00:00:00.001 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v23.11" build number 1000 00:00:00.002 originally caused by: 00:00:00.002 Started by upstream project "nightly-trigger" build number 3667 00:00:00.002 originally caused by: 00:00:00.002 Started by timer 00:00:00.190 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.190 The recommended git tool is: git 00:00:00.190 using credential 00000000-0000-0000-0000-000000000002 00:00:00.193 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.206 Fetching changes from the remote Git repository 00:00:00.207 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.225 Using shallow fetch with depth 1 00:00:00.225 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.225 > git --version # timeout=10 00:00:00.240 > git --version # 'git version 2.39.2' 00:00:00.240 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.259 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.259 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:06.192 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.204 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.217 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:06.217 > git config core.sparsecheckout # timeout=10 00:00:06.226 > git read-tree -mu HEAD # timeout=10 00:00:06.243 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:06.266 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:06.266 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:06.374 [Pipeline] Start of Pipeline 00:00:06.385 [Pipeline] library 00:00:06.386 Loading library shm_lib@master 00:00:06.386 Library shm_lib@master is cached. Copying from home. 00:00:06.399 [Pipeline] node 00:00:06.406 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:06.407 [Pipeline] { 00:00:06.415 [Pipeline] catchError 00:00:06.416 [Pipeline] { 00:00:06.424 [Pipeline] wrap 00:00:06.430 [Pipeline] { 00:00:06.435 [Pipeline] stage 00:00:06.436 [Pipeline] { (Prologue) 00:00:06.625 [Pipeline] sh 00:00:06.907 + logger -p user.info -t JENKINS-CI 00:00:06.926 [Pipeline] echo 00:00:06.928 Node: GP11 00:00:06.936 [Pipeline] sh 00:00:07.236 [Pipeline] setCustomBuildProperty 00:00:07.248 [Pipeline] echo 00:00:07.249 Cleanup processes 00:00:07.255 [Pipeline] sh 00:00:07.539 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.539 3085219 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.554 [Pipeline] sh 00:00:07.840 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.840 ++ grep -v 'sudo pgrep' 00:00:07.840 ++ awk '{print $1}' 00:00:07.840 + sudo kill -9 00:00:07.840 + true 00:00:07.856 [Pipeline] cleanWs 00:00:07.869 [WS-CLEANUP] Deleting project workspace... 00:00:07.869 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.876 [WS-CLEANUP] done 00:00:07.882 [Pipeline] setCustomBuildProperty 00:00:07.901 [Pipeline] sh 00:00:08.184 + sudo git config --global --replace-all safe.directory '*' 00:00:08.293 [Pipeline] httpRequest 00:00:09.354 [Pipeline] echo 00:00:09.356 Sorcerer 10.211.164.101 is alive 00:00:09.366 [Pipeline] retry 00:00:09.368 [Pipeline] { 00:00:09.382 [Pipeline] httpRequest 00:00:09.387 HttpMethod: GET 00:00:09.388 URL: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.388 Sending request to url: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.412 Response Code: HTTP/1.1 200 OK 00:00:09.413 Success: Status code 200 is in the accepted range: 200,404 00:00:09.413 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:33.615 [Pipeline] } 00:00:33.637 [Pipeline] // retry 00:00:33.645 [Pipeline] sh 00:00:33.933 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:33.951 [Pipeline] httpRequest 00:00:34.362 [Pipeline] echo 00:00:34.364 Sorcerer 10.211.164.101 is alive 00:00:34.378 [Pipeline] retry 00:00:34.380 [Pipeline] { 00:00:34.395 [Pipeline] httpRequest 00:00:34.400 HttpMethod: GET 00:00:34.401 URL: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:34.401 Sending request to url: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:34.407 Response Code: HTTP/1.1 200 OK 00:00:34.407 Success: Status code 200 is in the accepted range: 200,404 00:00:34.408 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:03.239 [Pipeline] } 00:01:03.257 [Pipeline] // retry 00:01:03.265 [Pipeline] sh 00:01:03.554 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:06.104 [Pipeline] sh 00:01:06.393 + git -C spdk log --oneline -n5 00:01:06.393 c13c99a5e test: Various fixes for Fedora40 00:01:06.393 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:06.393 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:06.393 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:06.393 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:06.412 [Pipeline] withCredentials 00:01:06.423 > git --version # timeout=10 00:01:06.435 > git --version # 'git version 2.39.2' 00:01:06.453 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:01:06.455 [Pipeline] { 00:01:06.463 [Pipeline] retry 00:01:06.465 [Pipeline] { 00:01:06.481 [Pipeline] sh 00:01:06.768 + git ls-remote http://dpdk.org/git/dpdk-stable v23.11 00:01:06.783 [Pipeline] } 00:01:06.806 [Pipeline] // retry 00:01:06.812 [Pipeline] } 00:01:06.831 [Pipeline] // withCredentials 00:01:06.842 [Pipeline] httpRequest 00:01:07.238 [Pipeline] echo 00:01:07.240 Sorcerer 10.211.164.101 is alive 00:01:07.251 [Pipeline] retry 00:01:07.253 [Pipeline] { 00:01:07.266 [Pipeline] httpRequest 00:01:07.271 HttpMethod: GET 00:01:07.271 URL: http://10.211.164.101/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:07.272 Sending request to url: http://10.211.164.101/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:07.274 Response Code: HTTP/1.1 200 OK 00:01:07.275 Success: Status code 200 is in the accepted range: 200,404 00:01:07.275 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:13.404 [Pipeline] } 00:01:13.424 [Pipeline] // retry 00:01:13.433 [Pipeline] sh 00:01:13.722 + tar --no-same-owner -xf dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:15.113 [Pipeline] sh 00:01:15.404 + git -C dpdk log --oneline -n5 00:01:15.404 eeb0605f11 version: 23.11.0 00:01:15.404 238778122a doc: update release notes for 23.11 00:01:15.404 46aa6b3cfc doc: fix description of RSS features 00:01:15.404 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:15.404 7e421ae345 devtools: support skipping forbid rule check 00:01:15.416 [Pipeline] } 00:01:15.429 [Pipeline] // stage 00:01:15.438 [Pipeline] stage 00:01:15.441 [Pipeline] { (Prepare) 00:01:15.467 [Pipeline] writeFile 00:01:15.485 [Pipeline] sh 00:01:15.776 + logger -p user.info -t JENKINS-CI 00:01:15.789 [Pipeline] sh 00:01:16.075 + logger -p user.info -t JENKINS-CI 00:01:16.086 [Pipeline] sh 00:01:16.370 + cat autorun-spdk.conf 00:01:16.370 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:16.370 SPDK_TEST_NVMF=1 00:01:16.370 SPDK_TEST_NVME_CLI=1 00:01:16.370 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:16.370 SPDK_TEST_NVMF_NICS=e810 00:01:16.370 SPDK_TEST_VFIOUSER=1 00:01:16.370 SPDK_RUN_UBSAN=1 00:01:16.370 NET_TYPE=phy 00:01:16.370 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:16.370 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:16.378 RUN_NIGHTLY=1 00:01:16.384 [Pipeline] readFile 00:01:16.416 [Pipeline] withEnv 00:01:16.418 [Pipeline] { 00:01:16.435 [Pipeline] sh 00:01:16.723 + set -ex 00:01:16.723 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:16.723 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:16.723 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:16.723 ++ SPDK_TEST_NVMF=1 00:01:16.723 ++ SPDK_TEST_NVME_CLI=1 00:01:16.723 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:16.723 ++ SPDK_TEST_NVMF_NICS=e810 00:01:16.723 ++ SPDK_TEST_VFIOUSER=1 00:01:16.723 ++ SPDK_RUN_UBSAN=1 00:01:16.723 ++ NET_TYPE=phy 00:01:16.723 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:16.723 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:16.723 ++ RUN_NIGHTLY=1 00:01:16.723 + case $SPDK_TEST_NVMF_NICS in 00:01:16.723 + DRIVERS=ice 00:01:16.723 + [[ tcp == \r\d\m\a ]] 00:01:16.723 + [[ -n ice ]] 00:01:16.723 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:16.723 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:16.723 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:16.723 rmmod: ERROR: Module irdma is not currently loaded 00:01:16.723 rmmod: ERROR: Module i40iw is not currently loaded 00:01:16.723 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:16.723 + true 00:01:16.723 + for D in $DRIVERS 00:01:16.723 + sudo modprobe ice 00:01:16.723 + exit 0 00:01:16.735 [Pipeline] } 00:01:16.752 [Pipeline] // withEnv 00:01:16.758 [Pipeline] } 00:01:16.773 [Pipeline] // stage 00:01:16.783 [Pipeline] catchError 00:01:16.784 [Pipeline] { 00:01:16.796 [Pipeline] timeout 00:01:16.796 Timeout set to expire in 1 hr 0 min 00:01:16.798 [Pipeline] { 00:01:16.809 [Pipeline] stage 00:01:16.811 [Pipeline] { (Tests) 00:01:16.822 [Pipeline] sh 00:01:17.108 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:17.108 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:17.108 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:17.108 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:17.109 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:17.109 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:17.109 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:17.109 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:17.109 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:17.109 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:17.109 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:17.109 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:17.109 + source /etc/os-release 00:01:17.109 ++ NAME='Fedora Linux' 00:01:17.109 ++ VERSION='39 (Cloud Edition)' 00:01:17.109 ++ ID=fedora 00:01:17.109 ++ VERSION_ID=39 00:01:17.109 ++ VERSION_CODENAME= 00:01:17.109 ++ PLATFORM_ID=platform:f39 00:01:17.109 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:17.109 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:17.109 ++ LOGO=fedora-logo-icon 00:01:17.109 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:17.109 ++ HOME_URL=https://fedoraproject.org/ 00:01:17.109 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:17.109 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:17.109 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:17.109 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:17.109 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:17.109 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:17.109 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:17.109 ++ SUPPORT_END=2024-11-12 00:01:17.109 ++ VARIANT='Cloud Edition' 00:01:17.109 ++ VARIANT_ID=cloud 00:01:17.109 + uname -a 00:01:17.109 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:17.109 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:18.050 Hugepages 00:01:18.050 node hugesize free / total 00:01:18.050 node0 1048576kB 0 / 0 00:01:18.050 node0 2048kB 0 / 0 00:01:18.050 node1 1048576kB 0 / 0 00:01:18.050 node1 2048kB 0 / 0 00:01:18.050 00:01:18.050 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:18.050 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:18.050 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:18.050 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:18.050 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:18.050 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:18.050 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:18.050 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:18.050 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:18.050 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:18.050 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:18.050 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:18.050 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:18.050 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:18.050 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:18.050 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:18.050 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:18.050 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:18.310 + rm -f /tmp/spdk-ld-path 00:01:18.310 + source autorun-spdk.conf 00:01:18.310 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:18.310 ++ SPDK_TEST_NVMF=1 00:01:18.310 ++ SPDK_TEST_NVME_CLI=1 00:01:18.310 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:18.310 ++ SPDK_TEST_NVMF_NICS=e810 00:01:18.310 ++ SPDK_TEST_VFIOUSER=1 00:01:18.310 ++ SPDK_RUN_UBSAN=1 00:01:18.310 ++ NET_TYPE=phy 00:01:18.310 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:18.310 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:18.310 ++ RUN_NIGHTLY=1 00:01:18.310 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:18.310 + [[ -n '' ]] 00:01:18.310 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:18.310 + for M in /var/spdk/build-*-manifest.txt 00:01:18.310 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:18.310 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:18.310 + for M in /var/spdk/build-*-manifest.txt 00:01:18.310 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:18.310 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:18.310 + for M in /var/spdk/build-*-manifest.txt 00:01:18.310 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:18.310 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:18.310 ++ uname 00:01:18.310 + [[ Linux == \L\i\n\u\x ]] 00:01:18.310 + sudo dmesg -T 00:01:18.310 + sudo dmesg --clear 00:01:18.310 + dmesg_pid=3086540 00:01:18.310 + [[ Fedora Linux == FreeBSD ]] 00:01:18.310 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:18.310 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:18.310 + sudo dmesg -Tw 00:01:18.310 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:18.310 + [[ -x /usr/src/fio-static/fio ]] 00:01:18.310 + export FIO_BIN=/usr/src/fio-static/fio 00:01:18.310 + FIO_BIN=/usr/src/fio-static/fio 00:01:18.310 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:18.310 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:18.310 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:18.310 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:18.310 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:18.310 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:18.310 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:18.310 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:18.310 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:18.310 Test configuration: 00:01:18.310 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:18.310 SPDK_TEST_NVMF=1 00:01:18.310 SPDK_TEST_NVME_CLI=1 00:01:18.310 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:18.310 SPDK_TEST_NVMF_NICS=e810 00:01:18.310 SPDK_TEST_VFIOUSER=1 00:01:18.310 SPDK_RUN_UBSAN=1 00:01:18.310 NET_TYPE=phy 00:01:18.310 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:18.310 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:18.310 RUN_NIGHTLY=1 04:57:19 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:18.310 04:57:19 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:18.310 04:57:19 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:18.310 04:57:19 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:18.310 04:57:19 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:18.310 04:57:19 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:18.310 04:57:19 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:18.310 04:57:19 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:18.310 04:57:19 -- paths/export.sh@5 -- $ export PATH 00:01:18.310 04:57:19 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:18.310 04:57:19 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:18.310 04:57:19 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:18.310 04:57:19 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732593439.XXXXXX 00:01:18.310 04:57:19 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732593439.VDZkRO 00:01:18.310 04:57:19 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:18.310 04:57:19 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:01:18.310 04:57:19 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:18.310 04:57:19 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:18.310 04:57:19 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:18.310 04:57:19 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:18.310 04:57:19 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:18.310 04:57:19 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:18.310 04:57:19 -- common/autotest_common.sh@10 -- $ set +x 00:01:18.310 04:57:19 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:18.311 04:57:19 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:18.311 04:57:19 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:18.311 04:57:19 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:18.311 04:57:19 -- spdk/autobuild.sh@16 -- $ date -u 00:01:18.311 Tue Nov 26 03:57:19 AM UTC 2024 00:01:18.311 04:57:19 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:18.311 LTS-67-gc13c99a5e 00:01:18.311 04:57:19 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:18.311 04:57:19 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:18.311 04:57:19 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:18.311 04:57:19 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:18.311 04:57:19 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:18.311 04:57:19 -- common/autotest_common.sh@10 -- $ set +x 00:01:18.311 ************************************ 00:01:18.311 START TEST ubsan 00:01:18.311 ************************************ 00:01:18.311 04:57:19 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:18.311 using ubsan 00:01:18.311 00:01:18.311 real 0m0.000s 00:01:18.311 user 0m0.000s 00:01:18.311 sys 0m0.000s 00:01:18.311 04:57:19 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:18.311 04:57:19 -- common/autotest_common.sh@10 -- $ set +x 00:01:18.311 ************************************ 00:01:18.311 END TEST ubsan 00:01:18.311 ************************************ 00:01:18.311 04:57:20 -- spdk/autobuild.sh@27 -- $ '[' -n v23.11 ']' 00:01:18.311 04:57:20 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:18.311 04:57:20 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:18.311 04:57:20 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:18.311 04:57:20 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:18.311 04:57:20 -- common/autotest_common.sh@10 -- $ set +x 00:01:18.311 ************************************ 00:01:18.311 START TEST build_native_dpdk 00:01:18.311 ************************************ 00:01:18.311 04:57:20 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:18.311 04:57:20 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:18.311 04:57:20 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:18.311 04:57:20 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:18.311 04:57:20 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:18.311 04:57:20 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:18.311 04:57:20 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:18.311 04:57:20 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:18.311 04:57:20 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:18.311 04:57:20 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:18.311 04:57:20 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:18.311 04:57:20 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:18.311 04:57:20 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:18.311 04:57:20 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:18.311 04:57:20 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:18.311 04:57:20 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:18.311 04:57:20 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:18.311 04:57:20 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:18.311 04:57:20 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:18.311 04:57:20 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:18.311 04:57:20 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:18.311 eeb0605f11 version: 23.11.0 00:01:18.311 238778122a doc: update release notes for 23.11 00:01:18.311 46aa6b3cfc doc: fix description of RSS features 00:01:18.311 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:18.311 7e421ae345 devtools: support skipping forbid rule check 00:01:18.311 04:57:20 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:18.311 04:57:20 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:18.311 04:57:20 -- common/autobuild_common.sh@87 -- $ dpdk_ver=23.11.0 00:01:18.311 04:57:20 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:18.311 04:57:20 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:18.311 04:57:20 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:18.311 04:57:20 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:18.311 04:57:20 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:18.311 04:57:20 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:18.311 04:57:20 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:18.311 04:57:20 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:18.311 04:57:20 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:18.311 04:57:20 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:18.311 04:57:20 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:18.311 04:57:20 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:18.311 04:57:20 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:18.311 04:57:20 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:18.311 04:57:20 -- common/autobuild_common.sh@169 -- $ lt 23.11.0 21.11.0 00:01:18.311 04:57:20 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 21.11.0 00:01:18.311 04:57:20 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:18.311 04:57:20 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:18.311 04:57:20 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:18.311 04:57:20 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:18.311 04:57:20 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:18.311 04:57:20 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:18.311 04:57:20 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:18.311 04:57:20 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:18.311 04:57:20 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:18.311 04:57:20 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:18.311 04:57:20 -- scripts/common.sh@343 -- $ case "$op" in 00:01:18.311 04:57:20 -- scripts/common.sh@344 -- $ : 1 00:01:18.311 04:57:20 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:18.311 04:57:20 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:18.311 04:57:20 -- scripts/common.sh@364 -- $ decimal 23 00:01:18.311 04:57:20 -- scripts/common.sh@352 -- $ local d=23 00:01:18.311 04:57:20 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:18.311 04:57:20 -- scripts/common.sh@354 -- $ echo 23 00:01:18.311 04:57:20 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:18.311 04:57:20 -- scripts/common.sh@365 -- $ decimal 21 00:01:18.311 04:57:20 -- scripts/common.sh@352 -- $ local d=21 00:01:18.311 04:57:20 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:18.311 04:57:20 -- scripts/common.sh@354 -- $ echo 21 00:01:18.311 04:57:20 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:18.311 04:57:20 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:18.311 04:57:20 -- scripts/common.sh@366 -- $ return 1 00:01:18.311 04:57:20 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:18.311 patching file config/rte_config.h 00:01:18.311 Hunk #1 succeeded at 60 (offset 1 line). 00:01:18.311 04:57:20 -- common/autobuild_common.sh@176 -- $ lt 23.11.0 24.07.0 00:01:18.311 04:57:20 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 24.07.0 00:01:18.311 04:57:20 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:18.311 04:57:20 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:18.311 04:57:20 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:18.311 04:57:20 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:18.311 04:57:20 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:18.311 04:57:20 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:18.311 04:57:20 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:18.311 04:57:20 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:18.311 04:57:20 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:18.311 04:57:20 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:18.311 04:57:20 -- scripts/common.sh@343 -- $ case "$op" in 00:01:18.311 04:57:20 -- scripts/common.sh@344 -- $ : 1 00:01:18.311 04:57:20 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:18.311 04:57:20 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:18.311 04:57:20 -- scripts/common.sh@364 -- $ decimal 23 00:01:18.311 04:57:20 -- scripts/common.sh@352 -- $ local d=23 00:01:18.311 04:57:20 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:18.311 04:57:20 -- scripts/common.sh@354 -- $ echo 23 00:01:18.311 04:57:20 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:18.311 04:57:20 -- scripts/common.sh@365 -- $ decimal 24 00:01:18.311 04:57:20 -- scripts/common.sh@352 -- $ local d=24 00:01:18.311 04:57:20 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:18.311 04:57:20 -- scripts/common.sh@354 -- $ echo 24 00:01:18.311 04:57:20 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:18.311 04:57:20 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:18.311 04:57:20 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:18.311 04:57:20 -- scripts/common.sh@367 -- $ return 0 00:01:18.311 04:57:20 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:18.311 patching file lib/pcapng/rte_pcapng.c 00:01:18.311 04:57:20 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:18.311 04:57:20 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:18.311 04:57:20 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:18.311 04:57:20 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:18.311 04:57:20 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:23.586 The Meson build system 00:01:23.586 Version: 1.5.0 00:01:23.586 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:23.586 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:23.586 Build type: native build 00:01:23.586 Program cat found: YES (/usr/bin/cat) 00:01:23.586 Project name: DPDK 00:01:23.586 Project version: 23.11.0 00:01:23.586 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:23.586 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:23.586 Host machine cpu family: x86_64 00:01:23.586 Host machine cpu: x86_64 00:01:23.586 Message: ## Building in Developer Mode ## 00:01:23.586 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:23.586 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:23.586 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:23.586 Program python3 found: YES (/usr/bin/python3) 00:01:23.586 Program cat found: YES (/usr/bin/cat) 00:01:23.586 config/meson.build:113: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:23.586 Compiler for C supports arguments -march=native: YES 00:01:23.586 Checking for size of "void *" : 8 00:01:23.586 Checking for size of "void *" : 8 (cached) 00:01:23.586 Library m found: YES 00:01:23.586 Library numa found: YES 00:01:23.586 Has header "numaif.h" : YES 00:01:23.586 Library fdt found: NO 00:01:23.586 Library execinfo found: NO 00:01:23.586 Has header "execinfo.h" : YES 00:01:23.586 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:23.586 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:23.586 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:23.586 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:23.586 Run-time dependency openssl found: YES 3.1.1 00:01:23.586 Run-time dependency libpcap found: YES 1.10.4 00:01:23.586 Has header "pcap.h" with dependency libpcap: YES 00:01:23.586 Compiler for C supports arguments -Wcast-qual: YES 00:01:23.586 Compiler for C supports arguments -Wdeprecated: YES 00:01:23.586 Compiler for C supports arguments -Wformat: YES 00:01:23.586 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:23.586 Compiler for C supports arguments -Wformat-security: NO 00:01:23.586 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:23.586 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:23.586 Compiler for C supports arguments -Wnested-externs: YES 00:01:23.586 Compiler for C supports arguments -Wold-style-definition: YES 00:01:23.586 Compiler for C supports arguments -Wpointer-arith: YES 00:01:23.586 Compiler for C supports arguments -Wsign-compare: YES 00:01:23.586 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:23.586 Compiler for C supports arguments -Wundef: YES 00:01:23.586 Compiler for C supports arguments -Wwrite-strings: YES 00:01:23.586 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:23.586 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:23.586 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:23.586 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:23.586 Program objdump found: YES (/usr/bin/objdump) 00:01:23.586 Compiler for C supports arguments -mavx512f: YES 00:01:23.586 Checking if "AVX512 checking" compiles: YES 00:01:23.586 Fetching value of define "__SSE4_2__" : 1 00:01:23.586 Fetching value of define "__AES__" : 1 00:01:23.586 Fetching value of define "__AVX__" : 1 00:01:23.586 Fetching value of define "__AVX2__" : (undefined) 00:01:23.586 Fetching value of define "__AVX512BW__" : (undefined) 00:01:23.586 Fetching value of define "__AVX512CD__" : (undefined) 00:01:23.586 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:23.586 Fetching value of define "__AVX512F__" : (undefined) 00:01:23.586 Fetching value of define "__AVX512VL__" : (undefined) 00:01:23.586 Fetching value of define "__PCLMUL__" : 1 00:01:23.586 Fetching value of define "__RDRND__" : 1 00:01:23.586 Fetching value of define "__RDSEED__" : (undefined) 00:01:23.586 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:23.586 Fetching value of define "__znver1__" : (undefined) 00:01:23.586 Fetching value of define "__znver2__" : (undefined) 00:01:23.586 Fetching value of define "__znver3__" : (undefined) 00:01:23.586 Fetching value of define "__znver4__" : (undefined) 00:01:23.586 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:23.586 Message: lib/log: Defining dependency "log" 00:01:23.586 Message: lib/kvargs: Defining dependency "kvargs" 00:01:23.586 Message: lib/telemetry: Defining dependency "telemetry" 00:01:23.586 Checking for function "getentropy" : NO 00:01:23.586 Message: lib/eal: Defining dependency "eal" 00:01:23.586 Message: lib/ring: Defining dependency "ring" 00:01:23.586 Message: lib/rcu: Defining dependency "rcu" 00:01:23.587 Message: lib/mempool: Defining dependency "mempool" 00:01:23.587 Message: lib/mbuf: Defining dependency "mbuf" 00:01:23.587 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:23.587 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:23.587 Compiler for C supports arguments -mpclmul: YES 00:01:23.587 Compiler for C supports arguments -maes: YES 00:01:23.587 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:23.587 Compiler for C supports arguments -mavx512bw: YES 00:01:23.587 Compiler for C supports arguments -mavx512dq: YES 00:01:23.587 Compiler for C supports arguments -mavx512vl: YES 00:01:23.587 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:23.587 Compiler for C supports arguments -mavx2: YES 00:01:23.587 Compiler for C supports arguments -mavx: YES 00:01:23.587 Message: lib/net: Defining dependency "net" 00:01:23.587 Message: lib/meter: Defining dependency "meter" 00:01:23.587 Message: lib/ethdev: Defining dependency "ethdev" 00:01:23.587 Message: lib/pci: Defining dependency "pci" 00:01:23.587 Message: lib/cmdline: Defining dependency "cmdline" 00:01:23.587 Message: lib/metrics: Defining dependency "metrics" 00:01:23.587 Message: lib/hash: Defining dependency "hash" 00:01:23.587 Message: lib/timer: Defining dependency "timer" 00:01:23.587 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:23.587 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:23.587 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:23.587 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:23.587 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:23.587 Message: lib/acl: Defining dependency "acl" 00:01:23.587 Message: lib/bbdev: Defining dependency "bbdev" 00:01:23.587 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:23.587 Run-time dependency libelf found: YES 0.191 00:01:23.587 Message: lib/bpf: Defining dependency "bpf" 00:01:23.587 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:23.587 Message: lib/compressdev: Defining dependency "compressdev" 00:01:23.587 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:23.587 Message: lib/distributor: Defining dependency "distributor" 00:01:23.587 Message: lib/dmadev: Defining dependency "dmadev" 00:01:23.587 Message: lib/efd: Defining dependency "efd" 00:01:23.587 Message: lib/eventdev: Defining dependency "eventdev" 00:01:23.587 Message: lib/dispatcher: Defining dependency "dispatcher" 00:01:23.587 Message: lib/gpudev: Defining dependency "gpudev" 00:01:23.587 Message: lib/gro: Defining dependency "gro" 00:01:23.587 Message: lib/gso: Defining dependency "gso" 00:01:23.587 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:23.587 Message: lib/jobstats: Defining dependency "jobstats" 00:01:23.587 Message: lib/latencystats: Defining dependency "latencystats" 00:01:23.587 Message: lib/lpm: Defining dependency "lpm" 00:01:23.587 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:23.587 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:23.587 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:23.587 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:23.587 Message: lib/member: Defining dependency "member" 00:01:23.587 Message: lib/pcapng: Defining dependency "pcapng" 00:01:23.587 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:23.587 Message: lib/power: Defining dependency "power" 00:01:23.587 Message: lib/rawdev: Defining dependency "rawdev" 00:01:23.587 Message: lib/regexdev: Defining dependency "regexdev" 00:01:23.587 Message: lib/mldev: Defining dependency "mldev" 00:01:23.587 Message: lib/rib: Defining dependency "rib" 00:01:23.587 Message: lib/reorder: Defining dependency "reorder" 00:01:23.587 Message: lib/sched: Defining dependency "sched" 00:01:23.587 Message: lib/security: Defining dependency "security" 00:01:23.587 Message: lib/stack: Defining dependency "stack" 00:01:23.587 Has header "linux/userfaultfd.h" : YES 00:01:23.587 Has header "linux/vduse.h" : YES 00:01:23.587 Message: lib/vhost: Defining dependency "vhost" 00:01:23.587 Message: lib/ipsec: Defining dependency "ipsec" 00:01:23.587 Message: lib/pdcp: Defining dependency "pdcp" 00:01:23.587 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:23.587 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:23.587 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:23.587 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:23.587 Message: lib/fib: Defining dependency "fib" 00:01:23.587 Message: lib/port: Defining dependency "port" 00:01:23.587 Message: lib/pdump: Defining dependency "pdump" 00:01:23.587 Message: lib/table: Defining dependency "table" 00:01:23.587 Message: lib/pipeline: Defining dependency "pipeline" 00:01:23.587 Message: lib/graph: Defining dependency "graph" 00:01:23.587 Message: lib/node: Defining dependency "node" 00:01:24.970 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:24.970 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:24.970 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:24.970 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:24.970 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:24.970 Compiler for C supports arguments -Wno-unused-value: YES 00:01:24.970 Compiler for C supports arguments -Wno-format: YES 00:01:24.970 Compiler for C supports arguments -Wno-format-security: YES 00:01:24.970 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:24.970 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:24.970 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:24.970 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:24.970 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:24.970 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:24.970 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:24.970 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:24.970 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:24.970 Has header "sys/epoll.h" : YES 00:01:24.970 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:24.970 Configuring doxy-api-html.conf using configuration 00:01:24.970 Configuring doxy-api-man.conf using configuration 00:01:24.970 Program mandb found: YES (/usr/bin/mandb) 00:01:24.970 Program sphinx-build found: NO 00:01:24.970 Configuring rte_build_config.h using configuration 00:01:24.970 Message: 00:01:24.970 ================= 00:01:24.970 Applications Enabled 00:01:24.970 ================= 00:01:24.970 00:01:24.970 apps: 00:01:24.970 dumpcap, graph, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, 00:01:24.970 test-crypto-perf, test-dma-perf, test-eventdev, test-fib, test-flow-perf, test-gpudev, test-mldev, test-pipeline, 00:01:24.970 test-pmd, test-regex, test-sad, test-security-perf, 00:01:24.970 00:01:24.970 Message: 00:01:24.970 ================= 00:01:24.970 Libraries Enabled 00:01:24.970 ================= 00:01:24.970 00:01:24.970 libs: 00:01:24.970 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:24.970 net, meter, ethdev, pci, cmdline, metrics, hash, timer, 00:01:24.970 acl, bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, 00:01:24.970 dmadev, efd, eventdev, dispatcher, gpudev, gro, gso, ip_frag, 00:01:24.970 jobstats, latencystats, lpm, member, pcapng, power, rawdev, regexdev, 00:01:24.970 mldev, rib, reorder, sched, security, stack, vhost, ipsec, 00:01:24.970 pdcp, fib, port, pdump, table, pipeline, graph, node, 00:01:24.970 00:01:24.970 00:01:24.970 Message: 00:01:24.970 =============== 00:01:24.970 Drivers Enabled 00:01:24.970 =============== 00:01:24.970 00:01:24.970 common: 00:01:24.971 00:01:24.971 bus: 00:01:24.971 pci, vdev, 00:01:24.971 mempool: 00:01:24.971 ring, 00:01:24.971 dma: 00:01:24.971 00:01:24.971 net: 00:01:24.971 i40e, 00:01:24.971 raw: 00:01:24.971 00:01:24.971 crypto: 00:01:24.971 00:01:24.971 compress: 00:01:24.971 00:01:24.971 regex: 00:01:24.971 00:01:24.971 ml: 00:01:24.971 00:01:24.971 vdpa: 00:01:24.971 00:01:24.971 event: 00:01:24.971 00:01:24.971 baseband: 00:01:24.971 00:01:24.971 gpu: 00:01:24.971 00:01:24.971 00:01:24.971 Message: 00:01:24.971 ================= 00:01:24.971 Content Skipped 00:01:24.971 ================= 00:01:24.971 00:01:24.971 apps: 00:01:24.971 00:01:24.971 libs: 00:01:24.971 00:01:24.971 drivers: 00:01:24.971 common/cpt: not in enabled drivers build config 00:01:24.971 common/dpaax: not in enabled drivers build config 00:01:24.971 common/iavf: not in enabled drivers build config 00:01:24.971 common/idpf: not in enabled drivers build config 00:01:24.971 common/mvep: not in enabled drivers build config 00:01:24.971 common/octeontx: not in enabled drivers build config 00:01:24.971 bus/auxiliary: not in enabled drivers build config 00:01:24.971 bus/cdx: not in enabled drivers build config 00:01:24.971 bus/dpaa: not in enabled drivers build config 00:01:24.971 bus/fslmc: not in enabled drivers build config 00:01:24.971 bus/ifpga: not in enabled drivers build config 00:01:24.971 bus/platform: not in enabled drivers build config 00:01:24.971 bus/vmbus: not in enabled drivers build config 00:01:24.971 common/cnxk: not in enabled drivers build config 00:01:24.971 common/mlx5: not in enabled drivers build config 00:01:24.971 common/nfp: not in enabled drivers build config 00:01:24.971 common/qat: not in enabled drivers build config 00:01:24.971 common/sfc_efx: not in enabled drivers build config 00:01:24.971 mempool/bucket: not in enabled drivers build config 00:01:24.971 mempool/cnxk: not in enabled drivers build config 00:01:24.971 mempool/dpaa: not in enabled drivers build config 00:01:24.971 mempool/dpaa2: not in enabled drivers build config 00:01:24.971 mempool/octeontx: not in enabled drivers build config 00:01:24.971 mempool/stack: not in enabled drivers build config 00:01:24.971 dma/cnxk: not in enabled drivers build config 00:01:24.971 dma/dpaa: not in enabled drivers build config 00:01:24.971 dma/dpaa2: not in enabled drivers build config 00:01:24.971 dma/hisilicon: not in enabled drivers build config 00:01:24.971 dma/idxd: not in enabled drivers build config 00:01:24.971 dma/ioat: not in enabled drivers build config 00:01:24.971 dma/skeleton: not in enabled drivers build config 00:01:24.971 net/af_packet: not in enabled drivers build config 00:01:24.971 net/af_xdp: not in enabled drivers build config 00:01:24.971 net/ark: not in enabled drivers build config 00:01:24.971 net/atlantic: not in enabled drivers build config 00:01:24.971 net/avp: not in enabled drivers build config 00:01:24.971 net/axgbe: not in enabled drivers build config 00:01:24.971 net/bnx2x: not in enabled drivers build config 00:01:24.971 net/bnxt: not in enabled drivers build config 00:01:24.971 net/bonding: not in enabled drivers build config 00:01:24.971 net/cnxk: not in enabled drivers build config 00:01:24.971 net/cpfl: not in enabled drivers build config 00:01:24.971 net/cxgbe: not in enabled drivers build config 00:01:24.971 net/dpaa: not in enabled drivers build config 00:01:24.971 net/dpaa2: not in enabled drivers build config 00:01:24.971 net/e1000: not in enabled drivers build config 00:01:24.971 net/ena: not in enabled drivers build config 00:01:24.971 net/enetc: not in enabled drivers build config 00:01:24.971 net/enetfec: not in enabled drivers build config 00:01:24.971 net/enic: not in enabled drivers build config 00:01:24.971 net/failsafe: not in enabled drivers build config 00:01:24.971 net/fm10k: not in enabled drivers build config 00:01:24.971 net/gve: not in enabled drivers build config 00:01:24.971 net/hinic: not in enabled drivers build config 00:01:24.971 net/hns3: not in enabled drivers build config 00:01:24.971 net/iavf: not in enabled drivers build config 00:01:24.971 net/ice: not in enabled drivers build config 00:01:24.971 net/idpf: not in enabled drivers build config 00:01:24.971 net/igc: not in enabled drivers build config 00:01:24.971 net/ionic: not in enabled drivers build config 00:01:24.971 net/ipn3ke: not in enabled drivers build config 00:01:24.971 net/ixgbe: not in enabled drivers build config 00:01:24.971 net/mana: not in enabled drivers build config 00:01:24.971 net/memif: not in enabled drivers build config 00:01:24.971 net/mlx4: not in enabled drivers build config 00:01:24.971 net/mlx5: not in enabled drivers build config 00:01:24.971 net/mvneta: not in enabled drivers build config 00:01:24.971 net/mvpp2: not in enabled drivers build config 00:01:24.971 net/netvsc: not in enabled drivers build config 00:01:24.971 net/nfb: not in enabled drivers build config 00:01:24.971 net/nfp: not in enabled drivers build config 00:01:24.971 net/ngbe: not in enabled drivers build config 00:01:24.971 net/null: not in enabled drivers build config 00:01:24.971 net/octeontx: not in enabled drivers build config 00:01:24.971 net/octeon_ep: not in enabled drivers build config 00:01:24.971 net/pcap: not in enabled drivers build config 00:01:24.971 net/pfe: not in enabled drivers build config 00:01:24.971 net/qede: not in enabled drivers build config 00:01:24.971 net/ring: not in enabled drivers build config 00:01:24.971 net/sfc: not in enabled drivers build config 00:01:24.971 net/softnic: not in enabled drivers build config 00:01:24.971 net/tap: not in enabled drivers build config 00:01:24.971 net/thunderx: not in enabled drivers build config 00:01:24.971 net/txgbe: not in enabled drivers build config 00:01:24.971 net/vdev_netvsc: not in enabled drivers build config 00:01:24.971 net/vhost: not in enabled drivers build config 00:01:24.971 net/virtio: not in enabled drivers build config 00:01:24.971 net/vmxnet3: not in enabled drivers build config 00:01:24.971 raw/cnxk_bphy: not in enabled drivers build config 00:01:24.971 raw/cnxk_gpio: not in enabled drivers build config 00:01:24.971 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:24.971 raw/ifpga: not in enabled drivers build config 00:01:24.971 raw/ntb: not in enabled drivers build config 00:01:24.971 raw/skeleton: not in enabled drivers build config 00:01:24.971 crypto/armv8: not in enabled drivers build config 00:01:24.971 crypto/bcmfs: not in enabled drivers build config 00:01:24.971 crypto/caam_jr: not in enabled drivers build config 00:01:24.971 crypto/ccp: not in enabled drivers build config 00:01:24.971 crypto/cnxk: not in enabled drivers build config 00:01:24.971 crypto/dpaa_sec: not in enabled drivers build config 00:01:24.971 crypto/dpaa2_sec: not in enabled drivers build config 00:01:24.971 crypto/ipsec_mb: not in enabled drivers build config 00:01:24.971 crypto/mlx5: not in enabled drivers build config 00:01:24.971 crypto/mvsam: not in enabled drivers build config 00:01:24.971 crypto/nitrox: not in enabled drivers build config 00:01:24.971 crypto/null: not in enabled drivers build config 00:01:24.971 crypto/octeontx: not in enabled drivers build config 00:01:24.971 crypto/openssl: not in enabled drivers build config 00:01:24.971 crypto/scheduler: not in enabled drivers build config 00:01:24.971 crypto/uadk: not in enabled drivers build config 00:01:24.971 crypto/virtio: not in enabled drivers build config 00:01:24.971 compress/isal: not in enabled drivers build config 00:01:24.971 compress/mlx5: not in enabled drivers build config 00:01:24.971 compress/octeontx: not in enabled drivers build config 00:01:24.971 compress/zlib: not in enabled drivers build config 00:01:24.971 regex/mlx5: not in enabled drivers build config 00:01:24.971 regex/cn9k: not in enabled drivers build config 00:01:24.971 ml/cnxk: not in enabled drivers build config 00:01:24.971 vdpa/ifc: not in enabled drivers build config 00:01:24.971 vdpa/mlx5: not in enabled drivers build config 00:01:24.971 vdpa/nfp: not in enabled drivers build config 00:01:24.971 vdpa/sfc: not in enabled drivers build config 00:01:24.971 event/cnxk: not in enabled drivers build config 00:01:24.971 event/dlb2: not in enabled drivers build config 00:01:24.971 event/dpaa: not in enabled drivers build config 00:01:24.971 event/dpaa2: not in enabled drivers build config 00:01:24.971 event/dsw: not in enabled drivers build config 00:01:24.971 event/opdl: not in enabled drivers build config 00:01:24.971 event/skeleton: not in enabled drivers build config 00:01:24.971 event/sw: not in enabled drivers build config 00:01:24.971 event/octeontx: not in enabled drivers build config 00:01:24.971 baseband/acc: not in enabled drivers build config 00:01:24.971 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:24.971 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:24.971 baseband/la12xx: not in enabled drivers build config 00:01:24.971 baseband/null: not in enabled drivers build config 00:01:24.971 baseband/turbo_sw: not in enabled drivers build config 00:01:24.971 gpu/cuda: not in enabled drivers build config 00:01:24.971 00:01:24.971 00:01:24.971 Build targets in project: 220 00:01:24.971 00:01:24.971 DPDK 23.11.0 00:01:24.971 00:01:24.971 User defined options 00:01:24.971 libdir : lib 00:01:24.971 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:24.971 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:24.971 c_link_args : 00:01:24.971 enable_docs : false 00:01:24.971 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:24.971 enable_kmods : false 00:01:24.971 machine : native 00:01:24.971 tests : false 00:01:24.971 00:01:24.971 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:24.971 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:24.971 04:57:26 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:24.971 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:24.971 [1/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:24.971 [2/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:24.971 [3/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:24.972 [4/710] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:24.972 [5/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:24.972 [6/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:24.972 [7/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:24.972 [8/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:24.972 [9/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:25.235 [10/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:25.235 [11/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:25.235 [12/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:25.235 [13/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:25.235 [14/710] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:25.235 [15/710] Linking static target lib/librte_kvargs.a 00:01:25.235 [16/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:25.235 [17/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:25.235 [18/710] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:25.235 [19/710] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:25.235 [20/710] Linking static target lib/librte_log.a 00:01:25.499 [21/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:25.499 [22/710] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.105 [23/710] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.105 [24/710] Linking target lib/librte_log.so.24.0 00:01:26.105 [25/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:26.105 [26/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:26.105 [27/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:26.105 [28/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:26.105 [29/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:26.105 [30/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:26.105 [31/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:26.105 [32/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:26.105 [33/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:26.105 [34/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:26.105 [35/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:26.105 [36/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:26.105 [37/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:26.105 [38/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:26.105 [39/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:26.105 [40/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:26.105 [41/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:26.105 [42/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:26.105 [43/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:26.381 [44/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:26.381 [45/710] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:26.381 [46/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:26.381 [47/710] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:26.381 [48/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:26.381 [49/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:26.381 [50/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:26.381 [51/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:26.381 [52/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:26.381 [53/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:26.381 [54/710] Linking target lib/librte_kvargs.so.24.0 00:01:26.381 [55/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:26.381 [56/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:26.381 [57/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:26.381 [58/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:26.381 [59/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:26.381 [60/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:26.381 [61/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:26.381 [62/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:26.381 [63/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:26.643 [64/710] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:26.643 [65/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:26.643 [66/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:26.643 [67/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:26.904 [68/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:26.904 [69/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:26.904 [70/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:26.904 [71/710] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:26.904 [72/710] Linking static target lib/librte_pci.a 00:01:26.904 [73/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:26.904 [74/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:26.904 [75/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:27.170 [76/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:27.170 [77/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:27.170 [78/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:27.170 [79/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:27.170 [80/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:27.170 [81/710] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.170 [82/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:27.170 [83/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:27.170 [84/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:27.170 [85/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:27.170 [86/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:27.435 [87/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:27.435 [88/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:27.435 [89/710] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:27.435 [90/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:27.435 [91/710] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:27.435 [92/710] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:27.435 [93/710] Linking static target lib/librte_ring.a 00:01:27.435 [94/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:27.435 [95/710] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:27.435 [96/710] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:27.435 [97/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:27.435 [98/710] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:27.435 [99/710] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:27.702 [100/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:27.703 [101/710] Linking static target lib/librte_meter.a 00:01:27.703 [102/710] Linking static target lib/librte_telemetry.a 00:01:27.703 [103/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:27.703 [104/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:27.703 [105/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:27.703 [106/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:27.703 [107/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:27.703 [108/710] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:27.703 [109/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:27.703 [110/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:27.703 [111/710] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:27.703 [112/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:27.703 [113/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:27.703 [114/710] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.962 [115/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:27.962 [116/710] Linking static target lib/librte_eal.a 00:01:27.962 [117/710] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.962 [118/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:27.962 [119/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:27.962 [120/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:27.962 [121/710] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:27.962 [122/710] Linking static target lib/librte_net.a 00:01:27.962 [123/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:27.962 [124/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:28.223 [125/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:28.224 [126/710] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.224 [127/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:28.224 [128/710] Linking static target lib/librte_cmdline.a 00:01:28.224 [129/710] Linking target lib/librte_telemetry.so.24.0 00:01:28.224 [130/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:28.224 [131/710] Linking static target lib/librte_mempool.a 00:01:28.224 [132/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:28.484 [133/710] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:28.484 [134/710] Linking static target lib/librte_cfgfile.a 00:01:28.484 [135/710] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.484 [136/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:28.484 [137/710] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:28.484 [138/710] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:28.484 [139/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:28.484 [140/710] Linking static target lib/librte_metrics.a 00:01:28.484 [141/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:28.484 [142/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:28.750 [143/710] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:28.750 [144/710] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:28.750 [145/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:29.013 [146/710] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:29.013 [147/710] Linking static target lib/librte_rcu.a 00:01:29.013 [148/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:29.013 [149/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:29.013 [150/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:29.013 [151/710] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:29.013 [152/710] Linking static target lib/librte_bitratestats.a 00:01:29.013 [153/710] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.013 [154/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:29.013 [155/710] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:29.013 [156/710] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.277 [157/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:29.277 [158/710] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:29.277 [159/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:29.277 [160/710] Linking static target lib/librte_timer.a 00:01:29.277 [161/710] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.277 [162/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:29.277 [163/710] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.277 [164/710] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.277 [165/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:29.277 [166/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:29.277 [167/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:29.539 [168/710] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:29.539 [169/710] Linking static target lib/librte_bbdev.a 00:01:29.539 [170/710] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.539 [171/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:29.540 [172/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:29.540 [173/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:29.804 [174/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:29.804 [175/710] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.804 [176/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:29.804 [177/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:29.804 [178/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:29.804 [179/710] Linking static target lib/librte_compressdev.a 00:01:29.804 [180/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:30.068 [181/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:30.068 [182/710] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:30.068 [183/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:30.068 [184/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:30.068 [185/710] Linking static target lib/librte_distributor.a 00:01:30.335 [186/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:30.335 [187/710] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.335 [188/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:30.598 [189/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:30.598 [190/710] Linking static target lib/librte_dmadev.a 00:01:30.598 [191/710] Linking static target lib/librte_bpf.a 00:01:30.598 [192/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:30.598 [193/710] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.598 [194/710] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:30.598 [195/710] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.598 [196/710] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:30.598 [197/710] Compiling C object lib/librte_dispatcher.a.p/dispatcher_rte_dispatcher.c.o 00:01:30.598 [198/710] Linking static target lib/librte_dispatcher.a 00:01:30.861 [199/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:30.861 [200/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:30.861 [201/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp6.c.o 00:01:30.861 [202/710] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:30.861 [203/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:30.861 [204/710] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:30.861 [205/710] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:30.861 [206/710] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:30.861 [207/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:30.861 [208/710] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:30.861 [209/710] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:30.861 [210/710] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.861 [211/710] Linking static target lib/librte_gpudev.a 00:01:30.861 [212/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:31.129 [213/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:31.129 [214/710] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:31.129 [215/710] Linking static target lib/librte_gro.a 00:01:31.129 [216/710] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.129 [217/710] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:31.129 [218/710] Linking static target lib/librte_jobstats.a 00:01:31.129 [219/710] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:31.392 [220/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:31.392 [221/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_dma_adapter.c.o 00:01:31.392 [222/710] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.392 [223/710] Generating lib/dispatcher.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.656 [224/710] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:31.656 [225/710] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.656 [226/710] Linking static target lib/librte_latencystats.a 00:01:31.656 [227/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:31.656 [228/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:31.656 [229/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:31.656 [230/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:31.656 [231/710] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:31.656 [232/710] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:31.919 [233/710] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:31.919 [234/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:31.919 [235/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:31.919 [236/710] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:31.919 [237/710] Linking static target lib/librte_ip_frag.a 00:01:31.919 [238/710] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.919 [239/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:32.183 [240/710] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:32.183 [241/710] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:32.183 [242/710] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:32.183 [243/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev_pmd.c.o 00:01:32.183 [244/710] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.183 [245/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:32.446 [246/710] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.446 [247/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils.c.o 00:01:32.446 [248/710] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:32.446 [249/710] Linking static target lib/librte_gso.a 00:01:32.446 [250/710] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:32.446 [251/710] Linking static target lib/librte_regexdev.a 00:01:32.446 [252/710] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:32.446 [253/710] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:32.709 [254/710] Linking static target lib/librte_rawdev.a 00:01:32.709 [255/710] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:32.709 [256/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev.c.o 00:01:32.709 [257/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:32.709 [258/710] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:32.709 [259/710] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.709 [260/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar_bfloat16.c.o 00:01:32.709 [261/710] Linking static target lib/librte_efd.a 00:01:32.709 [262/710] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:32.974 [263/710] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:32.974 [264/710] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:32.974 [265/710] Linking static target lib/librte_pcapng.a 00:01:32.974 [266/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar.c.o 00:01:32.974 [267/710] Linking static target lib/librte_mldev.a 00:01:32.974 [268/710] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:32.974 [269/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:32.974 [270/710] Linking static target lib/acl/libavx2_tmp.a 00:01:32.974 [271/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:32.974 [272/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:32.974 [273/710] Linking static target lib/librte_stack.a 00:01:33.239 [274/710] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.240 [275/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:33.240 [276/710] Linking static target lib/librte_lpm.a 00:01:33.240 [277/710] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:33.240 [278/710] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:33.240 [279/710] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:33.240 [280/710] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.240 [281/710] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.240 [282/710] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:33.240 [283/710] Linking static target lib/librte_hash.a 00:01:33.240 [284/710] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:33.240 [285/710] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:33.500 [286/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:33.500 [287/710] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.500 [288/710] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:33.500 [289/710] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:33.500 [290/710] Linking static target lib/librte_reorder.a 00:01:33.761 [291/710] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:33.761 [292/710] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:33.761 [293/710] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.761 [294/710] Linking static target lib/librte_power.a 00:01:33.761 [295/710] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.761 [296/710] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:33.761 [297/710] Linking static target lib/librte_security.a 00:01:33.761 [298/710] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:33.761 [299/710] Linking static target lib/acl/libavx512_tmp.a 00:01:33.761 [300/710] Linking static target lib/librte_acl.a 00:01:33.761 [301/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:34.022 [302/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:34.022 [303/710] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:34.022 [304/710] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:34.022 [305/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:34.022 [306/710] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.022 [307/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:34.284 [308/710] Linking static target lib/librte_mbuf.a 00:01:34.284 [309/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:34.284 [310/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_crypto.c.o 00:01:34.284 [311/710] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.284 [312/710] Linking static target lib/librte_rib.a 00:01:34.284 [313/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_ctrl_pdu.c.o 00:01:34.284 [314/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_reorder.c.o 00:01:34.284 [315/710] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.284 [316/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_cnt.c.o 00:01:34.284 [317/710] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:34.547 [318/710] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.547 [319/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:34.548 [320/710] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:34.548 [321/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:34.548 [322/710] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:34.548 [323/710] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:34.548 [324/710] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:34.548 [325/710] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:34.548 [326/710] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.548 [327/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:34.813 [328/710] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.813 [329/710] Generating lib/mldev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.813 [330/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:35.074 [331/710] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:35.074 [332/710] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.074 [333/710] Compiling C object lib/librte_pdcp.a.p/pdcp_rte_pdcp.c.o 00:01:35.339 [334/710] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:35.339 [335/710] Linking static target lib/librte_member.a 00:01:35.339 [336/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:35.339 [337/710] Linking static target lib/librte_eventdev.a 00:01:35.339 [338/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:35.339 [339/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:35.601 [340/710] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:35.601 [341/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:35.601 [342/710] Linking static target lib/librte_cryptodev.a 00:01:35.601 [343/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:35.601 [344/710] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:35.601 [345/710] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.601 [346/710] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:35.601 [347/710] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:35.601 [348/710] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:35.864 [349/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:35.864 [350/710] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:35.864 [351/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:35.864 [352/710] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:35.864 [353/710] Linking static target lib/librte_sched.a 00:01:35.864 [354/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:35.864 [355/710] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:35.864 [356/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:35.864 [357/710] Linking static target lib/librte_fib.a 00:01:35.864 [358/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:35.864 [359/710] Linking static target lib/librte_ethdev.a 00:01:35.864 [360/710] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:36.132 [361/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:36.132 [362/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:36.132 [363/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:36.132 [364/710] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:36.132 [365/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:36.132 [366/710] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:36.399 [367/710] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:36.399 [368/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:36.399 [369/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:36.399 [370/710] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.399 [371/710] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.399 [372/710] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:36.399 [373/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:36.659 [374/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:36.659 [375/710] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:36.659 [376/710] Linking static target lib/librte_pdump.a 00:01:36.927 [377/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:36.927 [378/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_worker.c.o 00:01:36.927 [379/710] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:36.927 [380/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:36.927 [381/710] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:36.927 [382/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:36.927 [383/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:37.187 [384/710] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:37.187 [385/710] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:37.187 [386/710] Compiling C object lib/librte_graph.a.p/graph_graph_pcap.c.o 00:01:37.187 [387/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:37.187 [388/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:37.187 [389/710] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.187 [390/710] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:37.450 [391/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:37.450 [392/710] Linking static target lib/librte_ipsec.a 00:01:37.450 [393/710] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:37.450 [394/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:37.450 [395/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:37.450 [396/710] Linking static target lib/librte_table.a 00:01:37.450 [397/710] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.713 [398/710] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:37.713 [399/710] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:37.713 [400/710] Compiling C object lib/librte_node.a.p/node_kernel_tx.c.o 00:01:37.975 [401/710] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.975 [402/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:38.242 [403/710] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:38.242 [404/710] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.242 [405/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:38.242 [406/710] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:38.517 [407/710] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:38.517 [408/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:38.517 [409/710] Linking target lib/librte_eal.so.24.0 00:01:38.517 [410/710] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:38.517 [411/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:38.517 [412/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:38.517 [413/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:38.517 [414/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:38.517 [415/710] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:38.517 [416/710] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.517 [417/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ipsec.c.o 00:01:38.517 [418/710] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.776 [419/710] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:38.776 [420/710] Linking target lib/librte_ring.so.24.0 00:01:38.776 [421/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:38.776 [422/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:38.776 [423/710] Linking target lib/librte_meter.so.24.0 00:01:38.776 [424/710] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:38.776 [425/710] Linking target lib/librte_pci.so.24.0 00:01:39.039 [426/710] Linking target lib/librte_timer.so.24.0 00:01:39.039 [427/710] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:39.039 [428/710] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:39.039 [429/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:39.039 [430/710] Linking target lib/librte_acl.so.24.0 00:01:39.039 [431/710] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:39.039 [432/710] Linking target lib/librte_rcu.so.24.0 00:01:39.039 [433/710] Linking target lib/librte_mempool.so.24.0 00:01:39.039 [434/710] Linking target lib/librte_cfgfile.so.24.0 00:01:39.039 [435/710] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:39.039 [436/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:39.039 [437/710] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:39.297 [438/710] Linking target lib/librte_dmadev.so.24.0 00:01:39.297 [439/710] Linking target lib/librte_jobstats.so.24.0 00:01:39.297 [440/710] Linking target lib/librte_rawdev.so.24.0 00:01:39.297 [441/710] Linking target lib/librte_stack.so.24.0 00:01:39.297 [442/710] Linking static target lib/librte_port.a 00:01:39.297 [443/710] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:39.297 [444/710] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:39.297 [445/710] Linking static target drivers/librte_bus_vdev.a 00:01:39.297 [446/710] Generating symbol file lib/librte_acl.so.24.0.p/librte_acl.so.24.0.symbols 00:01:39.297 [447/710] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:39.297 [448/710] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:39.297 [449/710] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:39.297 [450/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_model_mcore_dispatch.c.o 00:01:39.297 [451/710] Linking target lib/librte_mbuf.so.24.0 00:01:39.297 [452/710] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:39.297 [453/710] Linking target lib/librte_rib.so.24.0 00:01:39.559 [454/710] Linking static target lib/librte_graph.a 00:01:39.559 [455/710] Compiling C object lib/librte_node.a.p/node_kernel_rx.c.o 00:01:39.559 [456/710] Compiling C object lib/librte_node.a.p/node_ip4_reassembly.c.o 00:01:39.559 [457/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:39.559 [458/710] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:39.559 [459/710] Generating symbol file lib/librte_rib.so.24.0.p/librte_rib.so.24.0.symbols 00:01:39.559 [460/710] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.823 [461/710] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:39.823 [462/710] Linking target lib/librte_net.so.24.0 00:01:39.823 [463/710] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:39.823 [464/710] Compiling C object app/dpdk-graph.p/graph_cli.c.o 00:01:39.823 [465/710] Linking target lib/librte_bbdev.so.24.0 00:01:39.823 [466/710] Linking target lib/librte_compressdev.so.24.0 00:01:39.823 [467/710] Linking target lib/librte_cryptodev.so.24.0 00:01:39.823 [468/710] Linking target lib/librte_distributor.so.24.0 00:01:39.823 [469/710] Compiling C object app/dpdk-graph.p/graph_conn.c.o 00:01:39.823 [470/710] Linking target lib/librte_regexdev.so.24.0 00:01:39.823 [471/710] Linking target lib/librte_gpudev.so.24.0 00:01:39.823 [472/710] Linking target lib/librte_mldev.so.24.0 00:01:39.823 [473/710] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:39.823 [474/710] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:39.823 [475/710] Linking static target drivers/librte_bus_pci.a 00:01:39.823 [476/710] Compiling C object app/dpdk-graph.p/graph_ethdev_rx.c.o 00:01:39.823 [477/710] Linking target lib/librte_reorder.so.24.0 00:01:39.823 [478/710] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:39.823 [479/710] Linking target lib/librte_sched.so.24.0 00:01:39.823 [480/710] Linking target lib/librte_fib.so.24.0 00:01:39.823 [481/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:39.823 [482/710] Linking target drivers/librte_bus_vdev.so.24.0 00:01:40.087 [483/710] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:40.087 [484/710] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:40.087 [485/710] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.087 [486/710] Linking target lib/librte_cmdline.so.24.0 00:01:40.087 [487/710] Generating symbol file lib/librte_reorder.so.24.0.p/librte_reorder.so.24.0.symbols 00:01:40.087 [488/710] Linking target lib/librte_security.so.24.0 00:01:40.087 [489/710] Linking target lib/librte_hash.so.24.0 00:01:40.087 [490/710] Generating symbol file lib/librte_sched.so.24.0.p/librte_sched.so.24.0.symbols 00:01:40.087 [491/710] Compiling C object app/dpdk-graph.p/graph_graph.c.o 00:01:40.087 [492/710] Generating symbol file drivers/librte_bus_vdev.so.24.0.p/librte_bus_vdev.so.24.0.symbols 00:01:40.349 [493/710] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:40.349 [494/710] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:40.349 [495/710] Linking static target drivers/librte_mempool_ring.a 00:01:40.349 [496/710] Compiling C object app/dpdk-graph.p/graph_ethdev.c.o 00:01:40.349 [497/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:40.349 [498/710] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:40.349 [499/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:40.349 [500/710] Generating symbol file lib/librte_security.so.24.0.p/librte_security.so.24.0.symbols 00:01:40.349 [501/710] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:40.349 [502/710] Linking target drivers/librte_mempool_ring.so.24.0 00:01:40.349 [503/710] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.349 [504/710] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:40.349 [505/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:40.349 [506/710] Linking target lib/librte_efd.so.24.0 00:01:40.349 [507/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:40.349 [508/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_recycle_mbufs_vec_common.c.o 00:01:40.612 [509/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:40.612 [510/710] Linking target lib/librte_lpm.so.24.0 00:01:40.612 [511/710] Linking target lib/librte_member.so.24.0 00:01:40.612 [512/710] Linking target lib/librte_ipsec.so.24.0 00:01:40.612 [513/710] Compiling C object app/dpdk-graph.p/graph_ip4_route.c.o 00:01:40.612 [514/710] Compiling C object app/dpdk-graph.p/graph_ip6_route.c.o 00:01:40.612 [515/710] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.612 [516/710] Generating symbol file lib/librte_lpm.so.24.0.p/librte_lpm.so.24.0.symbols 00:01:40.612 [517/710] Compiling C object app/dpdk-graph.p/graph_main.c.o 00:01:40.879 [518/710] Generating symbol file lib/librte_ipsec.so.24.0.p/librte_ipsec.so.24.0.symbols 00:01:40.879 [519/710] Linking target drivers/librte_bus_pci.so.24.0 00:01:40.879 [520/710] Compiling C object app/dpdk-graph.p/graph_l3fwd.c.o 00:01:40.879 [521/710] Compiling C object app/dpdk-graph.p/graph_mempool.c.o 00:01:40.879 [522/710] Compiling C object lib/librte_node.a.p/node_ip4_local.c.o 00:01:40.879 [523/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:41.140 [524/710] Generating symbol file drivers/librte_bus_pci.so.24.0.p/librte_bus_pci.so.24.0.symbols 00:01:41.140 [525/710] Compiling C object app/dpdk-graph.p/graph_utils.c.o 00:01:41.403 [526/710] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:41.403 [527/710] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:41.403 [528/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:41.403 [529/710] Compiling C object lib/librte_node.a.p/node_udp4_input.c.o 00:01:41.403 [530/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:41.665 [531/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:41.665 [532/710] Compiling C object app/dpdk-graph.p/graph_neigh.c.o 00:01:41.665 [533/710] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:41.665 [534/710] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:41.929 [535/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:41.929 [536/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:41.929 [537/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:41.929 [538/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:41.929 [539/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:41.929 [540/710] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:42.189 [541/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:42.189 [542/710] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:42.189 [543/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:42.452 [544/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:42.452 [545/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:42.452 [546/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:42.452 [547/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:42.452 [548/710] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:42.714 [549/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_main.c.o 00:01:42.714 [550/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:42.714 [551/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:42.977 [552/710] Compiling C object lib/librte_node.a.p/node_ip6_lookup.c.o 00:01:42.977 [553/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_test.c.o 00:01:42.978 [554/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:42.978 [555/710] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:42.978 [556/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:42.978 [557/710] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:43.244 [558/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:43.244 [559/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_parser.c.o 00:01:43.244 [560/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:43.507 [561/710] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.507 [562/710] Linking target lib/librte_ethdev.so.24.0 00:01:43.770 [563/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:43.770 [564/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:43.770 [565/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_main.c.o 00:01:43.770 [566/710] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:43.770 [567/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:43.770 [568/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:44.035 [569/710] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:44.035 [570/710] Linking target lib/librte_metrics.so.24.0 00:01:44.035 [571/710] Linking target lib/librte_bpf.so.24.0 00:01:44.035 [572/710] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:44.035 [573/710] Linking target lib/librte_eventdev.so.24.0 00:01:44.035 [574/710] Linking target lib/librte_gro.so.24.0 00:01:44.035 [575/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:44.035 [576/710] Linking target lib/librte_gso.so.24.0 00:01:44.035 [577/710] Linking target lib/librte_ip_frag.so.24.0 00:01:44.035 [578/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:44.035 [579/710] Linking target lib/librte_pcapng.so.24.0 00:01:44.299 [580/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_device_ops.c.o 00:01:44.299 [581/710] Generating symbol file lib/librte_metrics.so.24.0.p/librte_metrics.so.24.0.symbols 00:01:44.299 [582/710] Generating symbol file lib/librte_bpf.so.24.0.p/librte_bpf.so.24.0.symbols 00:01:44.299 [583/710] Linking target lib/librte_power.so.24.0 00:01:44.299 [584/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_options.c.o 00:01:44.299 [585/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_common.c.o 00:01:44.299 [586/710] Generating symbol file lib/librte_eventdev.so.24.0.p/librte_eventdev.so.24.0.symbols 00:01:44.299 [587/710] Linking target lib/librte_latencystats.so.24.0 00:01:44.299 [588/710] Linking target lib/librte_bitratestats.so.24.0 00:01:44.299 [589/710] Linking target lib/librte_dispatcher.so.24.0 00:01:44.299 [590/710] Generating symbol file lib/librte_ip_frag.so.24.0.p/librte_ip_frag.so.24.0.symbols 00:01:44.299 [591/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_ops.c.o 00:01:44.299 [592/710] Generating symbol file lib/librte_pcapng.so.24.0.p/librte_pcapng.so.24.0.symbols 00:01:44.299 [593/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_ordered.c.o 00:01:44.561 [594/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:44.562 [595/710] Linking target lib/librte_pdump.so.24.0 00:01:44.562 [596/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_benchmark.c.o 00:01:44.562 [597/710] Linking target lib/librte_port.so.24.0 00:01:44.562 [598/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_interleave.c.o 00:01:44.562 [599/710] Linking target lib/librte_graph.so.24.0 00:01:44.562 [600/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_stats.c.o 00:01:44.562 [601/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_process.c.o 00:01:44.562 [602/710] Linking static target lib/librte_pdcp.a 00:01:44.562 [603/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:44.826 [604/710] Generating symbol file lib/librte_graph.so.24.0.p/librte_graph.so.24.0.symbols 00:01:44.826 [605/710] Generating symbol file lib/librte_port.so.24.0.p/librte_port.so.24.0.symbols 00:01:44.826 [606/710] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:44.826 [607/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:44.826 [608/710] Linking target lib/librte_table.so.24.0 00:01:44.826 [609/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:45.091 [610/710] Generating symbol file lib/librte_table.so.24.0.p/librte_table.so.24.0.symbols 00:01:45.091 [611/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:45.091 [612/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:45.091 [613/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_common.c.o 00:01:45.091 [614/710] Generating lib/pdcp.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.091 [615/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:45.091 [616/710] Linking target lib/librte_pdcp.so.24.0 00:01:45.351 [617/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:45.351 [618/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:45.610 [619/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:45.610 [620/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:45.610 [621/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:45.610 [622/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:45.610 [623/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:45.610 [624/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:45.871 [625/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_cman.c.o 00:01:45.871 [626/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:45.871 [627/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:45.871 [628/710] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:45.871 [629/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:46.131 [630/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:46.131 [631/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:46.131 [632/710] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:46.391 [633/710] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:46.391 [634/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:46.391 [635/710] Compiling C object app/dpdk-testpmd.p/test-pmd_recycle_mbufs.c.o 00:01:46.391 [636/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:46.391 [637/710] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:46.391 [638/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:46.391 [639/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:46.650 [640/710] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:46.650 [641/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:46.650 [642/710] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:46.650 [643/710] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:46.650 [644/710] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:46.910 [645/710] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:46.910 [646/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:47.168 [647/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:47.426 [648/710] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:47.426 [649/710] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:47.426 [650/710] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:01:47.426 [651/710] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:47.426 [652/710] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:47.683 [653/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:47.683 [654/710] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:01:47.683 [655/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:01:47.683 [656/710] Linking static target drivers/libtmp_rte_net_i40e.a 00:01:47.941 [657/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:01:47.941 [658/710] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:01:48.200 [659/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:48.200 [660/710] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:01:48.200 [661/710] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:48.200 [662/710] Compiling C object drivers/librte_net_i40e.so.24.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:48.200 [663/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:01:48.200 [664/710] Linking static target drivers/librte_net_i40e.a 00:01:48.200 [665/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:01:48.200 [666/710] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:01:48.766 [667/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:01:48.766 [668/710] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.024 [669/710] Linking target drivers/librte_net_i40e.so.24.0 00:01:49.024 [670/710] Compiling C object lib/librte_node.a.p/node_ip6_rewrite.c.o 00:01:49.024 [671/710] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:01:49.590 [672/710] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:01:49.848 [673/710] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:01:49.848 [674/710] Linking static target lib/librte_node.a 00:01:50.415 [675/710] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.415 [676/710] Linking target lib/librte_node.so.24.0 00:01:50.673 [677/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_common.c.o 00:01:50.931 [678/710] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:01:50.931 [679/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:01:52.834 [680/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:01:53.402 [681/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:01:58.688 [682/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:30.825 [683/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:30.825 [684/710] Linking static target lib/librte_vhost.a 00:02:30.825 [685/710] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:30.825 [686/710] Linking target lib/librte_vhost.so.24.0 00:02:43.048 [687/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:43.048 [688/710] Linking static target lib/librte_pipeline.a 00:02:43.048 [689/710] Linking target app/dpdk-dumpcap 00:02:43.048 [690/710] Linking target app/dpdk-test-cmdline 00:02:43.048 [691/710] Linking target app/dpdk-graph 00:02:43.048 [692/710] Linking target app/dpdk-test-bbdev 00:02:43.048 [693/710] Linking target app/dpdk-proc-info 00:02:43.048 [694/710] Linking target app/dpdk-pdump 00:02:43.048 [695/710] Linking target app/dpdk-test-acl 00:02:43.048 [696/710] Linking target app/dpdk-test-regex 00:02:43.048 [697/710] Linking target app/dpdk-test-pipeline 00:02:43.048 [698/710] Linking target app/dpdk-test-security-perf 00:02:43.048 [699/710] Linking target app/dpdk-test-compress-perf 00:02:43.048 [700/710] Linking target app/dpdk-test-sad 00:02:43.048 [701/710] Linking target app/dpdk-test-gpudev 00:02:43.048 [702/710] Linking target app/dpdk-test-dma-perf 00:02:43.048 [703/710] Linking target app/dpdk-test-eventdev 00:02:43.048 [704/710] Linking target app/dpdk-test-flow-perf 00:02:43.049 [705/710] Linking target app/dpdk-test-fib 00:02:43.049 [706/710] Linking target app/dpdk-test-mldev 00:02:43.049 [707/710] Linking target app/dpdk-test-crypto-perf 00:02:43.049 [708/710] Linking target app/dpdk-testpmd 00:02:44.430 [709/710] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:44.689 [710/710] Linking target lib/librte_pipeline.so.24.0 00:02:44.689 04:58:46 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:44.689 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:44.689 [0/1] Installing files. 00:02:44.951 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:44.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:44.955 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec_sa.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:44.956 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:44.957 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:44.957 Installing lib/librte_log.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_dispatcher.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_mldev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.216 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_pdcp.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing lib/librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing drivers/librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:45.788 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing drivers/librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:45.788 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing drivers/librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:45.788 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:45.788 Installing drivers/librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:45.788 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-graph to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-dma-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-mldev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/log/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:45.788 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lock_annotations.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_stdatomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.789 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_dtls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_pdcp_hdr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.790 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_dma_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dispatcher/rte_dispatcher.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.791 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_mcore_dispatch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_rtc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip6_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_udp4_input_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/dpdk-cmdline-gen.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-rss-flows.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:45.792 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:45.792 Installing symlink pointing to librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so.24 00:02:45.792 Installing symlink pointing to librte_log.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so 00:02:45.792 Installing symlink pointing to librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.24 00:02:45.792 Installing symlink pointing to librte_kvargs.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:45.792 Installing symlink pointing to librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.24 00:02:45.792 Installing symlink pointing to librte_telemetry.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:45.792 Installing symlink pointing to librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.24 00:02:45.792 Installing symlink pointing to librte_eal.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:45.792 Installing symlink pointing to librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.24 00:02:45.792 Installing symlink pointing to librte_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:45.792 Installing symlink pointing to librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.24 00:02:45.792 Installing symlink pointing to librte_rcu.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:45.792 Installing symlink pointing to librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.24 00:02:45.792 Installing symlink pointing to librte_mempool.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:45.792 Installing symlink pointing to librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.24 00:02:45.792 Installing symlink pointing to librte_mbuf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:45.792 Installing symlink pointing to librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.24 00:02:45.792 Installing symlink pointing to librte_net.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:45.792 Installing symlink pointing to librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.24 00:02:45.793 Installing symlink pointing to librte_meter.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:45.793 Installing symlink pointing to librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.24 00:02:45.793 Installing symlink pointing to librte_ethdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:45.793 Installing symlink pointing to librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.24 00:02:45.793 Installing symlink pointing to librte_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:45.793 Installing symlink pointing to librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.24 00:02:45.793 Installing symlink pointing to librte_cmdline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:45.793 Installing symlink pointing to librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.24 00:02:45.793 Installing symlink pointing to librte_metrics.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:45.793 Installing symlink pointing to librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.24 00:02:45.793 Installing symlink pointing to librte_hash.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:45.793 Installing symlink pointing to librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.24 00:02:45.793 Installing symlink pointing to librte_timer.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:45.793 Installing symlink pointing to librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.24 00:02:45.793 Installing symlink pointing to librte_acl.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:45.793 Installing symlink pointing to librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.24 00:02:45.793 Installing symlink pointing to librte_bbdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:45.793 Installing symlink pointing to librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.24 00:02:45.793 Installing symlink pointing to librte_bitratestats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:45.793 Installing symlink pointing to librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.24 00:02:45.793 Installing symlink pointing to librte_bpf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:45.793 Installing symlink pointing to librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.24 00:02:45.793 Installing symlink pointing to librte_cfgfile.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:45.793 Installing symlink pointing to librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.24 00:02:45.793 Installing symlink pointing to librte_compressdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:45.793 Installing symlink pointing to librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.24 00:02:45.793 Installing symlink pointing to librte_cryptodev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:45.793 Installing symlink pointing to librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.24 00:02:45.793 Installing symlink pointing to librte_distributor.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:45.793 Installing symlink pointing to librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.24 00:02:45.793 Installing symlink pointing to librte_dmadev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:45.793 Installing symlink pointing to librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.24 00:02:45.793 Installing symlink pointing to librte_efd.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:45.793 Installing symlink pointing to librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.24 00:02:45.793 Installing symlink pointing to librte_eventdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:45.793 Installing symlink pointing to librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so.24 00:02:45.793 Installing symlink pointing to librte_dispatcher.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so 00:02:45.793 Installing symlink pointing to librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.24 00:02:45.793 Installing symlink pointing to librte_gpudev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:45.793 Installing symlink pointing to librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.24 00:02:45.793 Installing symlink pointing to librte_gro.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:45.793 Installing symlink pointing to librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.24 00:02:45.793 Installing symlink pointing to librte_gso.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:45.793 Installing symlink pointing to librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.24 00:02:45.793 Installing symlink pointing to librte_ip_frag.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:45.793 Installing symlink pointing to librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.24 00:02:45.793 Installing symlink pointing to librte_jobstats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:45.793 Installing symlink pointing to librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.24 00:02:45.793 Installing symlink pointing to librte_latencystats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:45.793 Installing symlink pointing to librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.24 00:02:45.793 Installing symlink pointing to librte_lpm.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:45.793 Installing symlink pointing to librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.24 00:02:45.793 Installing symlink pointing to librte_member.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:45.793 Installing symlink pointing to librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.24 00:02:45.793 Installing symlink pointing to librte_pcapng.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:45.793 Installing symlink pointing to librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.24 00:02:45.793 Installing symlink pointing to librte_power.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:45.793 './librte_bus_pci.so' -> 'dpdk/pmds-24.0/librte_bus_pci.so' 00:02:45.793 './librte_bus_pci.so.24' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24' 00:02:45.793 './librte_bus_pci.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24.0' 00:02:45.793 './librte_bus_vdev.so' -> 'dpdk/pmds-24.0/librte_bus_vdev.so' 00:02:45.793 './librte_bus_vdev.so.24' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24' 00:02:45.793 './librte_bus_vdev.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24.0' 00:02:45.793 './librte_mempool_ring.so' -> 'dpdk/pmds-24.0/librte_mempool_ring.so' 00:02:45.793 './librte_mempool_ring.so.24' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24' 00:02:45.793 './librte_mempool_ring.so.24.0' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24.0' 00:02:45.793 './librte_net_i40e.so' -> 'dpdk/pmds-24.0/librte_net_i40e.so' 00:02:45.793 './librte_net_i40e.so.24' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24' 00:02:45.793 './librte_net_i40e.so.24.0' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24.0' 00:02:45.793 Installing symlink pointing to librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.24 00:02:45.793 Installing symlink pointing to librte_rawdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:45.793 Installing symlink pointing to librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.24 00:02:45.793 Installing symlink pointing to librte_regexdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:45.793 Installing symlink pointing to librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so.24 00:02:45.793 Installing symlink pointing to librte_mldev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so 00:02:45.793 Installing symlink pointing to librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.24 00:02:45.793 Installing symlink pointing to librte_rib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:45.793 Installing symlink pointing to librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.24 00:02:45.793 Installing symlink pointing to librte_reorder.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:45.793 Installing symlink pointing to librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.24 00:02:45.793 Installing symlink pointing to librte_sched.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:45.793 Installing symlink pointing to librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.24 00:02:45.793 Installing symlink pointing to librte_security.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:45.793 Installing symlink pointing to librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.24 00:02:45.793 Installing symlink pointing to librte_stack.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:45.793 Installing symlink pointing to librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.24 00:02:45.793 Installing symlink pointing to librte_vhost.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:45.793 Installing symlink pointing to librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.24 00:02:45.793 Installing symlink pointing to librte_ipsec.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:45.793 Installing symlink pointing to librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so.24 00:02:45.793 Installing symlink pointing to librte_pdcp.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so 00:02:45.793 Installing symlink pointing to librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.24 00:02:45.793 Installing symlink pointing to librte_fib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:45.793 Installing symlink pointing to librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.24 00:02:45.793 Installing symlink pointing to librte_port.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:45.793 Installing symlink pointing to librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.24 00:02:45.793 Installing symlink pointing to librte_pdump.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:45.794 Installing symlink pointing to librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.24 00:02:45.794 Installing symlink pointing to librte_table.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:45.794 Installing symlink pointing to librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.24 00:02:45.794 Installing symlink pointing to librte_pipeline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:45.794 Installing symlink pointing to librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.24 00:02:45.794 Installing symlink pointing to librte_graph.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:45.794 Installing symlink pointing to librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.24 00:02:45.794 Installing symlink pointing to librte_node.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:45.794 Installing symlink pointing to librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24 00:02:45.794 Installing symlink pointing to librte_bus_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:02:45.794 Installing symlink pointing to librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24 00:02:45.794 Installing symlink pointing to librte_bus_vdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:02:45.794 Installing symlink pointing to librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24 00:02:45.794 Installing symlink pointing to librte_mempool_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:02:45.794 Installing symlink pointing to librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24 00:02:45.794 Installing symlink pointing to librte_net_i40e.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:02:45.794 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-24.0' 00:02:45.794 04:58:47 -- common/autobuild_common.sh@192 -- $ uname -s 00:02:45.794 04:58:47 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:45.794 04:58:47 -- common/autobuild_common.sh@203 -- $ cat 00:02:45.794 04:58:47 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:45.794 00:02:45.794 real 1m27.491s 00:02:45.794 user 18m2.635s 00:02:45.794 sys 2m8.564s 00:02:45.794 04:58:47 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:45.794 04:58:47 -- common/autotest_common.sh@10 -- $ set +x 00:02:45.794 ************************************ 00:02:45.794 END TEST build_native_dpdk 00:02:45.794 ************************************ 00:02:45.794 04:58:47 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:45.794 04:58:47 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:45.794 04:58:47 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:45.794 04:58:47 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:45.794 04:58:47 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:45.794 04:58:47 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:45.794 04:58:47 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:45.794 04:58:47 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:46.053 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:46.053 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:46.053 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:46.053 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:46.313 Using 'verbs' RDMA provider 00:02:56.875 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:03:05.002 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:03:05.262 Creating mk/config.mk...done. 00:03:05.262 Creating mk/cc.flags.mk...done. 00:03:05.262 Type 'make' to build. 00:03:05.262 04:59:06 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:05.262 04:59:06 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:03:05.262 04:59:06 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:03:05.262 04:59:06 -- common/autotest_common.sh@10 -- $ set +x 00:03:05.262 ************************************ 00:03:05.262 START TEST make 00:03:05.262 ************************************ 00:03:05.262 04:59:07 -- common/autotest_common.sh@1114 -- $ make -j48 00:03:05.521 make[1]: Nothing to be done for 'all'. 00:03:07.442 The Meson build system 00:03:07.442 Version: 1.5.0 00:03:07.442 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:07.442 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:07.442 Build type: native build 00:03:07.442 Project name: libvfio-user 00:03:07.442 Project version: 0.0.1 00:03:07.442 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:07.442 C linker for the host machine: gcc ld.bfd 2.40-14 00:03:07.442 Host machine cpu family: x86_64 00:03:07.442 Host machine cpu: x86_64 00:03:07.442 Run-time dependency threads found: YES 00:03:07.442 Library dl found: YES 00:03:07.442 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:07.442 Run-time dependency json-c found: YES 0.17 00:03:07.442 Run-time dependency cmocka found: YES 1.1.7 00:03:07.442 Program pytest-3 found: NO 00:03:07.442 Program flake8 found: NO 00:03:07.442 Program misspell-fixer found: NO 00:03:07.442 Program restructuredtext-lint found: NO 00:03:07.442 Program valgrind found: YES (/usr/bin/valgrind) 00:03:07.442 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:07.442 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:07.442 Compiler for C supports arguments -Wwrite-strings: YES 00:03:07.442 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:07.442 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:07.442 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:07.442 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:07.442 Build targets in project: 8 00:03:07.442 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:07.442 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:07.442 00:03:07.442 libvfio-user 0.0.1 00:03:07.442 00:03:07.442 User defined options 00:03:07.442 buildtype : debug 00:03:07.442 default_library: shared 00:03:07.442 libdir : /usr/local/lib 00:03:07.442 00:03:07.442 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:08.391 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:08.391 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:08.391 [2/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:08.391 [3/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:08.391 [4/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:08.391 [5/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:08.391 [6/37] Compiling C object samples/null.p/null.c.o 00:03:08.391 [7/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:08.391 [8/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:08.391 [9/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:08.391 [10/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:08.391 [11/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:08.391 [12/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:08.391 [13/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:08.391 [14/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:08.391 [15/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:08.391 [16/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:08.391 [17/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:08.391 [18/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:08.391 [19/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:08.391 [20/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:08.658 [21/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:08.658 [22/37] Compiling C object samples/server.p/server.c.o 00:03:08.658 [23/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:08.658 [24/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:08.658 [25/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:08.658 [26/37] Compiling C object samples/client.p/client.c.o 00:03:08.658 [27/37] Linking target samples/client 00:03:08.658 [28/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:08.658 [29/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:08.923 [30/37] Linking target test/unit_tests 00:03:08.923 [31/37] Linking target lib/libvfio-user.so.0.0.1 00:03:08.923 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:09.184 [33/37] Linking target samples/null 00:03:09.184 [34/37] Linking target samples/server 00:03:09.184 [35/37] Linking target samples/gpio-pci-idio-16 00:03:09.184 [36/37] Linking target samples/lspci 00:03:09.184 [37/37] Linking target samples/shadow_ioeventfd_server 00:03:09.184 INFO: autodetecting backend as ninja 00:03:09.184 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:09.185 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:10.127 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:10.127 ninja: no work to do. 00:03:20.099 CC lib/log/log.o 00:03:20.099 CC lib/log/log_flags.o 00:03:20.099 CC lib/log/log_deprecated.o 00:03:20.099 CC lib/ut/ut.o 00:03:20.099 CC lib/ut_mock/mock.o 00:03:20.358 LIB libspdk_ut_mock.a 00:03:20.358 LIB libspdk_log.a 00:03:20.358 SO libspdk_ut_mock.so.5.0 00:03:20.358 LIB libspdk_ut.a 00:03:20.358 SO libspdk_ut.so.1.0 00:03:20.358 SO libspdk_log.so.6.1 00:03:20.358 SYMLINK libspdk_ut_mock.so 00:03:20.358 SYMLINK libspdk_ut.so 00:03:20.358 SYMLINK libspdk_log.so 00:03:20.358 CC lib/dma/dma.o 00:03:20.358 CC lib/ioat/ioat.o 00:03:20.358 CXX lib/trace_parser/trace.o 00:03:20.358 CC lib/util/base64.o 00:03:20.358 CC lib/util/bit_array.o 00:03:20.358 CC lib/util/cpuset.o 00:03:20.358 CC lib/util/crc16.o 00:03:20.358 CC lib/util/crc32.o 00:03:20.358 CC lib/util/crc32c.o 00:03:20.358 CC lib/util/crc32_ieee.o 00:03:20.358 CC lib/util/crc64.o 00:03:20.358 CC lib/util/fd.o 00:03:20.358 CC lib/util/dif.o 00:03:20.358 CC lib/util/file.o 00:03:20.358 CC lib/util/hexlify.o 00:03:20.358 CC lib/util/iov.o 00:03:20.358 CC lib/util/math.o 00:03:20.358 CC lib/util/pipe.o 00:03:20.358 CC lib/util/strerror_tls.o 00:03:20.358 CC lib/util/string.o 00:03:20.358 CC lib/util/uuid.o 00:03:20.358 CC lib/util/fd_group.o 00:03:20.358 CC lib/util/xor.o 00:03:20.358 CC lib/util/zipf.o 00:03:20.617 CC lib/vfio_user/host/vfio_user_pci.o 00:03:20.617 CC lib/vfio_user/host/vfio_user.o 00:03:20.617 LIB libspdk_dma.a 00:03:20.617 SO libspdk_dma.so.3.0 00:03:20.617 SYMLINK libspdk_dma.so 00:03:20.875 LIB libspdk_ioat.a 00:03:20.875 SO libspdk_ioat.so.6.0 00:03:20.875 LIB libspdk_vfio_user.a 00:03:20.875 SO libspdk_vfio_user.so.4.0 00:03:20.875 SYMLINK libspdk_ioat.so 00:03:20.875 SYMLINK libspdk_vfio_user.so 00:03:21.134 LIB libspdk_util.a 00:03:21.134 SO libspdk_util.so.8.0 00:03:21.134 SYMLINK libspdk_util.so 00:03:21.393 CC lib/conf/conf.o 00:03:21.393 CC lib/env_dpdk/env.o 00:03:21.393 CC lib/vmd/vmd.o 00:03:21.393 CC lib/json/json_parse.o 00:03:21.393 CC lib/rdma/common.o 00:03:21.393 CC lib/env_dpdk/memory.o 00:03:21.393 CC lib/vmd/led.o 00:03:21.393 CC lib/idxd/idxd.o 00:03:21.393 CC lib/rdma/rdma_verbs.o 00:03:21.393 CC lib/json/json_util.o 00:03:21.393 CC lib/env_dpdk/pci.o 00:03:21.393 CC lib/idxd/idxd_user.o 00:03:21.393 CC lib/env_dpdk/init.o 00:03:21.393 CC lib/idxd/idxd_kernel.o 00:03:21.393 CC lib/json/json_write.o 00:03:21.393 CC lib/env_dpdk/threads.o 00:03:21.393 CC lib/env_dpdk/pci_ioat.o 00:03:21.393 CC lib/env_dpdk/pci_virtio.o 00:03:21.393 CC lib/env_dpdk/pci_vmd.o 00:03:21.393 CC lib/env_dpdk/pci_idxd.o 00:03:21.393 CC lib/env_dpdk/pci_event.o 00:03:21.393 CC lib/env_dpdk/sigbus_handler.o 00:03:21.393 CC lib/env_dpdk/pci_dpdk.o 00:03:21.393 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:21.393 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:21.393 LIB libspdk_trace_parser.a 00:03:21.393 SO libspdk_trace_parser.so.4.0 00:03:21.651 SYMLINK libspdk_trace_parser.so 00:03:21.651 LIB libspdk_rdma.a 00:03:21.651 LIB libspdk_json.a 00:03:21.651 LIB libspdk_conf.a 00:03:21.651 SO libspdk_rdma.so.5.0 00:03:21.651 SO libspdk_json.so.5.1 00:03:21.651 SO libspdk_conf.so.5.0 00:03:21.651 SYMLINK libspdk_rdma.so 00:03:21.651 SYMLINK libspdk_conf.so 00:03:21.651 SYMLINK libspdk_json.so 00:03:21.910 CC lib/jsonrpc/jsonrpc_server.o 00:03:21.910 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:21.910 CC lib/jsonrpc/jsonrpc_client.o 00:03:21.910 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:21.910 LIB libspdk_idxd.a 00:03:21.910 SO libspdk_idxd.so.11.0 00:03:21.910 SYMLINK libspdk_idxd.so 00:03:21.910 LIB libspdk_vmd.a 00:03:21.910 SO libspdk_vmd.so.5.0 00:03:22.173 SYMLINK libspdk_vmd.so 00:03:22.173 LIB libspdk_jsonrpc.a 00:03:22.173 SO libspdk_jsonrpc.so.5.1 00:03:22.173 SYMLINK libspdk_jsonrpc.so 00:03:22.173 CC lib/rpc/rpc.o 00:03:22.495 LIB libspdk_rpc.a 00:03:22.495 SO libspdk_rpc.so.5.0 00:03:22.495 SYMLINK libspdk_rpc.so 00:03:22.780 CC lib/notify/notify.o 00:03:22.780 CC lib/notify/notify_rpc.o 00:03:22.780 CC lib/trace/trace.o 00:03:22.780 CC lib/trace/trace_flags.o 00:03:22.780 CC lib/sock/sock.o 00:03:22.780 CC lib/trace/trace_rpc.o 00:03:22.780 CC lib/sock/sock_rpc.o 00:03:22.780 LIB libspdk_notify.a 00:03:22.780 SO libspdk_notify.so.5.0 00:03:22.780 SYMLINK libspdk_notify.so 00:03:22.780 LIB libspdk_trace.a 00:03:23.037 SO libspdk_trace.so.9.0 00:03:23.037 SYMLINK libspdk_trace.so 00:03:23.037 LIB libspdk_sock.a 00:03:23.037 SO libspdk_sock.so.8.0 00:03:23.037 CC lib/thread/thread.o 00:03:23.037 CC lib/thread/iobuf.o 00:03:23.037 SYMLINK libspdk_sock.so 00:03:23.295 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:23.295 CC lib/nvme/nvme_ctrlr.o 00:03:23.295 CC lib/nvme/nvme_fabric.o 00:03:23.295 CC lib/nvme/nvme_ns_cmd.o 00:03:23.295 CC lib/nvme/nvme_ns.o 00:03:23.295 CC lib/nvme/nvme_pcie_common.o 00:03:23.295 CC lib/nvme/nvme_pcie.o 00:03:23.295 CC lib/nvme/nvme_qpair.o 00:03:23.295 CC lib/nvme/nvme.o 00:03:23.295 CC lib/nvme/nvme_quirks.o 00:03:23.295 CC lib/nvme/nvme_transport.o 00:03:23.295 CC lib/nvme/nvme_discovery.o 00:03:23.295 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:23.295 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:23.295 CC lib/nvme/nvme_tcp.o 00:03:23.295 CC lib/nvme/nvme_opal.o 00:03:23.295 CC lib/nvme/nvme_io_msg.o 00:03:23.295 CC lib/nvme/nvme_poll_group.o 00:03:23.295 CC lib/nvme/nvme_zns.o 00:03:23.295 CC lib/nvme/nvme_cuse.o 00:03:23.295 CC lib/nvme/nvme_vfio_user.o 00:03:23.295 CC lib/nvme/nvme_rdma.o 00:03:23.295 LIB libspdk_env_dpdk.a 00:03:23.295 SO libspdk_env_dpdk.so.13.0 00:03:23.552 SYMLINK libspdk_env_dpdk.so 00:03:24.927 LIB libspdk_thread.a 00:03:24.927 SO libspdk_thread.so.9.0 00:03:24.927 SYMLINK libspdk_thread.so 00:03:24.927 CC lib/vfu_tgt/tgt_endpoint.o 00:03:24.927 CC lib/blob/blobstore.o 00:03:24.927 CC lib/virtio/virtio.o 00:03:24.927 CC lib/accel/accel.o 00:03:24.927 CC lib/init/json_config.o 00:03:24.927 CC lib/vfu_tgt/tgt_rpc.o 00:03:24.927 CC lib/blob/request.o 00:03:24.927 CC lib/accel/accel_rpc.o 00:03:24.927 CC lib/virtio/virtio_vhost_user.o 00:03:24.927 CC lib/init/subsystem.o 00:03:24.927 CC lib/blob/zeroes.o 00:03:24.927 CC lib/accel/accel_sw.o 00:03:24.927 CC lib/init/subsystem_rpc.o 00:03:24.927 CC lib/virtio/virtio_vfio_user.o 00:03:24.927 CC lib/blob/blob_bs_dev.o 00:03:24.927 CC lib/init/rpc.o 00:03:24.927 CC lib/virtio/virtio_pci.o 00:03:25.185 LIB libspdk_init.a 00:03:25.185 SO libspdk_init.so.4.0 00:03:25.185 SYMLINK libspdk_init.so 00:03:25.185 LIB libspdk_virtio.a 00:03:25.185 LIB libspdk_vfu_tgt.a 00:03:25.185 SO libspdk_vfu_tgt.so.2.0 00:03:25.185 SO libspdk_virtio.so.6.0 00:03:25.443 SYMLINK libspdk_vfu_tgt.so 00:03:25.443 SYMLINK libspdk_virtio.so 00:03:25.443 CC lib/event/app.o 00:03:25.443 CC lib/event/reactor.o 00:03:25.443 CC lib/event/log_rpc.o 00:03:25.443 CC lib/event/app_rpc.o 00:03:25.443 CC lib/event/scheduler_static.o 00:03:25.701 LIB libspdk_nvme.a 00:03:25.701 SO libspdk_nvme.so.12.0 00:03:25.701 LIB libspdk_event.a 00:03:25.701 SO libspdk_event.so.12.0 00:03:25.958 SYMLINK libspdk_event.so 00:03:25.958 SYMLINK libspdk_nvme.so 00:03:25.958 LIB libspdk_accel.a 00:03:25.958 SO libspdk_accel.so.14.0 00:03:25.958 SYMLINK libspdk_accel.so 00:03:26.216 CC lib/bdev/bdev.o 00:03:26.216 CC lib/bdev/bdev_rpc.o 00:03:26.216 CC lib/bdev/bdev_zone.o 00:03:26.216 CC lib/bdev/scsi_nvme.o 00:03:26.216 CC lib/bdev/part.o 00:03:28.119 LIB libspdk_blob.a 00:03:28.119 SO libspdk_blob.so.10.1 00:03:28.119 SYMLINK libspdk_blob.so 00:03:28.119 CC lib/blobfs/tree.o 00:03:28.119 CC lib/blobfs/blobfs.o 00:03:28.119 CC lib/lvol/lvol.o 00:03:28.685 LIB libspdk_bdev.a 00:03:28.685 LIB libspdk_blobfs.a 00:03:28.685 SO libspdk_bdev.so.14.0 00:03:28.685 SO libspdk_blobfs.so.9.0 00:03:28.949 SYMLINK libspdk_blobfs.so 00:03:28.949 SYMLINK libspdk_bdev.so 00:03:28.949 LIB libspdk_lvol.a 00:03:28.949 SO libspdk_lvol.so.9.1 00:03:28.949 SYMLINK libspdk_lvol.so 00:03:28.949 CC lib/nvmf/ctrlr.o 00:03:28.949 CC lib/scsi/dev.o 00:03:28.949 CC lib/ftl/ftl_core.o 00:03:28.949 CC lib/ublk/ublk.o 00:03:28.949 CC lib/scsi/lun.o 00:03:28.949 CC lib/nvmf/ctrlr_discovery.o 00:03:28.949 CC lib/ftl/ftl_init.o 00:03:28.949 CC lib/ublk/ublk_rpc.o 00:03:28.949 CC lib/nvmf/ctrlr_bdev.o 00:03:28.949 CC lib/ftl/ftl_layout.o 00:03:28.949 CC lib/scsi/port.o 00:03:28.949 CC lib/nbd/nbd.o 00:03:28.949 CC lib/nvmf/subsystem.o 00:03:28.949 CC lib/ftl/ftl_debug.o 00:03:28.949 CC lib/nbd/nbd_rpc.o 00:03:28.949 CC lib/ftl/ftl_io.o 00:03:28.949 CC lib/scsi/scsi.o 00:03:28.949 CC lib/nvmf/nvmf.o 00:03:28.949 CC lib/scsi/scsi_bdev.o 00:03:28.949 CC lib/scsi/scsi_pr.o 00:03:28.949 CC lib/ftl/ftl_sb.o 00:03:28.949 CC lib/nvmf/nvmf_rpc.o 00:03:28.949 CC lib/ftl/ftl_l2p.o 00:03:28.949 CC lib/scsi/scsi_rpc.o 00:03:28.949 CC lib/nvmf/transport.o 00:03:28.949 CC lib/ftl/ftl_l2p_flat.o 00:03:28.949 CC lib/nvmf/tcp.o 00:03:28.949 CC lib/scsi/task.o 00:03:28.949 CC lib/nvmf/vfio_user.o 00:03:28.949 CC lib/ftl/ftl_nv_cache.o 00:03:28.949 CC lib/ftl/ftl_band.o 00:03:28.949 CC lib/nvmf/rdma.o 00:03:28.949 CC lib/ftl/ftl_writer.o 00:03:28.949 CC lib/ftl/ftl_band_ops.o 00:03:28.949 CC lib/ftl/ftl_rq.o 00:03:28.949 CC lib/ftl/ftl_reloc.o 00:03:28.949 CC lib/ftl/ftl_l2p_cache.o 00:03:28.949 CC lib/ftl/ftl_p2l.o 00:03:28.949 CC lib/ftl/mngt/ftl_mngt.o 00:03:28.949 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:28.949 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:28.949 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:28.949 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:28.949 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:28.949 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:28.949 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:28.949 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:28.949 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:29.209 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:29.209 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:29.209 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:29.472 CC lib/ftl/utils/ftl_conf.o 00:03:29.472 CC lib/ftl/utils/ftl_md.o 00:03:29.472 CC lib/ftl/utils/ftl_mempool.o 00:03:29.472 CC lib/ftl/utils/ftl_bitmap.o 00:03:29.472 CC lib/ftl/utils/ftl_property.o 00:03:29.472 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:29.472 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:29.472 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:29.472 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:29.472 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:29.472 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:29.472 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:29.472 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:29.472 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:29.472 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:29.472 CC lib/ftl/base/ftl_base_dev.o 00:03:29.472 CC lib/ftl/base/ftl_base_bdev.o 00:03:29.472 CC lib/ftl/ftl_trace.o 00:03:29.731 LIB libspdk_nbd.a 00:03:29.731 SO libspdk_nbd.so.6.0 00:03:29.731 SYMLINK libspdk_nbd.so 00:03:29.989 LIB libspdk_scsi.a 00:03:29.989 SO libspdk_scsi.so.8.0 00:03:29.989 LIB libspdk_ublk.a 00:03:29.989 SYMLINK libspdk_scsi.so 00:03:29.989 SO libspdk_ublk.so.2.0 00:03:29.989 SYMLINK libspdk_ublk.so 00:03:29.989 CC lib/vhost/vhost.o 00:03:29.989 CC lib/iscsi/conn.o 00:03:29.989 CC lib/vhost/vhost_rpc.o 00:03:29.989 CC lib/iscsi/init_grp.o 00:03:29.989 CC lib/vhost/vhost_scsi.o 00:03:29.989 CC lib/vhost/vhost_blk.o 00:03:29.989 CC lib/iscsi/iscsi.o 00:03:29.989 CC lib/vhost/rte_vhost_user.o 00:03:29.989 CC lib/iscsi/md5.o 00:03:29.989 CC lib/iscsi/param.o 00:03:29.989 CC lib/iscsi/portal_grp.o 00:03:29.989 CC lib/iscsi/tgt_node.o 00:03:29.989 CC lib/iscsi/iscsi_subsystem.o 00:03:29.989 CC lib/iscsi/iscsi_rpc.o 00:03:29.989 CC lib/iscsi/task.o 00:03:30.248 LIB libspdk_ftl.a 00:03:30.506 SO libspdk_ftl.so.8.0 00:03:30.764 SYMLINK libspdk_ftl.so 00:03:31.332 LIB libspdk_vhost.a 00:03:31.332 SO libspdk_vhost.so.7.1 00:03:31.332 SYMLINK libspdk_vhost.so 00:03:31.590 LIB libspdk_nvmf.a 00:03:31.590 LIB libspdk_iscsi.a 00:03:31.590 SO libspdk_nvmf.so.17.0 00:03:31.590 SO libspdk_iscsi.so.7.0 00:03:31.849 SYMLINK libspdk_iscsi.so 00:03:31.849 SYMLINK libspdk_nvmf.so 00:03:31.849 CC module/vfu_device/vfu_virtio.o 00:03:31.849 CC module/env_dpdk/env_dpdk_rpc.o 00:03:31.849 CC module/vfu_device/vfu_virtio_blk.o 00:03:31.849 CC module/vfu_device/vfu_virtio_scsi.o 00:03:31.849 CC module/vfu_device/vfu_virtio_rpc.o 00:03:31.849 CC module/blob/bdev/blob_bdev.o 00:03:31.849 CC module/accel/dsa/accel_dsa.o 00:03:31.849 CC module/sock/posix/posix.o 00:03:31.849 CC module/accel/iaa/accel_iaa.o 00:03:31.849 CC module/accel/ioat/accel_ioat.o 00:03:31.849 CC module/accel/dsa/accel_dsa_rpc.o 00:03:31.849 CC module/accel/iaa/accel_iaa_rpc.o 00:03:31.849 CC module/accel/ioat/accel_ioat_rpc.o 00:03:31.849 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:31.849 CC module/scheduler/gscheduler/gscheduler.o 00:03:31.849 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:31.849 CC module/accel/error/accel_error.o 00:03:32.108 CC module/accel/error/accel_error_rpc.o 00:03:32.108 LIB libspdk_env_dpdk_rpc.a 00:03:32.108 SO libspdk_env_dpdk_rpc.so.5.0 00:03:32.108 SYMLINK libspdk_env_dpdk_rpc.so 00:03:32.108 LIB libspdk_scheduler_gscheduler.a 00:03:32.108 LIB libspdk_scheduler_dpdk_governor.a 00:03:32.108 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:32.108 SO libspdk_scheduler_gscheduler.so.3.0 00:03:32.108 LIB libspdk_accel_error.a 00:03:32.108 LIB libspdk_accel_ioat.a 00:03:32.108 LIB libspdk_scheduler_dynamic.a 00:03:32.108 LIB libspdk_accel_iaa.a 00:03:32.108 SO libspdk_accel_error.so.1.0 00:03:32.108 SO libspdk_accel_ioat.so.5.0 00:03:32.108 SO libspdk_scheduler_dynamic.so.3.0 00:03:32.108 SYMLINK libspdk_scheduler_gscheduler.so 00:03:32.108 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:32.108 SO libspdk_accel_iaa.so.2.0 00:03:32.366 LIB libspdk_accel_dsa.a 00:03:32.366 SYMLINK libspdk_accel_error.so 00:03:32.366 SYMLINK libspdk_accel_ioat.so 00:03:32.366 SYMLINK libspdk_scheduler_dynamic.so 00:03:32.366 SO libspdk_accel_dsa.so.4.0 00:03:32.366 LIB libspdk_blob_bdev.a 00:03:32.366 SYMLINK libspdk_accel_iaa.so 00:03:32.366 SO libspdk_blob_bdev.so.10.1 00:03:32.366 SYMLINK libspdk_accel_dsa.so 00:03:32.366 SYMLINK libspdk_blob_bdev.so 00:03:32.627 CC module/bdev/delay/vbdev_delay.o 00:03:32.627 CC module/bdev/error/vbdev_error.o 00:03:32.627 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:32.627 CC module/bdev/null/bdev_null.o 00:03:32.627 CC module/bdev/split/vbdev_split.o 00:03:32.627 CC module/bdev/raid/bdev_raid.o 00:03:32.627 CC module/bdev/nvme/bdev_nvme.o 00:03:32.627 CC module/bdev/error/vbdev_error_rpc.o 00:03:32.627 CC module/bdev/null/bdev_null_rpc.o 00:03:32.627 CC module/bdev/malloc/bdev_malloc.o 00:03:32.627 CC module/bdev/raid/bdev_raid_rpc.o 00:03:32.627 CC module/bdev/split/vbdev_split_rpc.o 00:03:32.627 CC module/bdev/passthru/vbdev_passthru.o 00:03:32.627 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:32.627 CC module/blobfs/bdev/blobfs_bdev.o 00:03:32.627 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:32.627 CC module/bdev/aio/bdev_aio.o 00:03:32.627 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:32.627 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:32.627 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:32.627 CC module/bdev/aio/bdev_aio_rpc.o 00:03:32.627 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:32.627 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:32.627 CC module/bdev/raid/bdev_raid_sb.o 00:03:32.627 CC module/bdev/iscsi/bdev_iscsi.o 00:03:32.627 CC module/bdev/lvol/vbdev_lvol.o 00:03:32.627 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:32.627 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:32.627 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:32.627 CC module/bdev/nvme/nvme_rpc.o 00:03:32.627 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:32.627 CC module/bdev/gpt/gpt.o 00:03:32.627 CC module/bdev/raid/raid0.o 00:03:32.627 CC module/bdev/raid/raid1.o 00:03:32.627 CC module/bdev/gpt/vbdev_gpt.o 00:03:32.627 CC module/bdev/raid/concat.o 00:03:32.627 CC module/bdev/ftl/bdev_ftl.o 00:03:32.627 CC module/bdev/nvme/bdev_mdns_client.o 00:03:32.627 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:32.627 CC module/bdev/nvme/vbdev_opal.o 00:03:32.627 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:32.627 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:32.627 LIB libspdk_vfu_device.a 00:03:32.628 SO libspdk_vfu_device.so.2.0 00:03:32.886 SYMLINK libspdk_vfu_device.so 00:03:32.886 LIB libspdk_bdev_gpt.a 00:03:32.886 LIB libspdk_sock_posix.a 00:03:32.886 LIB libspdk_blobfs_bdev.a 00:03:32.886 SO libspdk_sock_posix.so.5.0 00:03:32.886 SO libspdk_blobfs_bdev.so.5.0 00:03:32.886 SO libspdk_bdev_gpt.so.5.0 00:03:32.886 LIB libspdk_bdev_ftl.a 00:03:32.886 LIB libspdk_bdev_split.a 00:03:32.886 SYMLINK libspdk_bdev_gpt.so 00:03:32.886 SYMLINK libspdk_blobfs_bdev.so 00:03:32.886 SO libspdk_bdev_ftl.so.5.0 00:03:32.886 LIB libspdk_bdev_iscsi.a 00:03:32.886 SO libspdk_bdev_split.so.5.0 00:03:32.886 SYMLINK libspdk_sock_posix.so 00:03:32.886 SO libspdk_bdev_iscsi.so.5.0 00:03:33.144 LIB libspdk_bdev_null.a 00:03:33.144 LIB libspdk_bdev_passthru.a 00:03:33.144 SYMLINK libspdk_bdev_ftl.so 00:03:33.144 SYMLINK libspdk_bdev_split.so 00:03:33.144 LIB libspdk_bdev_error.a 00:03:33.144 SO libspdk_bdev_null.so.5.0 00:03:33.144 SO libspdk_bdev_passthru.so.5.0 00:03:33.144 SYMLINK libspdk_bdev_iscsi.so 00:03:33.144 LIB libspdk_bdev_delay.a 00:03:33.144 SO libspdk_bdev_error.so.5.0 00:03:33.144 LIB libspdk_bdev_aio.a 00:03:33.144 SO libspdk_bdev_delay.so.5.0 00:03:33.144 SO libspdk_bdev_aio.so.5.0 00:03:33.144 SYMLINK libspdk_bdev_null.so 00:03:33.144 SYMLINK libspdk_bdev_passthru.so 00:03:33.144 LIB libspdk_bdev_zone_block.a 00:03:33.144 SYMLINK libspdk_bdev_error.so 00:03:33.144 LIB libspdk_bdev_malloc.a 00:03:33.144 SO libspdk_bdev_zone_block.so.5.0 00:03:33.144 SYMLINK libspdk_bdev_delay.so 00:03:33.144 SYMLINK libspdk_bdev_aio.so 00:03:33.144 SO libspdk_bdev_malloc.so.5.0 00:03:33.144 SYMLINK libspdk_bdev_zone_block.so 00:03:33.144 SYMLINK libspdk_bdev_malloc.so 00:03:33.144 LIB libspdk_bdev_lvol.a 00:03:33.402 SO libspdk_bdev_lvol.so.5.0 00:03:33.402 LIB libspdk_bdev_virtio.a 00:03:33.402 SO libspdk_bdev_virtio.so.5.0 00:03:33.402 SYMLINK libspdk_bdev_lvol.so 00:03:33.402 SYMLINK libspdk_bdev_virtio.so 00:03:33.660 LIB libspdk_bdev_raid.a 00:03:33.660 SO libspdk_bdev_raid.so.5.0 00:03:33.660 SYMLINK libspdk_bdev_raid.so 00:03:35.036 LIB libspdk_bdev_nvme.a 00:03:35.036 SO libspdk_bdev_nvme.so.6.0 00:03:35.036 SYMLINK libspdk_bdev_nvme.so 00:03:35.294 CC module/event/subsystems/scheduler/scheduler.o 00:03:35.294 CC module/event/subsystems/sock/sock.o 00:03:35.294 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:35.294 CC module/event/subsystems/vmd/vmd.o 00:03:35.294 CC module/event/subsystems/iobuf/iobuf.o 00:03:35.294 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:35.294 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:35.294 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:35.294 LIB libspdk_event_sock.a 00:03:35.294 LIB libspdk_event_vhost_blk.a 00:03:35.294 LIB libspdk_event_scheduler.a 00:03:35.294 LIB libspdk_event_vfu_tgt.a 00:03:35.294 LIB libspdk_event_vmd.a 00:03:35.294 SO libspdk_event_sock.so.4.0 00:03:35.294 LIB libspdk_event_iobuf.a 00:03:35.294 SO libspdk_event_vfu_tgt.so.2.0 00:03:35.294 SO libspdk_event_vhost_blk.so.2.0 00:03:35.294 SO libspdk_event_scheduler.so.3.0 00:03:35.294 SO libspdk_event_vmd.so.5.0 00:03:35.294 SO libspdk_event_iobuf.so.2.0 00:03:35.294 SYMLINK libspdk_event_sock.so 00:03:35.553 SYMLINK libspdk_event_vfu_tgt.so 00:03:35.553 SYMLINK libspdk_event_vhost_blk.so 00:03:35.553 SYMLINK libspdk_event_scheduler.so 00:03:35.553 SYMLINK libspdk_event_vmd.so 00:03:35.553 SYMLINK libspdk_event_iobuf.so 00:03:35.553 CC module/event/subsystems/accel/accel.o 00:03:35.811 LIB libspdk_event_accel.a 00:03:35.811 SO libspdk_event_accel.so.5.0 00:03:35.811 SYMLINK libspdk_event_accel.so 00:03:35.811 CC module/event/subsystems/bdev/bdev.o 00:03:36.070 LIB libspdk_event_bdev.a 00:03:36.070 SO libspdk_event_bdev.so.5.0 00:03:36.070 SYMLINK libspdk_event_bdev.so 00:03:36.329 CC module/event/subsystems/ublk/ublk.o 00:03:36.329 CC module/event/subsystems/scsi/scsi.o 00:03:36.329 CC module/event/subsystems/nbd/nbd.o 00:03:36.329 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:36.329 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:36.329 LIB libspdk_event_nbd.a 00:03:36.329 LIB libspdk_event_ublk.a 00:03:36.329 LIB libspdk_event_scsi.a 00:03:36.329 SO libspdk_event_nbd.so.5.0 00:03:36.329 SO libspdk_event_ublk.so.2.0 00:03:36.329 SO libspdk_event_scsi.so.5.0 00:03:36.329 SYMLINK libspdk_event_nbd.so 00:03:36.329 SYMLINK libspdk_event_ublk.so 00:03:36.588 SYMLINK libspdk_event_scsi.so 00:03:36.588 LIB libspdk_event_nvmf.a 00:03:36.588 SO libspdk_event_nvmf.so.5.0 00:03:36.588 SYMLINK libspdk_event_nvmf.so 00:03:36.588 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:36.588 CC module/event/subsystems/iscsi/iscsi.o 00:03:36.588 LIB libspdk_event_vhost_scsi.a 00:03:36.848 SO libspdk_event_vhost_scsi.so.2.0 00:03:36.848 LIB libspdk_event_iscsi.a 00:03:36.848 SO libspdk_event_iscsi.so.5.0 00:03:36.848 SYMLINK libspdk_event_vhost_scsi.so 00:03:36.848 SYMLINK libspdk_event_iscsi.so 00:03:36.848 SO libspdk.so.5.0 00:03:36.848 SYMLINK libspdk.so 00:03:37.118 CC app/spdk_nvme_discover/discovery_aer.o 00:03:37.118 CXX app/trace/trace.o 00:03:37.118 CC app/spdk_top/spdk_top.o 00:03:37.118 CC app/spdk_nvme_identify/identify.o 00:03:37.118 CC app/spdk_lspci/spdk_lspci.o 00:03:37.118 CC app/trace_record/trace_record.o 00:03:37.118 CC app/spdk_nvme_perf/perf.o 00:03:37.118 CC test/rpc_client/rpc_client_test.o 00:03:37.118 TEST_HEADER include/spdk/accel.h 00:03:37.118 TEST_HEADER include/spdk/accel_module.h 00:03:37.118 TEST_HEADER include/spdk/assert.h 00:03:37.118 TEST_HEADER include/spdk/barrier.h 00:03:37.118 TEST_HEADER include/spdk/base64.h 00:03:37.118 TEST_HEADER include/spdk/bdev.h 00:03:37.118 TEST_HEADER include/spdk/bdev_module.h 00:03:37.118 TEST_HEADER include/spdk/bdev_zone.h 00:03:37.118 TEST_HEADER include/spdk/bit_array.h 00:03:37.118 TEST_HEADER include/spdk/bit_pool.h 00:03:37.118 TEST_HEADER include/spdk/blob_bdev.h 00:03:37.118 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:37.118 TEST_HEADER include/spdk/blobfs.h 00:03:37.118 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:37.118 CC app/spdk_dd/spdk_dd.o 00:03:37.118 TEST_HEADER include/spdk/blob.h 00:03:37.118 TEST_HEADER include/spdk/conf.h 00:03:37.118 TEST_HEADER include/spdk/config.h 00:03:37.118 TEST_HEADER include/spdk/cpuset.h 00:03:37.118 TEST_HEADER include/spdk/crc16.h 00:03:37.118 CC app/nvmf_tgt/nvmf_main.o 00:03:37.118 CC app/iscsi_tgt/iscsi_tgt.o 00:03:37.118 TEST_HEADER include/spdk/crc32.h 00:03:37.118 CC examples/sock/hello_world/hello_sock.o 00:03:37.118 TEST_HEADER include/spdk/crc64.h 00:03:37.118 CC examples/util/zipf/zipf.o 00:03:37.118 TEST_HEADER include/spdk/dif.h 00:03:37.118 CC examples/vmd/led/led.o 00:03:37.118 TEST_HEADER include/spdk/dma.h 00:03:37.118 CC examples/accel/perf/accel_perf.o 00:03:37.118 CC examples/ioat/verify/verify.o 00:03:37.118 CC examples/nvme/reconnect/reconnect.o 00:03:37.118 CC examples/vmd/lsvmd/lsvmd.o 00:03:37.118 CC app/vhost/vhost.o 00:03:37.118 TEST_HEADER include/spdk/endian.h 00:03:37.118 CC examples/ioat/perf/perf.o 00:03:37.118 CC examples/idxd/perf/perf.o 00:03:37.118 CC app/fio/nvme/fio_plugin.o 00:03:37.118 TEST_HEADER include/spdk/env_dpdk.h 00:03:37.118 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:37.118 CC examples/nvme/hotplug/hotplug.o 00:03:37.118 CC examples/nvme/hello_world/hello_world.o 00:03:37.118 TEST_HEADER include/spdk/env.h 00:03:37.118 CC examples/nvme/abort/abort.o 00:03:37.118 TEST_HEADER include/spdk/event.h 00:03:37.118 CC examples/nvme/arbitration/arbitration.o 00:03:37.118 CC test/nvme/aer/aer.o 00:03:37.118 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:37.118 CC test/thread/poller_perf/poller_perf.o 00:03:37.118 TEST_HEADER include/spdk/fd_group.h 00:03:37.118 TEST_HEADER include/spdk/fd.h 00:03:37.118 CC app/spdk_tgt/spdk_tgt.o 00:03:37.118 TEST_HEADER include/spdk/file.h 00:03:37.118 CC test/event/event_perf/event_perf.o 00:03:37.118 TEST_HEADER include/spdk/ftl.h 00:03:37.118 TEST_HEADER include/spdk/gpt_spec.h 00:03:37.118 TEST_HEADER include/spdk/hexlify.h 00:03:37.118 TEST_HEADER include/spdk/histogram_data.h 00:03:37.118 TEST_HEADER include/spdk/idxd.h 00:03:37.118 CC examples/blob/cli/blobcli.o 00:03:37.118 TEST_HEADER include/spdk/idxd_spec.h 00:03:37.118 TEST_HEADER include/spdk/init.h 00:03:37.118 CC examples/blob/hello_world/hello_blob.o 00:03:37.118 TEST_HEADER include/spdk/ioat.h 00:03:37.118 TEST_HEADER include/spdk/ioat_spec.h 00:03:37.118 TEST_HEADER include/spdk/iscsi_spec.h 00:03:37.118 CC examples/thread/thread/thread_ex.o 00:03:37.118 CC examples/nvmf/nvmf/nvmf.o 00:03:37.118 CC examples/bdev/bdevperf/bdevperf.o 00:03:37.118 CC test/accel/dif/dif.o 00:03:37.118 TEST_HEADER include/spdk/json.h 00:03:37.118 CC examples/bdev/hello_world/hello_bdev.o 00:03:37.118 TEST_HEADER include/spdk/jsonrpc.h 00:03:37.118 TEST_HEADER include/spdk/likely.h 00:03:37.118 CC test/blobfs/mkfs/mkfs.o 00:03:37.118 TEST_HEADER include/spdk/log.h 00:03:37.118 CC test/dma/test_dma/test_dma.o 00:03:37.118 CC test/bdev/bdevio/bdevio.o 00:03:37.118 CC app/fio/bdev/fio_plugin.o 00:03:37.118 TEST_HEADER include/spdk/lvol.h 00:03:37.118 TEST_HEADER include/spdk/memory.h 00:03:37.118 TEST_HEADER include/spdk/mmio.h 00:03:37.118 CC test/app/bdev_svc/bdev_svc.o 00:03:37.118 TEST_HEADER include/spdk/nbd.h 00:03:37.118 TEST_HEADER include/spdk/notify.h 00:03:37.380 TEST_HEADER include/spdk/nvme.h 00:03:37.380 TEST_HEADER include/spdk/nvme_intel.h 00:03:37.380 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:37.380 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:37.380 CC test/env/mem_callbacks/mem_callbacks.o 00:03:37.380 TEST_HEADER include/spdk/nvme_spec.h 00:03:37.380 TEST_HEADER include/spdk/nvme_zns.h 00:03:37.380 CC test/lvol/esnap/esnap.o 00:03:37.380 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:37.380 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:37.380 TEST_HEADER include/spdk/nvmf.h 00:03:37.380 TEST_HEADER include/spdk/nvmf_spec.h 00:03:37.380 TEST_HEADER include/spdk/nvmf_transport.h 00:03:37.380 TEST_HEADER include/spdk/opal.h 00:03:37.380 TEST_HEADER include/spdk/opal_spec.h 00:03:37.380 TEST_HEADER include/spdk/pci_ids.h 00:03:37.380 TEST_HEADER include/spdk/pipe.h 00:03:37.381 TEST_HEADER include/spdk/queue.h 00:03:37.381 TEST_HEADER include/spdk/reduce.h 00:03:37.381 TEST_HEADER include/spdk/rpc.h 00:03:37.381 TEST_HEADER include/spdk/scheduler.h 00:03:37.381 TEST_HEADER include/spdk/scsi.h 00:03:37.381 TEST_HEADER include/spdk/scsi_spec.h 00:03:37.381 TEST_HEADER include/spdk/sock.h 00:03:37.381 TEST_HEADER include/spdk/stdinc.h 00:03:37.381 TEST_HEADER include/spdk/string.h 00:03:37.381 LINK spdk_lspci 00:03:37.381 TEST_HEADER include/spdk/thread.h 00:03:37.381 TEST_HEADER include/spdk/trace.h 00:03:37.381 TEST_HEADER include/spdk/trace_parser.h 00:03:37.381 TEST_HEADER include/spdk/tree.h 00:03:37.381 TEST_HEADER include/spdk/ublk.h 00:03:37.381 TEST_HEADER include/spdk/util.h 00:03:37.381 TEST_HEADER include/spdk/uuid.h 00:03:37.381 TEST_HEADER include/spdk/version.h 00:03:37.381 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:37.381 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:37.381 TEST_HEADER include/spdk/vhost.h 00:03:37.381 TEST_HEADER include/spdk/vmd.h 00:03:37.381 TEST_HEADER include/spdk/xor.h 00:03:37.381 TEST_HEADER include/spdk/zipf.h 00:03:37.381 CXX test/cpp_headers/accel.o 00:03:37.381 LINK lsvmd 00:03:37.381 LINK rpc_client_test 00:03:37.381 LINK spdk_nvme_discover 00:03:37.381 LINK zipf 00:03:37.381 LINK led 00:03:37.381 LINK interrupt_tgt 00:03:37.381 LINK nvmf_tgt 00:03:37.381 LINK poller_perf 00:03:37.381 LINK event_perf 00:03:37.644 LINK vhost 00:03:37.644 LINK cmb_copy 00:03:37.644 LINK iscsi_tgt 00:03:37.644 LINK spdk_trace_record 00:03:37.644 LINK ioat_perf 00:03:37.644 LINK verify 00:03:37.644 LINK spdk_tgt 00:03:37.644 LINK bdev_svc 00:03:37.644 LINK hello_sock 00:03:37.644 LINK hello_world 00:03:37.644 LINK mkfs 00:03:37.644 LINK hotplug 00:03:37.644 CXX test/cpp_headers/accel_module.o 00:03:37.644 LINK hello_blob 00:03:37.644 LINK hello_bdev 00:03:37.644 LINK thread 00:03:37.644 CXX test/cpp_headers/assert.o 00:03:37.644 LINK aer 00:03:37.906 LINK nvmf 00:03:37.906 CXX test/cpp_headers/barrier.o 00:03:37.906 LINK idxd_perf 00:03:37.906 LINK spdk_dd 00:03:37.906 CXX test/cpp_headers/base64.o 00:03:37.906 LINK arbitration 00:03:37.906 LINK reconnect 00:03:37.906 CC test/nvme/reset/reset.o 00:03:37.906 CC test/env/vtophys/vtophys.o 00:03:37.906 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:37.906 CC test/event/reactor/reactor.o 00:03:37.906 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:37.906 LINK abort 00:03:37.906 LINK spdk_trace 00:03:37.906 LINK bdevio 00:03:37.906 CXX test/cpp_headers/bdev.o 00:03:37.906 CC test/app/histogram_perf/histogram_perf.o 00:03:37.906 CXX test/cpp_headers/bdev_module.o 00:03:37.906 LINK dif 00:03:37.906 LINK test_dma 00:03:37.906 CC test/env/memory/memory_ut.o 00:03:37.906 CC test/app/jsoncat/jsoncat.o 00:03:37.906 CC test/nvme/sgl/sgl.o 00:03:37.906 CC test/env/pci/pci_ut.o 00:03:37.906 CC test/app/stub/stub.o 00:03:37.906 LINK accel_perf 00:03:37.906 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:38.167 CXX test/cpp_headers/bdev_zone.o 00:03:38.167 CC test/event/reactor_perf/reactor_perf.o 00:03:38.167 LINK nvme_manage 00:03:38.167 CXX test/cpp_headers/bit_array.o 00:03:38.167 CC test/event/app_repeat/app_repeat.o 00:03:38.167 CC test/nvme/e2edp/nvme_dp.o 00:03:38.167 CXX test/cpp_headers/bit_pool.o 00:03:38.167 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:38.167 CXX test/cpp_headers/blob_bdev.o 00:03:38.167 CXX test/cpp_headers/blobfs_bdev.o 00:03:38.167 CC test/nvme/overhead/overhead.o 00:03:38.167 CC test/event/scheduler/scheduler.o 00:03:38.167 LINK reactor 00:03:38.167 LINK blobcli 00:03:38.167 LINK vtophys 00:03:38.167 CXX test/cpp_headers/blobfs.o 00:03:38.167 CC test/nvme/err_injection/err_injection.o 00:03:38.167 LINK spdk_bdev 00:03:38.167 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:38.167 CC test/nvme/startup/startup.o 00:03:38.167 LINK pmr_persistence 00:03:38.167 LINK env_dpdk_post_init 00:03:38.167 CC test/nvme/reserve/reserve.o 00:03:38.167 LINK spdk_nvme 00:03:38.167 LINK histogram_perf 00:03:38.167 CC test/nvme/simple_copy/simple_copy.o 00:03:38.167 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:38.167 LINK jsoncat 00:03:38.167 CC test/nvme/connect_stress/connect_stress.o 00:03:38.429 CC test/nvme/boot_partition/boot_partition.o 00:03:38.429 LINK reset 00:03:38.429 LINK reactor_perf 00:03:38.429 LINK stub 00:03:38.429 CXX test/cpp_headers/blob.o 00:03:38.429 LINK app_repeat 00:03:38.429 CXX test/cpp_headers/conf.o 00:03:38.429 CXX test/cpp_headers/config.o 00:03:38.429 CXX test/cpp_headers/cpuset.o 00:03:38.429 CXX test/cpp_headers/crc16.o 00:03:38.429 LINK mem_callbacks 00:03:38.429 CXX test/cpp_headers/crc32.o 00:03:38.429 CC test/nvme/compliance/nvme_compliance.o 00:03:38.429 CXX test/cpp_headers/crc64.o 00:03:38.429 CXX test/cpp_headers/dif.o 00:03:38.429 CC test/nvme/cuse/cuse.o 00:03:38.429 CXX test/cpp_headers/dma.o 00:03:38.429 CXX test/cpp_headers/endian.o 00:03:38.429 CXX test/cpp_headers/env_dpdk.o 00:03:38.429 CC test/nvme/fdp/fdp.o 00:03:38.429 CC test/nvme/fused_ordering/fused_ordering.o 00:03:38.429 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:38.429 CXX test/cpp_headers/env.o 00:03:38.429 LINK sgl 00:03:38.429 CXX test/cpp_headers/event.o 00:03:38.429 CXX test/cpp_headers/fd_group.o 00:03:38.692 CXX test/cpp_headers/file.o 00:03:38.692 CXX test/cpp_headers/fd.o 00:03:38.692 CXX test/cpp_headers/ftl.o 00:03:38.692 CXX test/cpp_headers/gpt_spec.o 00:03:38.692 CXX test/cpp_headers/hexlify.o 00:03:38.692 LINK err_injection 00:03:38.692 LINK spdk_nvme_perf 00:03:38.692 LINK startup 00:03:38.692 LINK spdk_nvme_identify 00:03:38.692 LINK scheduler 00:03:38.692 CXX test/cpp_headers/histogram_data.o 00:03:38.692 LINK boot_partition 00:03:38.692 LINK connect_stress 00:03:38.692 LINK nvme_dp 00:03:38.692 CXX test/cpp_headers/idxd.o 00:03:38.692 LINK reserve 00:03:38.692 LINK spdk_top 00:03:38.692 CXX test/cpp_headers/idxd_spec.o 00:03:38.692 CXX test/cpp_headers/init.o 00:03:38.692 LINK bdevperf 00:03:38.692 CXX test/cpp_headers/ioat.o 00:03:38.692 LINK overhead 00:03:38.692 LINK simple_copy 00:03:38.692 LINK pci_ut 00:03:38.692 CXX test/cpp_headers/ioat_spec.o 00:03:38.692 CXX test/cpp_headers/iscsi_spec.o 00:03:38.692 CXX test/cpp_headers/json.o 00:03:38.692 CXX test/cpp_headers/jsonrpc.o 00:03:38.951 CXX test/cpp_headers/likely.o 00:03:38.951 LINK nvme_fuzz 00:03:38.951 CXX test/cpp_headers/log.o 00:03:38.951 CXX test/cpp_headers/lvol.o 00:03:38.951 CXX test/cpp_headers/memory.o 00:03:38.951 CXX test/cpp_headers/mmio.o 00:03:38.951 CXX test/cpp_headers/nbd.o 00:03:38.951 CXX test/cpp_headers/notify.o 00:03:38.951 CXX test/cpp_headers/nvme.o 00:03:38.951 LINK doorbell_aers 00:03:38.951 CXX test/cpp_headers/nvme_intel.o 00:03:38.951 CXX test/cpp_headers/nvme_ocssd.o 00:03:38.951 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:38.951 CXX test/cpp_headers/nvme_spec.o 00:03:38.951 CXX test/cpp_headers/nvme_zns.o 00:03:38.951 LINK fused_ordering 00:03:38.951 CXX test/cpp_headers/nvmf_cmd.o 00:03:38.951 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:38.951 CXX test/cpp_headers/nvmf.o 00:03:38.951 CXX test/cpp_headers/nvmf_spec.o 00:03:38.951 CXX test/cpp_headers/nvmf_transport.o 00:03:38.951 CXX test/cpp_headers/opal.o 00:03:38.951 CXX test/cpp_headers/opal_spec.o 00:03:38.951 CXX test/cpp_headers/pci_ids.o 00:03:38.952 CXX test/cpp_headers/pipe.o 00:03:38.952 CXX test/cpp_headers/queue.o 00:03:38.952 CXX test/cpp_headers/reduce.o 00:03:38.952 CXX test/cpp_headers/rpc.o 00:03:38.952 CXX test/cpp_headers/scheduler.o 00:03:38.952 CXX test/cpp_headers/scsi.o 00:03:38.952 CXX test/cpp_headers/scsi_spec.o 00:03:38.952 CXX test/cpp_headers/sock.o 00:03:38.952 CXX test/cpp_headers/stdinc.o 00:03:38.952 CXX test/cpp_headers/string.o 00:03:38.952 CXX test/cpp_headers/thread.o 00:03:38.952 CXX test/cpp_headers/trace.o 00:03:39.211 CXX test/cpp_headers/trace_parser.o 00:03:39.211 CXX test/cpp_headers/tree.o 00:03:39.211 LINK vhost_fuzz 00:03:39.211 LINK nvme_compliance 00:03:39.211 CXX test/cpp_headers/ublk.o 00:03:39.211 CXX test/cpp_headers/util.o 00:03:39.211 CXX test/cpp_headers/uuid.o 00:03:39.211 CXX test/cpp_headers/version.o 00:03:39.211 LINK fdp 00:03:39.211 CXX test/cpp_headers/vfio_user_pci.o 00:03:39.211 CXX test/cpp_headers/vfio_user_spec.o 00:03:39.211 CXX test/cpp_headers/vhost.o 00:03:39.211 CXX test/cpp_headers/vmd.o 00:03:39.211 CXX test/cpp_headers/xor.o 00:03:39.211 CXX test/cpp_headers/zipf.o 00:03:39.778 LINK memory_ut 00:03:40.036 LINK cuse 00:03:40.294 LINK iscsi_fuzz 00:03:42.829 LINK esnap 00:03:42.829 00:03:42.829 real 0m37.591s 00:03:42.829 user 7m17.374s 00:03:42.829 sys 1m37.337s 00:03:42.829 04:59:44 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:42.829 04:59:44 -- common/autotest_common.sh@10 -- $ set +x 00:03:42.829 ************************************ 00:03:42.829 END TEST make 00:03:42.829 ************************************ 00:03:43.088 04:59:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:43.088 04:59:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:43.088 04:59:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:43.088 04:59:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:43.088 04:59:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:43.088 04:59:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:43.088 04:59:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:43.088 04:59:44 -- scripts/common.sh@335 -- # IFS=.-: 00:03:43.088 04:59:44 -- scripts/common.sh@335 -- # read -ra ver1 00:03:43.088 04:59:44 -- scripts/common.sh@336 -- # IFS=.-: 00:03:43.088 04:59:44 -- scripts/common.sh@336 -- # read -ra ver2 00:03:43.088 04:59:44 -- scripts/common.sh@337 -- # local 'op=<' 00:03:43.088 04:59:44 -- scripts/common.sh@339 -- # ver1_l=2 00:03:43.088 04:59:44 -- scripts/common.sh@340 -- # ver2_l=1 00:03:43.088 04:59:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:43.088 04:59:44 -- scripts/common.sh@343 -- # case "$op" in 00:03:43.088 04:59:44 -- scripts/common.sh@344 -- # : 1 00:03:43.088 04:59:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:43.088 04:59:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:43.088 04:59:44 -- scripts/common.sh@364 -- # decimal 1 00:03:43.088 04:59:44 -- scripts/common.sh@352 -- # local d=1 00:03:43.088 04:59:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:43.088 04:59:44 -- scripts/common.sh@354 -- # echo 1 00:03:43.088 04:59:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:43.088 04:59:44 -- scripts/common.sh@365 -- # decimal 2 00:03:43.088 04:59:44 -- scripts/common.sh@352 -- # local d=2 00:03:43.088 04:59:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:43.088 04:59:44 -- scripts/common.sh@354 -- # echo 2 00:03:43.088 04:59:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:43.088 04:59:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:43.088 04:59:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:43.088 04:59:44 -- scripts/common.sh@367 -- # return 0 00:03:43.088 04:59:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:43.088 04:59:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:43.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:43.088 --rc genhtml_branch_coverage=1 00:03:43.088 --rc genhtml_function_coverage=1 00:03:43.088 --rc genhtml_legend=1 00:03:43.088 --rc geninfo_all_blocks=1 00:03:43.088 --rc geninfo_unexecuted_blocks=1 00:03:43.088 00:03:43.088 ' 00:03:43.088 04:59:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:43.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:43.088 --rc genhtml_branch_coverage=1 00:03:43.088 --rc genhtml_function_coverage=1 00:03:43.088 --rc genhtml_legend=1 00:03:43.088 --rc geninfo_all_blocks=1 00:03:43.088 --rc geninfo_unexecuted_blocks=1 00:03:43.088 00:03:43.088 ' 00:03:43.088 04:59:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:43.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:43.088 --rc genhtml_branch_coverage=1 00:03:43.088 --rc genhtml_function_coverage=1 00:03:43.088 --rc genhtml_legend=1 00:03:43.088 --rc geninfo_all_blocks=1 00:03:43.088 --rc geninfo_unexecuted_blocks=1 00:03:43.088 00:03:43.088 ' 00:03:43.088 04:59:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:43.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:43.088 --rc genhtml_branch_coverage=1 00:03:43.088 --rc genhtml_function_coverage=1 00:03:43.088 --rc genhtml_legend=1 00:03:43.088 --rc geninfo_all_blocks=1 00:03:43.088 --rc geninfo_unexecuted_blocks=1 00:03:43.088 00:03:43.088 ' 00:03:43.088 04:59:44 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:43.088 04:59:44 -- nvmf/common.sh@7 -- # uname -s 00:03:43.088 04:59:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:43.088 04:59:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:43.088 04:59:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:43.088 04:59:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:43.088 04:59:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:43.088 04:59:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:43.088 04:59:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:43.088 04:59:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:43.088 04:59:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:43.088 04:59:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:43.088 04:59:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:43.088 04:59:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:43.088 04:59:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:43.088 04:59:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:43.088 04:59:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:43.088 04:59:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:43.088 04:59:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:43.088 04:59:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:43.088 04:59:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:43.088 04:59:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:43.088 04:59:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:43.088 04:59:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:43.088 04:59:44 -- paths/export.sh@5 -- # export PATH 00:03:43.088 04:59:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:43.088 04:59:44 -- nvmf/common.sh@46 -- # : 0 00:03:43.088 04:59:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:43.088 04:59:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:43.088 04:59:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:43.088 04:59:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:43.088 04:59:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:43.088 04:59:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:43.088 04:59:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:43.088 04:59:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:43.088 04:59:44 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:43.088 04:59:44 -- spdk/autotest.sh@32 -- # uname -s 00:03:43.089 04:59:44 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:43.089 04:59:44 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:43.089 04:59:44 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:43.089 04:59:44 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:43.089 04:59:44 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:43.089 04:59:44 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:43.089 04:59:44 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:43.089 04:59:44 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:43.089 04:59:44 -- spdk/autotest.sh@48 -- # udevadm_pid=3141022 00:03:43.089 04:59:44 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:43.089 04:59:44 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:43.089 04:59:44 -- spdk/autotest.sh@54 -- # echo 3141024 00:03:43.089 04:59:44 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:43.089 04:59:44 -- spdk/autotest.sh@56 -- # echo 3141025 00:03:43.089 04:59:44 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:43.089 04:59:44 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:43.089 04:59:44 -- spdk/autotest.sh@60 -- # echo 3141026 00:03:43.089 04:59:44 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:43.089 04:59:44 -- spdk/autotest.sh@62 -- # echo 3141027 00:03:43.089 04:59:44 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:43.089 04:59:44 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:43.089 04:59:44 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:43.089 04:59:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:43.089 04:59:44 -- common/autotest_common.sh@10 -- # set +x 00:03:43.089 04:59:44 -- spdk/autotest.sh@70 -- # create_test_list 00:03:43.089 04:59:44 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:43.089 04:59:44 -- common/autotest_common.sh@10 -- # set +x 00:03:43.089 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:43.089 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:43.089 04:59:44 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:43.089 04:59:44 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:43.089 04:59:44 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:43.089 04:59:44 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:43.089 04:59:44 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:43.089 04:59:44 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:43.089 04:59:44 -- common/autotest_common.sh@1450 -- # uname 00:03:43.089 04:59:44 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:43.089 04:59:44 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:43.089 04:59:44 -- common/autotest_common.sh@1470 -- # uname 00:03:43.089 04:59:44 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:43.089 04:59:44 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:43.089 04:59:44 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:43.349 lcov: LCOV version 1.15 00:03:43.349 04:59:44 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:04:01.454 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:04:01.454 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:04:01.454 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:04:01.454 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:04:01.454 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:04:01.454 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:19.555 05:00:18 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:19.555 05:00:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:19.555 05:00:18 -- common/autotest_common.sh@10 -- # set +x 00:04:19.555 05:00:18 -- spdk/autotest.sh@89 -- # rm -f 00:04:19.555 05:00:18 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:19.555 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:19.555 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:19.555 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:19.555 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:19.555 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:19.555 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:19.555 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:19.555 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:19.555 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:19.555 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:19.555 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:19.555 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:19.555 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:19.555 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:19.555 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:19.555 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:19.555 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:19.555 05:00:20 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:19.555 05:00:20 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:19.555 05:00:20 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:19.555 05:00:20 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:19.555 05:00:20 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:19.555 05:00:20 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:19.555 05:00:20 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:19.555 05:00:20 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:19.555 05:00:20 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:19.555 05:00:20 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:19.555 05:00:20 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:19.555 05:00:20 -- spdk/autotest.sh@108 -- # grep -v p 00:04:19.555 05:00:20 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:19.555 05:00:20 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:19.555 05:00:20 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:19.555 05:00:20 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:19.555 05:00:20 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:19.555 No valid GPT data, bailing 00:04:19.555 05:00:20 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:19.555 05:00:20 -- scripts/common.sh@393 -- # pt= 00:04:19.555 05:00:20 -- scripts/common.sh@394 -- # return 1 00:04:19.555 05:00:20 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:19.555 1+0 records in 00:04:19.555 1+0 records out 00:04:19.555 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00215737 s, 486 MB/s 00:04:19.555 05:00:20 -- spdk/autotest.sh@116 -- # sync 00:04:19.555 05:00:20 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:19.555 05:00:20 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:19.555 05:00:20 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:20.492 05:00:22 -- spdk/autotest.sh@122 -- # uname -s 00:04:20.492 05:00:22 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:20.492 05:00:22 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:20.492 05:00:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:20.492 05:00:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:20.492 05:00:22 -- common/autotest_common.sh@10 -- # set +x 00:04:20.492 ************************************ 00:04:20.492 START TEST setup.sh 00:04:20.492 ************************************ 00:04:20.492 05:00:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:20.492 * Looking for test storage... 00:04:20.492 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:20.492 05:00:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:20.492 05:00:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:20.492 05:00:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:20.492 05:00:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:20.492 05:00:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:20.492 05:00:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:20.492 05:00:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:20.492 05:00:22 -- scripts/common.sh@335 -- # IFS=.-: 00:04:20.492 05:00:22 -- scripts/common.sh@335 -- # read -ra ver1 00:04:20.492 05:00:22 -- scripts/common.sh@336 -- # IFS=.-: 00:04:20.492 05:00:22 -- scripts/common.sh@336 -- # read -ra ver2 00:04:20.492 05:00:22 -- scripts/common.sh@337 -- # local 'op=<' 00:04:20.492 05:00:22 -- scripts/common.sh@339 -- # ver1_l=2 00:04:20.492 05:00:22 -- scripts/common.sh@340 -- # ver2_l=1 00:04:20.492 05:00:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:20.492 05:00:22 -- scripts/common.sh@343 -- # case "$op" in 00:04:20.492 05:00:22 -- scripts/common.sh@344 -- # : 1 00:04:20.492 05:00:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:20.492 05:00:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:20.492 05:00:22 -- scripts/common.sh@364 -- # decimal 1 00:04:20.492 05:00:22 -- scripts/common.sh@352 -- # local d=1 00:04:20.492 05:00:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:20.492 05:00:22 -- scripts/common.sh@354 -- # echo 1 00:04:20.492 05:00:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:20.492 05:00:22 -- scripts/common.sh@365 -- # decimal 2 00:04:20.492 05:00:22 -- scripts/common.sh@352 -- # local d=2 00:04:20.492 05:00:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:20.492 05:00:22 -- scripts/common.sh@354 -- # echo 2 00:04:20.492 05:00:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:20.492 05:00:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:20.492 05:00:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:20.492 05:00:22 -- scripts/common.sh@367 -- # return 0 00:04:20.492 05:00:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:20.492 05:00:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:20.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.492 --rc genhtml_branch_coverage=1 00:04:20.492 --rc genhtml_function_coverage=1 00:04:20.492 --rc genhtml_legend=1 00:04:20.492 --rc geninfo_all_blocks=1 00:04:20.492 --rc geninfo_unexecuted_blocks=1 00:04:20.492 00:04:20.492 ' 00:04:20.492 05:00:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:20.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.492 --rc genhtml_branch_coverage=1 00:04:20.492 --rc genhtml_function_coverage=1 00:04:20.492 --rc genhtml_legend=1 00:04:20.492 --rc geninfo_all_blocks=1 00:04:20.492 --rc geninfo_unexecuted_blocks=1 00:04:20.492 00:04:20.492 ' 00:04:20.492 05:00:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:20.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.492 --rc genhtml_branch_coverage=1 00:04:20.492 --rc genhtml_function_coverage=1 00:04:20.492 --rc genhtml_legend=1 00:04:20.492 --rc geninfo_all_blocks=1 00:04:20.492 --rc geninfo_unexecuted_blocks=1 00:04:20.492 00:04:20.492 ' 00:04:20.492 05:00:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:20.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.492 --rc genhtml_branch_coverage=1 00:04:20.492 --rc genhtml_function_coverage=1 00:04:20.492 --rc genhtml_legend=1 00:04:20.492 --rc geninfo_all_blocks=1 00:04:20.492 --rc geninfo_unexecuted_blocks=1 00:04:20.492 00:04:20.492 ' 00:04:20.492 05:00:22 -- setup/test-setup.sh@10 -- # uname -s 00:04:20.492 05:00:22 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:20.492 05:00:22 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:20.492 05:00:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:20.492 05:00:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:20.492 05:00:22 -- common/autotest_common.sh@10 -- # set +x 00:04:20.492 ************************************ 00:04:20.492 START TEST acl 00:04:20.492 ************************************ 00:04:20.492 05:00:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:20.492 * Looking for test storage... 00:04:20.492 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:20.492 05:00:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:20.492 05:00:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:20.492 05:00:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:20.751 05:00:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:20.751 05:00:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:20.752 05:00:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:20.752 05:00:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:20.752 05:00:22 -- scripts/common.sh@335 -- # IFS=.-: 00:04:20.752 05:00:22 -- scripts/common.sh@335 -- # read -ra ver1 00:04:20.752 05:00:22 -- scripts/common.sh@336 -- # IFS=.-: 00:04:20.752 05:00:22 -- scripts/common.sh@336 -- # read -ra ver2 00:04:20.752 05:00:22 -- scripts/common.sh@337 -- # local 'op=<' 00:04:20.752 05:00:22 -- scripts/common.sh@339 -- # ver1_l=2 00:04:20.752 05:00:22 -- scripts/common.sh@340 -- # ver2_l=1 00:04:20.752 05:00:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:20.752 05:00:22 -- scripts/common.sh@343 -- # case "$op" in 00:04:20.752 05:00:22 -- scripts/common.sh@344 -- # : 1 00:04:20.752 05:00:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:20.752 05:00:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:20.752 05:00:22 -- scripts/common.sh@364 -- # decimal 1 00:04:20.752 05:00:22 -- scripts/common.sh@352 -- # local d=1 00:04:20.752 05:00:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:20.752 05:00:22 -- scripts/common.sh@354 -- # echo 1 00:04:20.752 05:00:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:20.752 05:00:22 -- scripts/common.sh@365 -- # decimal 2 00:04:20.752 05:00:22 -- scripts/common.sh@352 -- # local d=2 00:04:20.752 05:00:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:20.752 05:00:22 -- scripts/common.sh@354 -- # echo 2 00:04:20.752 05:00:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:20.752 05:00:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:20.752 05:00:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:20.752 05:00:22 -- scripts/common.sh@367 -- # return 0 00:04:20.752 05:00:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:20.752 05:00:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:20.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.752 --rc genhtml_branch_coverage=1 00:04:20.752 --rc genhtml_function_coverage=1 00:04:20.752 --rc genhtml_legend=1 00:04:20.752 --rc geninfo_all_blocks=1 00:04:20.752 --rc geninfo_unexecuted_blocks=1 00:04:20.752 00:04:20.752 ' 00:04:20.752 05:00:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:20.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.752 --rc genhtml_branch_coverage=1 00:04:20.752 --rc genhtml_function_coverage=1 00:04:20.752 --rc genhtml_legend=1 00:04:20.752 --rc geninfo_all_blocks=1 00:04:20.752 --rc geninfo_unexecuted_blocks=1 00:04:20.752 00:04:20.752 ' 00:04:20.752 05:00:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:20.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.752 --rc genhtml_branch_coverage=1 00:04:20.752 --rc genhtml_function_coverage=1 00:04:20.752 --rc genhtml_legend=1 00:04:20.752 --rc geninfo_all_blocks=1 00:04:20.752 --rc geninfo_unexecuted_blocks=1 00:04:20.752 00:04:20.752 ' 00:04:20.752 05:00:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:20.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.752 --rc genhtml_branch_coverage=1 00:04:20.752 --rc genhtml_function_coverage=1 00:04:20.752 --rc genhtml_legend=1 00:04:20.752 --rc geninfo_all_blocks=1 00:04:20.752 --rc geninfo_unexecuted_blocks=1 00:04:20.752 00:04:20.752 ' 00:04:20.752 05:00:22 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:20.752 05:00:22 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:20.752 05:00:22 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:20.752 05:00:22 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:20.752 05:00:22 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:20.752 05:00:22 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:20.752 05:00:22 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:20.752 05:00:22 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:20.752 05:00:22 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:20.752 05:00:22 -- setup/acl.sh@12 -- # devs=() 00:04:20.752 05:00:22 -- setup/acl.sh@12 -- # declare -a devs 00:04:20.752 05:00:22 -- setup/acl.sh@13 -- # drivers=() 00:04:20.752 05:00:22 -- setup/acl.sh@13 -- # declare -A drivers 00:04:20.752 05:00:22 -- setup/acl.sh@51 -- # setup reset 00:04:20.752 05:00:22 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:20.752 05:00:22 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:22.192 05:00:23 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:22.192 05:00:23 -- setup/acl.sh@16 -- # local dev driver 00:04:22.192 05:00:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:22.192 05:00:23 -- setup/acl.sh@15 -- # setup output status 00:04:22.192 05:00:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:22.192 05:00:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:23.133 Hugepages 00:04:23.133 node hugesize free / total 00:04:23.133 05:00:24 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:23.133 05:00:24 -- setup/acl.sh@19 -- # continue 00:04:23.133 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.133 05:00:24 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:23.133 05:00:24 -- setup/acl.sh@19 -- # continue 00:04:23.133 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.133 05:00:24 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:23.133 05:00:24 -- setup/acl.sh@19 -- # continue 00:04:23.133 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.133 00:04:23.133 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:23.133 05:00:24 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:23.133 05:00:24 -- setup/acl.sh@19 -- # continue 00:04:23.133 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.133 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:23.133 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.133 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.133 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.133 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:23.133 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.133 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.133 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.133 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:23.133 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # continue 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:23.134 05:00:24 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:23.134 05:00:24 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:23.134 05:00:24 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:23.134 05:00:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:23.134 05:00:24 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:23.134 05:00:24 -- setup/acl.sh@54 -- # run_test denied denied 00:04:23.134 05:00:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:23.134 05:00:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:23.134 05:00:24 -- common/autotest_common.sh@10 -- # set +x 00:04:23.134 ************************************ 00:04:23.134 START TEST denied 00:04:23.134 ************************************ 00:04:23.134 05:00:24 -- common/autotest_common.sh@1114 -- # denied 00:04:23.134 05:00:24 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:23.134 05:00:24 -- setup/acl.sh@38 -- # setup output config 00:04:23.134 05:00:24 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:23.134 05:00:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:23.134 05:00:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:25.039 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:25.039 05:00:26 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:25.039 05:00:26 -- setup/acl.sh@28 -- # local dev driver 00:04:25.039 05:00:26 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:25.039 05:00:26 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:25.039 05:00:26 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:25.040 05:00:26 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:25.040 05:00:26 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:25.040 05:00:26 -- setup/acl.sh@41 -- # setup reset 00:04:25.040 05:00:26 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:25.040 05:00:26 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:26.946 00:04:26.946 real 0m3.778s 00:04:26.946 user 0m1.123s 00:04:26.946 sys 0m1.760s 00:04:26.946 05:00:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:26.946 05:00:28 -- common/autotest_common.sh@10 -- # set +x 00:04:26.946 ************************************ 00:04:26.947 END TEST denied 00:04:26.947 ************************************ 00:04:26.947 05:00:28 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:26.947 05:00:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:26.947 05:00:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:26.947 05:00:28 -- common/autotest_common.sh@10 -- # set +x 00:04:26.947 ************************************ 00:04:26.947 START TEST allowed 00:04:26.947 ************************************ 00:04:26.947 05:00:28 -- common/autotest_common.sh@1114 -- # allowed 00:04:26.947 05:00:28 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:26.947 05:00:28 -- setup/acl.sh@45 -- # setup output config 00:04:26.947 05:00:28 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:26.947 05:00:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:26.947 05:00:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:29.491 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:29.491 05:00:31 -- setup/acl.sh@47 -- # verify 00:04:29.491 05:00:31 -- setup/acl.sh@28 -- # local dev driver 00:04:29.491 05:00:31 -- setup/acl.sh@48 -- # setup reset 00:04:29.491 05:00:31 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:29.491 05:00:31 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:30.869 00:04:30.869 real 0m3.852s 00:04:30.869 user 0m1.020s 00:04:30.869 sys 0m1.693s 00:04:30.869 05:00:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:30.869 05:00:32 -- common/autotest_common.sh@10 -- # set +x 00:04:30.869 ************************************ 00:04:30.869 END TEST allowed 00:04:30.869 ************************************ 00:04:30.869 00:04:30.869 real 0m10.317s 00:04:30.869 user 0m3.205s 00:04:30.869 sys 0m5.160s 00:04:30.869 05:00:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:30.869 05:00:32 -- common/autotest_common.sh@10 -- # set +x 00:04:30.869 ************************************ 00:04:30.869 END TEST acl 00:04:30.869 ************************************ 00:04:30.869 05:00:32 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:30.869 05:00:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.869 05:00:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.869 05:00:32 -- common/autotest_common.sh@10 -- # set +x 00:04:30.869 ************************************ 00:04:30.869 START TEST hugepages 00:04:30.869 ************************************ 00:04:30.869 05:00:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:30.869 * Looking for test storage... 00:04:30.869 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:30.869 05:00:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:30.869 05:00:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:30.869 05:00:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:31.129 05:00:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:31.129 05:00:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:31.129 05:00:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:31.129 05:00:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:31.129 05:00:32 -- scripts/common.sh@335 -- # IFS=.-: 00:04:31.130 05:00:32 -- scripts/common.sh@335 -- # read -ra ver1 00:04:31.130 05:00:32 -- scripts/common.sh@336 -- # IFS=.-: 00:04:31.130 05:00:32 -- scripts/common.sh@336 -- # read -ra ver2 00:04:31.130 05:00:32 -- scripts/common.sh@337 -- # local 'op=<' 00:04:31.130 05:00:32 -- scripts/common.sh@339 -- # ver1_l=2 00:04:31.130 05:00:32 -- scripts/common.sh@340 -- # ver2_l=1 00:04:31.130 05:00:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:31.130 05:00:32 -- scripts/common.sh@343 -- # case "$op" in 00:04:31.130 05:00:32 -- scripts/common.sh@344 -- # : 1 00:04:31.130 05:00:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:31.130 05:00:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:31.130 05:00:32 -- scripts/common.sh@364 -- # decimal 1 00:04:31.130 05:00:32 -- scripts/common.sh@352 -- # local d=1 00:04:31.130 05:00:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:31.130 05:00:32 -- scripts/common.sh@354 -- # echo 1 00:04:31.130 05:00:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:31.130 05:00:32 -- scripts/common.sh@365 -- # decimal 2 00:04:31.130 05:00:32 -- scripts/common.sh@352 -- # local d=2 00:04:31.130 05:00:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:31.130 05:00:32 -- scripts/common.sh@354 -- # echo 2 00:04:31.130 05:00:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:31.130 05:00:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:31.130 05:00:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:31.130 05:00:32 -- scripts/common.sh@367 -- # return 0 00:04:31.130 05:00:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:31.130 05:00:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:31.130 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.130 --rc genhtml_branch_coverage=1 00:04:31.130 --rc genhtml_function_coverage=1 00:04:31.130 --rc genhtml_legend=1 00:04:31.130 --rc geninfo_all_blocks=1 00:04:31.130 --rc geninfo_unexecuted_blocks=1 00:04:31.130 00:04:31.130 ' 00:04:31.130 05:00:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:31.130 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.130 --rc genhtml_branch_coverage=1 00:04:31.130 --rc genhtml_function_coverage=1 00:04:31.130 --rc genhtml_legend=1 00:04:31.130 --rc geninfo_all_blocks=1 00:04:31.130 --rc geninfo_unexecuted_blocks=1 00:04:31.130 00:04:31.130 ' 00:04:31.130 05:00:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:31.130 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.130 --rc genhtml_branch_coverage=1 00:04:31.130 --rc genhtml_function_coverage=1 00:04:31.130 --rc genhtml_legend=1 00:04:31.130 --rc geninfo_all_blocks=1 00:04:31.130 --rc geninfo_unexecuted_blocks=1 00:04:31.130 00:04:31.130 ' 00:04:31.130 05:00:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:31.130 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.130 --rc genhtml_branch_coverage=1 00:04:31.130 --rc genhtml_function_coverage=1 00:04:31.130 --rc genhtml_legend=1 00:04:31.130 --rc geninfo_all_blocks=1 00:04:31.130 --rc geninfo_unexecuted_blocks=1 00:04:31.130 00:04:31.130 ' 00:04:31.130 05:00:32 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:31.130 05:00:32 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:31.130 05:00:32 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:31.130 05:00:32 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:31.130 05:00:32 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:31.130 05:00:32 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:31.130 05:00:32 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:31.130 05:00:32 -- setup/common.sh@18 -- # local node= 00:04:31.130 05:00:32 -- setup/common.sh@19 -- # local var val 00:04:31.130 05:00:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:31.130 05:00:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:31.130 05:00:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:31.130 05:00:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:31.130 05:00:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:31.130 05:00:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.130 05:00:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 40485056 kB' 'MemAvailable: 44264376 kB' 'Buffers: 2708 kB' 'Cached: 13259600 kB' 'SwapCached: 0 kB' 'Active: 9992608 kB' 'Inactive: 3766524 kB' 'Active(anon): 9590836 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500204 kB' 'Mapped: 187912 kB' 'Shmem: 9094012 kB' 'KReclaimable: 209692 kB' 'Slab: 780180 kB' 'SReclaimable: 209692 kB' 'SUnreclaim: 570488 kB' 'KernelStack: 12816 kB' 'PageTables: 8292 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559280 kB' 'Committed_AS: 10660668 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198652 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.130 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.130 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.131 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.131 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # continue 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.132 05:00:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.132 05:00:32 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:31.132 05:00:32 -- setup/common.sh@33 -- # echo 2048 00:04:31.132 05:00:32 -- setup/common.sh@33 -- # return 0 00:04:31.132 05:00:32 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:31.132 05:00:32 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:31.132 05:00:32 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:31.132 05:00:32 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:31.132 05:00:32 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:31.132 05:00:32 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:31.132 05:00:32 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:31.132 05:00:32 -- setup/hugepages.sh@207 -- # get_nodes 00:04:31.132 05:00:32 -- setup/hugepages.sh@27 -- # local node 00:04:31.132 05:00:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:31.132 05:00:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:31.132 05:00:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:31.132 05:00:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:31.132 05:00:32 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:31.132 05:00:32 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:31.132 05:00:32 -- setup/hugepages.sh@208 -- # clear_hp 00:04:31.132 05:00:32 -- setup/hugepages.sh@37 -- # local node hp 00:04:31.132 05:00:32 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:31.132 05:00:32 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:31.132 05:00:32 -- setup/hugepages.sh@41 -- # echo 0 00:04:31.132 05:00:32 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:31.132 05:00:32 -- setup/hugepages.sh@41 -- # echo 0 00:04:31.132 05:00:32 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:31.132 05:00:32 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:31.132 05:00:32 -- setup/hugepages.sh@41 -- # echo 0 00:04:31.132 05:00:32 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:31.132 05:00:32 -- setup/hugepages.sh@41 -- # echo 0 00:04:31.132 05:00:32 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:31.132 05:00:32 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:31.132 05:00:32 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:31.132 05:00:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:31.132 05:00:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:31.132 05:00:32 -- common/autotest_common.sh@10 -- # set +x 00:04:31.132 ************************************ 00:04:31.132 START TEST default_setup 00:04:31.132 ************************************ 00:04:31.132 05:00:32 -- common/autotest_common.sh@1114 -- # default_setup 00:04:31.132 05:00:32 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:31.132 05:00:32 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:31.132 05:00:32 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:31.132 05:00:32 -- setup/hugepages.sh@51 -- # shift 00:04:31.132 05:00:32 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:31.132 05:00:32 -- setup/hugepages.sh@52 -- # local node_ids 00:04:31.132 05:00:32 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:31.132 05:00:32 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:31.132 05:00:32 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:31.132 05:00:32 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:31.132 05:00:32 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:31.132 05:00:32 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:31.132 05:00:32 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:31.132 05:00:32 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:31.132 05:00:32 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:31.132 05:00:32 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:31.132 05:00:32 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:31.132 05:00:32 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:31.132 05:00:32 -- setup/hugepages.sh@73 -- # return 0 00:04:31.132 05:00:32 -- setup/hugepages.sh@137 -- # setup output 00:04:31.132 05:00:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:31.132 05:00:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:32.507 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:32.507 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:32.507 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:32.507 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:32.507 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:32.507 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:32.507 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:32.507 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:32.507 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:32.507 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:32.507 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:32.507 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:32.507 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:32.507 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:32.507 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:32.507 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:33.445 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:33.445 05:00:35 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:33.445 05:00:35 -- setup/hugepages.sh@89 -- # local node 00:04:33.445 05:00:35 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:33.445 05:00:35 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:33.445 05:00:35 -- setup/hugepages.sh@92 -- # local surp 00:04:33.445 05:00:35 -- setup/hugepages.sh@93 -- # local resv 00:04:33.445 05:00:35 -- setup/hugepages.sh@94 -- # local anon 00:04:33.445 05:00:35 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:33.445 05:00:35 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:33.445 05:00:35 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:33.445 05:00:35 -- setup/common.sh@18 -- # local node= 00:04:33.445 05:00:35 -- setup/common.sh@19 -- # local var val 00:04:33.445 05:00:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:33.445 05:00:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:33.445 05:00:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:33.445 05:00:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:33.445 05:00:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:33.445 05:00:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42602876 kB' 'MemAvailable: 46382192 kB' 'Buffers: 2708 kB' 'Cached: 13259700 kB' 'SwapCached: 0 kB' 'Active: 9994428 kB' 'Inactive: 3766524 kB' 'Active(anon): 9592656 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501812 kB' 'Mapped: 187952 kB' 'Shmem: 9094112 kB' 'KReclaimable: 209684 kB' 'Slab: 780280 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 570596 kB' 'KernelStack: 12800 kB' 'PageTables: 8248 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10667208 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198764 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.445 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.445 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.446 05:00:35 -- setup/common.sh@33 -- # echo 0 00:04:33.446 05:00:35 -- setup/common.sh@33 -- # return 0 00:04:33.446 05:00:35 -- setup/hugepages.sh@97 -- # anon=0 00:04:33.446 05:00:35 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:33.446 05:00:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:33.446 05:00:35 -- setup/common.sh@18 -- # local node= 00:04:33.446 05:00:35 -- setup/common.sh@19 -- # local var val 00:04:33.446 05:00:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:33.446 05:00:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:33.446 05:00:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:33.446 05:00:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:33.446 05:00:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:33.446 05:00:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42605260 kB' 'MemAvailable: 46384576 kB' 'Buffers: 2708 kB' 'Cached: 13259708 kB' 'SwapCached: 0 kB' 'Active: 9994828 kB' 'Inactive: 3766524 kB' 'Active(anon): 9593056 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502344 kB' 'Mapped: 187952 kB' 'Shmem: 9094120 kB' 'KReclaimable: 209684 kB' 'Slab: 780284 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 570600 kB' 'KernelStack: 12832 kB' 'PageTables: 8332 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10667592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198780 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.446 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.446 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.447 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.447 05:00:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.448 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.448 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.448 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.448 05:00:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.448 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.448 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.448 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.448 05:00:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.448 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.448 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.448 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.448 05:00:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.448 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.448 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.448 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.448 05:00:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.448 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.448 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.448 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.448 05:00:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.448 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.448 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.448 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.448 05:00:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.448 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.448 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.708 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.708 05:00:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.708 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.708 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.708 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.708 05:00:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.708 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.708 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.708 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.708 05:00:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.708 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.708 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.708 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.708 05:00:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.708 05:00:35 -- setup/common.sh@33 -- # echo 0 00:04:33.708 05:00:35 -- setup/common.sh@33 -- # return 0 00:04:33.708 05:00:35 -- setup/hugepages.sh@99 -- # surp=0 00:04:33.708 05:00:35 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:33.708 05:00:35 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:33.708 05:00:35 -- setup/common.sh@18 -- # local node= 00:04:33.708 05:00:35 -- setup/common.sh@19 -- # local var val 00:04:33.708 05:00:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:33.708 05:00:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:33.708 05:00:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:33.708 05:00:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:33.708 05:00:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:33.708 05:00:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:33.708 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.708 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42604716 kB' 'MemAvailable: 46384032 kB' 'Buffers: 2708 kB' 'Cached: 13259716 kB' 'SwapCached: 0 kB' 'Active: 9994768 kB' 'Inactive: 3766524 kB' 'Active(anon): 9592996 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502220 kB' 'Mapped: 188308 kB' 'Shmem: 9094128 kB' 'KReclaimable: 209684 kB' 'Slab: 780296 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 570612 kB' 'KernelStack: 12800 kB' 'PageTables: 8148 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10669356 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198796 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.709 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.709 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.710 05:00:35 -- setup/common.sh@33 -- # echo 0 00:04:33.710 05:00:35 -- setup/common.sh@33 -- # return 0 00:04:33.710 05:00:35 -- setup/hugepages.sh@100 -- # resv=0 00:04:33.710 05:00:35 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:33.710 nr_hugepages=1024 00:04:33.710 05:00:35 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:33.710 resv_hugepages=0 00:04:33.710 05:00:35 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:33.710 surplus_hugepages=0 00:04:33.710 05:00:35 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:33.710 anon_hugepages=0 00:04:33.710 05:00:35 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:33.710 05:00:35 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:33.710 05:00:35 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:33.710 05:00:35 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:33.710 05:00:35 -- setup/common.sh@18 -- # local node= 00:04:33.710 05:00:35 -- setup/common.sh@19 -- # local var val 00:04:33.710 05:00:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:33.710 05:00:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:33.710 05:00:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:33.710 05:00:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:33.710 05:00:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:33.710 05:00:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42601552 kB' 'MemAvailable: 46380868 kB' 'Buffers: 2708 kB' 'Cached: 13259736 kB' 'SwapCached: 0 kB' 'Active: 9998208 kB' 'Inactive: 3766524 kB' 'Active(anon): 9596436 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505644 kB' 'Mapped: 188308 kB' 'Shmem: 9094148 kB' 'KReclaimable: 209684 kB' 'Slab: 780296 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 570612 kB' 'KernelStack: 12784 kB' 'PageTables: 8100 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10672672 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198796 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.710 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.710 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.711 05:00:35 -- setup/common.sh@33 -- # echo 1024 00:04:33.711 05:00:35 -- setup/common.sh@33 -- # return 0 00:04:33.711 05:00:35 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:33.711 05:00:35 -- setup/hugepages.sh@112 -- # get_nodes 00:04:33.711 05:00:35 -- setup/hugepages.sh@27 -- # local node 00:04:33.711 05:00:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:33.711 05:00:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:33.711 05:00:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:33.711 05:00:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:33.711 05:00:35 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:33.711 05:00:35 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:33.711 05:00:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:33.711 05:00:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:33.711 05:00:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:33.711 05:00:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:33.711 05:00:35 -- setup/common.sh@18 -- # local node=0 00:04:33.711 05:00:35 -- setup/common.sh@19 -- # local var val 00:04:33.711 05:00:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:33.711 05:00:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:33.711 05:00:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:33.711 05:00:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:33.711 05:00:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:33.711 05:00:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.711 05:00:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 26623884 kB' 'MemUsed: 6251040 kB' 'SwapCached: 0 kB' 'Active: 2632936 kB' 'Inactive: 226608 kB' 'Active(anon): 2459712 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226608 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2723184 kB' 'Mapped: 67336 kB' 'AnonPages: 139552 kB' 'Shmem: 2323352 kB' 'KernelStack: 6104 kB' 'PageTables: 3416 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84780 kB' 'Slab: 401900 kB' 'SReclaimable: 84780 kB' 'SUnreclaim: 317120 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.711 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.711 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # continue 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.712 05:00:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.712 05:00:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.712 05:00:35 -- setup/common.sh@33 -- # echo 0 00:04:33.712 05:00:35 -- setup/common.sh@33 -- # return 0 00:04:33.712 05:00:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:33.712 05:00:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:33.712 05:00:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:33.712 05:00:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:33.712 05:00:35 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:33.712 node0=1024 expecting 1024 00:04:33.712 05:00:35 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:33.712 00:04:33.712 real 0m2.555s 00:04:33.712 user 0m0.689s 00:04:33.712 sys 0m0.945s 00:04:33.712 05:00:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.712 05:00:35 -- common/autotest_common.sh@10 -- # set +x 00:04:33.712 ************************************ 00:04:33.712 END TEST default_setup 00:04:33.712 ************************************ 00:04:33.712 05:00:35 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:33.712 05:00:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.712 05:00:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.712 05:00:35 -- common/autotest_common.sh@10 -- # set +x 00:04:33.712 ************************************ 00:04:33.712 START TEST per_node_1G_alloc 00:04:33.712 ************************************ 00:04:33.712 05:00:35 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:33.713 05:00:35 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:33.713 05:00:35 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:33.713 05:00:35 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:33.713 05:00:35 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:33.713 05:00:35 -- setup/hugepages.sh@51 -- # shift 00:04:33.713 05:00:35 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:33.713 05:00:35 -- setup/hugepages.sh@52 -- # local node_ids 00:04:33.713 05:00:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:33.713 05:00:35 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:33.713 05:00:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:33.713 05:00:35 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:33.713 05:00:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:33.713 05:00:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:33.713 05:00:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:33.713 05:00:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:33.713 05:00:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:33.713 05:00:35 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:33.713 05:00:35 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:33.713 05:00:35 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:33.713 05:00:35 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:33.713 05:00:35 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:33.713 05:00:35 -- setup/hugepages.sh@73 -- # return 0 00:04:33.713 05:00:35 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:33.713 05:00:35 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:33.713 05:00:35 -- setup/hugepages.sh@146 -- # setup output 00:04:33.713 05:00:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:33.713 05:00:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:34.652 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:34.652 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:34.652 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:34.652 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:34.652 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:34.652 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:34.652 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:34.652 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:34.652 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:34.652 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:34.652 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:34.652 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:34.652 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:34.652 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:34.652 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:34.652 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:34.652 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:34.917 05:00:36 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:34.917 05:00:36 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:34.917 05:00:36 -- setup/hugepages.sh@89 -- # local node 00:04:34.917 05:00:36 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:34.917 05:00:36 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:34.917 05:00:36 -- setup/hugepages.sh@92 -- # local surp 00:04:34.917 05:00:36 -- setup/hugepages.sh@93 -- # local resv 00:04:34.917 05:00:36 -- setup/hugepages.sh@94 -- # local anon 00:04:34.917 05:00:36 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:34.917 05:00:36 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:34.917 05:00:36 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:34.917 05:00:36 -- setup/common.sh@18 -- # local node= 00:04:34.917 05:00:36 -- setup/common.sh@19 -- # local var val 00:04:34.917 05:00:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.917 05:00:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.917 05:00:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:34.917 05:00:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:34.917 05:00:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.917 05:00:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42609528 kB' 'MemAvailable: 46388844 kB' 'Buffers: 2708 kB' 'Cached: 13259784 kB' 'SwapCached: 0 kB' 'Active: 9994388 kB' 'Inactive: 3766524 kB' 'Active(anon): 9592616 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501632 kB' 'Mapped: 187912 kB' 'Shmem: 9094196 kB' 'KReclaimable: 209684 kB' 'Slab: 780616 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 570932 kB' 'KernelStack: 12832 kB' 'PageTables: 7884 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10667656 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198796 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.917 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.917 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.918 05:00:36 -- setup/common.sh@33 -- # echo 0 00:04:34.918 05:00:36 -- setup/common.sh@33 -- # return 0 00:04:34.918 05:00:36 -- setup/hugepages.sh@97 -- # anon=0 00:04:34.918 05:00:36 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:34.918 05:00:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:34.918 05:00:36 -- setup/common.sh@18 -- # local node= 00:04:34.918 05:00:36 -- setup/common.sh@19 -- # local var val 00:04:34.918 05:00:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.918 05:00:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.918 05:00:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:34.918 05:00:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:34.918 05:00:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.918 05:00:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42610552 kB' 'MemAvailable: 46389868 kB' 'Buffers: 2708 kB' 'Cached: 13259784 kB' 'SwapCached: 0 kB' 'Active: 9995520 kB' 'Inactive: 3766524 kB' 'Active(anon): 9593748 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502792 kB' 'Mapped: 187988 kB' 'Shmem: 9094196 kB' 'KReclaimable: 209684 kB' 'Slab: 780680 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 570996 kB' 'KernelStack: 12816 kB' 'PageTables: 7848 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10667668 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198748 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.918 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.918 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.919 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.919 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.920 05:00:36 -- setup/common.sh@33 -- # echo 0 00:04:34.920 05:00:36 -- setup/common.sh@33 -- # return 0 00:04:34.920 05:00:36 -- setup/hugepages.sh@99 -- # surp=0 00:04:34.920 05:00:36 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:34.920 05:00:36 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:34.920 05:00:36 -- setup/common.sh@18 -- # local node= 00:04:34.920 05:00:36 -- setup/common.sh@19 -- # local var val 00:04:34.920 05:00:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.920 05:00:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.920 05:00:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:34.920 05:00:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:34.920 05:00:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.920 05:00:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42610048 kB' 'MemAvailable: 46389364 kB' 'Buffers: 2708 kB' 'Cached: 13259784 kB' 'SwapCached: 0 kB' 'Active: 9994432 kB' 'Inactive: 3766524 kB' 'Active(anon): 9592660 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501704 kB' 'Mapped: 187952 kB' 'Shmem: 9094196 kB' 'KReclaimable: 209684 kB' 'Slab: 780648 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 570964 kB' 'KernelStack: 12832 kB' 'PageTables: 7844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10667684 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198748 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.920 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.920 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.921 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.921 05:00:36 -- setup/common.sh@33 -- # echo 0 00:04:34.921 05:00:36 -- setup/common.sh@33 -- # return 0 00:04:34.921 05:00:36 -- setup/hugepages.sh@100 -- # resv=0 00:04:34.921 05:00:36 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:34.921 nr_hugepages=1024 00:04:34.921 05:00:36 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:34.921 resv_hugepages=0 00:04:34.921 05:00:36 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:34.921 surplus_hugepages=0 00:04:34.921 05:00:36 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:34.921 anon_hugepages=0 00:04:34.921 05:00:36 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:34.921 05:00:36 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:34.921 05:00:36 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:34.921 05:00:36 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:34.921 05:00:36 -- setup/common.sh@18 -- # local node= 00:04:34.921 05:00:36 -- setup/common.sh@19 -- # local var val 00:04:34.921 05:00:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.921 05:00:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.921 05:00:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:34.921 05:00:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:34.921 05:00:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.921 05:00:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.921 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42610276 kB' 'MemAvailable: 46389592 kB' 'Buffers: 2708 kB' 'Cached: 13259812 kB' 'SwapCached: 0 kB' 'Active: 9994456 kB' 'Inactive: 3766524 kB' 'Active(anon): 9592684 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501668 kB' 'Mapped: 187876 kB' 'Shmem: 9094224 kB' 'KReclaimable: 209684 kB' 'Slab: 780624 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 570940 kB' 'KernelStack: 12832 kB' 'PageTables: 7836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10667696 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198748 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.922 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.922 05:00:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.923 05:00:36 -- setup/common.sh@33 -- # echo 1024 00:04:34.923 05:00:36 -- setup/common.sh@33 -- # return 0 00:04:34.923 05:00:36 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:34.923 05:00:36 -- setup/hugepages.sh@112 -- # get_nodes 00:04:34.923 05:00:36 -- setup/hugepages.sh@27 -- # local node 00:04:34.923 05:00:36 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:34.923 05:00:36 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:34.923 05:00:36 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:34.923 05:00:36 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:34.923 05:00:36 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:34.923 05:00:36 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:34.923 05:00:36 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:34.923 05:00:36 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:34.923 05:00:36 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:34.923 05:00:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:34.923 05:00:36 -- setup/common.sh@18 -- # local node=0 00:04:34.923 05:00:36 -- setup/common.sh@19 -- # local var val 00:04:34.923 05:00:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.923 05:00:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.923 05:00:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:34.923 05:00:36 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:34.923 05:00:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.923 05:00:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27686200 kB' 'MemUsed: 5188724 kB' 'SwapCached: 0 kB' 'Active: 2633312 kB' 'Inactive: 226608 kB' 'Active(anon): 2460088 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226608 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2723228 kB' 'Mapped: 67164 kB' 'AnonPages: 139820 kB' 'Shmem: 2323396 kB' 'KernelStack: 6136 kB' 'PageTables: 3160 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84780 kB' 'Slab: 402072 kB' 'SReclaimable: 84780 kB' 'SUnreclaim: 317292 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.923 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.923 05:00:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@33 -- # echo 0 00:04:34.924 05:00:36 -- setup/common.sh@33 -- # return 0 00:04:34.924 05:00:36 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:34.924 05:00:36 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:34.924 05:00:36 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:34.924 05:00:36 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:34.924 05:00:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:34.924 05:00:36 -- setup/common.sh@18 -- # local node=1 00:04:34.924 05:00:36 -- setup/common.sh@19 -- # local var val 00:04:34.924 05:00:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.924 05:00:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.924 05:00:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:34.924 05:00:36 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:34.924 05:00:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.924 05:00:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 14929852 kB' 'MemUsed: 12730884 kB' 'SwapCached: 0 kB' 'Active: 7360848 kB' 'Inactive: 3539916 kB' 'Active(anon): 7132300 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3539916 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10539296 kB' 'Mapped: 120712 kB' 'AnonPages: 361548 kB' 'Shmem: 6770832 kB' 'KernelStack: 6696 kB' 'PageTables: 4676 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 124904 kB' 'Slab: 378536 kB' 'SReclaimable: 124904 kB' 'SUnreclaim: 253632 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.924 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.924 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.925 05:00:36 -- setup/common.sh@32 -- # continue 00:04:34.925 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # continue 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # continue 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # continue 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # continue 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # continue 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # continue 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # continue 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # continue 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # continue 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # continue 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.185 05:00:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.185 05:00:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.185 05:00:36 -- setup/common.sh@33 -- # echo 0 00:04:35.185 05:00:36 -- setup/common.sh@33 -- # return 0 00:04:35.185 05:00:36 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:35.185 05:00:36 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:35.185 05:00:36 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:35.185 05:00:36 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:35.185 05:00:36 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:35.185 node0=512 expecting 512 00:04:35.185 05:00:36 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:35.185 05:00:36 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:35.185 05:00:36 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:35.185 05:00:36 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:35.185 node1=512 expecting 512 00:04:35.185 05:00:36 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:35.185 00:04:35.185 real 0m1.378s 00:04:35.185 user 0m0.588s 00:04:35.185 sys 0m0.752s 00:04:35.185 05:00:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:35.185 05:00:36 -- common/autotest_common.sh@10 -- # set +x 00:04:35.185 ************************************ 00:04:35.185 END TEST per_node_1G_alloc 00:04:35.185 ************************************ 00:04:35.185 05:00:36 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:35.185 05:00:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:35.185 05:00:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.186 05:00:36 -- common/autotest_common.sh@10 -- # set +x 00:04:35.186 ************************************ 00:04:35.186 START TEST even_2G_alloc 00:04:35.186 ************************************ 00:04:35.186 05:00:36 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:35.186 05:00:36 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:35.186 05:00:36 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:35.186 05:00:36 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:35.186 05:00:36 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:35.186 05:00:36 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:35.186 05:00:36 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:35.186 05:00:36 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:35.186 05:00:36 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:35.186 05:00:36 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:35.186 05:00:36 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:35.186 05:00:36 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:35.186 05:00:36 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:35.186 05:00:36 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:35.186 05:00:36 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:35.186 05:00:36 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:35.186 05:00:36 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:35.186 05:00:36 -- setup/hugepages.sh@83 -- # : 512 00:04:35.186 05:00:36 -- setup/hugepages.sh@84 -- # : 1 00:04:35.186 05:00:36 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:35.186 05:00:36 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:35.186 05:00:36 -- setup/hugepages.sh@83 -- # : 0 00:04:35.186 05:00:36 -- setup/hugepages.sh@84 -- # : 0 00:04:35.186 05:00:36 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:35.186 05:00:36 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:35.186 05:00:36 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:35.186 05:00:36 -- setup/hugepages.sh@153 -- # setup output 00:04:35.186 05:00:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:35.186 05:00:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:36.126 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:36.126 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:36.126 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:36.126 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:36.126 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:36.126 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:36.126 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:36.126 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:36.126 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:36.126 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:36.126 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:36.126 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:36.126 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:36.126 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:36.126 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:36.126 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:36.126 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:36.389 05:00:38 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:36.389 05:00:38 -- setup/hugepages.sh@89 -- # local node 00:04:36.389 05:00:38 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:36.389 05:00:38 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:36.389 05:00:38 -- setup/hugepages.sh@92 -- # local surp 00:04:36.389 05:00:38 -- setup/hugepages.sh@93 -- # local resv 00:04:36.389 05:00:38 -- setup/hugepages.sh@94 -- # local anon 00:04:36.389 05:00:38 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:36.389 05:00:38 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:36.389 05:00:38 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:36.389 05:00:38 -- setup/common.sh@18 -- # local node= 00:04:36.389 05:00:38 -- setup/common.sh@19 -- # local var val 00:04:36.389 05:00:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:36.389 05:00:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:36.389 05:00:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:36.389 05:00:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:36.389 05:00:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:36.389 05:00:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:36.389 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.389 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.389 05:00:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42613820 kB' 'MemAvailable: 46393136 kB' 'Buffers: 2708 kB' 'Cached: 13259876 kB' 'SwapCached: 0 kB' 'Active: 9994816 kB' 'Inactive: 3766524 kB' 'Active(anon): 9593044 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502036 kB' 'Mapped: 187880 kB' 'Shmem: 9094288 kB' 'KReclaimable: 209684 kB' 'Slab: 780704 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 571020 kB' 'KernelStack: 12848 kB' 'PageTables: 8208 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10667880 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:36.389 05:00:38 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.389 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.389 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.389 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.389 05:00:38 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.389 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.389 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.389 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.390 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.390 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:36.391 05:00:38 -- setup/common.sh@33 -- # echo 0 00:04:36.391 05:00:38 -- setup/common.sh@33 -- # return 0 00:04:36.391 05:00:38 -- setup/hugepages.sh@97 -- # anon=0 00:04:36.391 05:00:38 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:36.391 05:00:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:36.391 05:00:38 -- setup/common.sh@18 -- # local node= 00:04:36.391 05:00:38 -- setup/common.sh@19 -- # local var val 00:04:36.391 05:00:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:36.391 05:00:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:36.391 05:00:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:36.391 05:00:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:36.391 05:00:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:36.391 05:00:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42619668 kB' 'MemAvailable: 46398984 kB' 'Buffers: 2708 kB' 'Cached: 13259880 kB' 'SwapCached: 0 kB' 'Active: 9995136 kB' 'Inactive: 3766524 kB' 'Active(anon): 9593364 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502368 kB' 'Mapped: 187880 kB' 'Shmem: 9094292 kB' 'KReclaimable: 209684 kB' 'Slab: 780704 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 571020 kB' 'KernelStack: 12816 kB' 'PageTables: 8096 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10667892 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198780 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.391 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.391 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.392 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.392 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.393 05:00:38 -- setup/common.sh@33 -- # echo 0 00:04:36.393 05:00:38 -- setup/common.sh@33 -- # return 0 00:04:36.393 05:00:38 -- setup/hugepages.sh@99 -- # surp=0 00:04:36.393 05:00:38 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:36.393 05:00:38 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:36.393 05:00:38 -- setup/common.sh@18 -- # local node= 00:04:36.393 05:00:38 -- setup/common.sh@19 -- # local var val 00:04:36.393 05:00:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:36.393 05:00:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:36.393 05:00:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:36.393 05:00:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:36.393 05:00:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:36.393 05:00:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42619820 kB' 'MemAvailable: 46399136 kB' 'Buffers: 2708 kB' 'Cached: 13259892 kB' 'SwapCached: 0 kB' 'Active: 9994668 kB' 'Inactive: 3766524 kB' 'Active(anon): 9592896 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501812 kB' 'Mapped: 187880 kB' 'Shmem: 9094304 kB' 'KReclaimable: 209684 kB' 'Slab: 780768 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 571084 kB' 'KernelStack: 12848 kB' 'PageTables: 8208 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10667908 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198764 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.393 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.393 05:00:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.394 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.394 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:36.395 05:00:38 -- setup/common.sh@33 -- # echo 0 00:04:36.395 05:00:38 -- setup/common.sh@33 -- # return 0 00:04:36.395 05:00:38 -- setup/hugepages.sh@100 -- # resv=0 00:04:36.395 05:00:38 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:36.395 nr_hugepages=1024 00:04:36.395 05:00:38 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:36.395 resv_hugepages=0 00:04:36.395 05:00:38 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:36.395 surplus_hugepages=0 00:04:36.395 05:00:38 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:36.395 anon_hugepages=0 00:04:36.395 05:00:38 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:36.395 05:00:38 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:36.395 05:00:38 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:36.395 05:00:38 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:36.395 05:00:38 -- setup/common.sh@18 -- # local node= 00:04:36.395 05:00:38 -- setup/common.sh@19 -- # local var val 00:04:36.395 05:00:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:36.395 05:00:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:36.395 05:00:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:36.395 05:00:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:36.395 05:00:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:36.395 05:00:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42620176 kB' 'MemAvailable: 46399492 kB' 'Buffers: 2708 kB' 'Cached: 13259904 kB' 'SwapCached: 0 kB' 'Active: 9994664 kB' 'Inactive: 3766524 kB' 'Active(anon): 9592892 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501816 kB' 'Mapped: 187880 kB' 'Shmem: 9094316 kB' 'KReclaimable: 209684 kB' 'Slab: 780768 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 571084 kB' 'KernelStack: 12848 kB' 'PageTables: 8208 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10667924 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198764 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.395 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.395 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.396 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.396 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:36.397 05:00:38 -- setup/common.sh@33 -- # echo 1024 00:04:36.397 05:00:38 -- setup/common.sh@33 -- # return 0 00:04:36.397 05:00:38 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:36.397 05:00:38 -- setup/hugepages.sh@112 -- # get_nodes 00:04:36.397 05:00:38 -- setup/hugepages.sh@27 -- # local node 00:04:36.397 05:00:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:36.397 05:00:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:36.397 05:00:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:36.397 05:00:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:36.397 05:00:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:36.397 05:00:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:36.397 05:00:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:36.397 05:00:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:36.397 05:00:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:36.397 05:00:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:36.397 05:00:38 -- setup/common.sh@18 -- # local node=0 00:04:36.397 05:00:38 -- setup/common.sh@19 -- # local var val 00:04:36.397 05:00:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:36.397 05:00:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:36.397 05:00:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:36.397 05:00:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:36.397 05:00:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:36.397 05:00:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27684408 kB' 'MemUsed: 5190516 kB' 'SwapCached: 0 kB' 'Active: 2633916 kB' 'Inactive: 226608 kB' 'Active(anon): 2460692 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226608 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2723276 kB' 'Mapped: 67204 kB' 'AnonPages: 140404 kB' 'Shmem: 2323444 kB' 'KernelStack: 6168 kB' 'PageTables: 3568 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84780 kB' 'Slab: 401968 kB' 'SReclaimable: 84780 kB' 'SUnreclaim: 317188 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.397 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.397 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.398 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.398 05:00:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.658 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.658 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.658 05:00:38 -- setup/common.sh@33 -- # echo 0 00:04:36.658 05:00:38 -- setup/common.sh@33 -- # return 0 00:04:36.658 05:00:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:36.658 05:00:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:36.658 05:00:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:36.658 05:00:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:36.658 05:00:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:36.658 05:00:38 -- setup/common.sh@18 -- # local node=1 00:04:36.658 05:00:38 -- setup/common.sh@19 -- # local var val 00:04:36.658 05:00:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:36.658 05:00:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:36.658 05:00:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:36.658 05:00:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:36.659 05:00:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:36.659 05:00:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 14935324 kB' 'MemUsed: 12725412 kB' 'SwapCached: 0 kB' 'Active: 7360760 kB' 'Inactive: 3539916 kB' 'Active(anon): 7132212 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3539916 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10539364 kB' 'Mapped: 120676 kB' 'AnonPages: 361412 kB' 'Shmem: 6770900 kB' 'KernelStack: 6680 kB' 'PageTables: 4640 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 124904 kB' 'Slab: 378800 kB' 'SReclaimable: 124904 kB' 'SUnreclaim: 253896 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.659 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.659 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.660 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.660 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.660 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.660 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.660 05:00:38 -- setup/common.sh@32 -- # continue 00:04:36.660 05:00:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:36.660 05:00:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:36.660 05:00:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:36.660 05:00:38 -- setup/common.sh@33 -- # echo 0 00:04:36.660 05:00:38 -- setup/common.sh@33 -- # return 0 00:04:36.660 05:00:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:36.660 05:00:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:36.660 05:00:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:36.660 05:00:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:36.660 05:00:38 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:36.660 node0=512 expecting 512 00:04:36.660 05:00:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:36.660 05:00:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:36.660 05:00:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:36.660 05:00:38 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:36.660 node1=512 expecting 512 00:04:36.660 05:00:38 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:36.660 00:04:36.660 real 0m1.469s 00:04:36.660 user 0m0.631s 00:04:36.660 sys 0m0.805s 00:04:36.660 05:00:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:36.660 05:00:38 -- common/autotest_common.sh@10 -- # set +x 00:04:36.660 ************************************ 00:04:36.660 END TEST even_2G_alloc 00:04:36.660 ************************************ 00:04:36.660 05:00:38 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:36.660 05:00:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:36.660 05:00:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:36.660 05:00:38 -- common/autotest_common.sh@10 -- # set +x 00:04:36.660 ************************************ 00:04:36.660 START TEST odd_alloc 00:04:36.660 ************************************ 00:04:36.660 05:00:38 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:36.660 05:00:38 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:36.660 05:00:38 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:36.660 05:00:38 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:36.660 05:00:38 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:36.660 05:00:38 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:36.660 05:00:38 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:36.660 05:00:38 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:36.660 05:00:38 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:36.660 05:00:38 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:36.660 05:00:38 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:36.660 05:00:38 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:36.660 05:00:38 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:36.660 05:00:38 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:36.660 05:00:38 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:36.660 05:00:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:36.660 05:00:38 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:36.660 05:00:38 -- setup/hugepages.sh@83 -- # : 513 00:04:36.660 05:00:38 -- setup/hugepages.sh@84 -- # : 1 00:04:36.660 05:00:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:36.660 05:00:38 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:36.660 05:00:38 -- setup/hugepages.sh@83 -- # : 0 00:04:36.660 05:00:38 -- setup/hugepages.sh@84 -- # : 0 00:04:36.660 05:00:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:36.660 05:00:38 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:36.660 05:00:38 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:36.660 05:00:38 -- setup/hugepages.sh@160 -- # setup output 00:04:36.660 05:00:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:36.660 05:00:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:37.599 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:37.599 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:37.599 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:37.599 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:37.599 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:37.599 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:37.599 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:37.599 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:37.599 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:37.599 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:37.599 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:37.599 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:37.599 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:37.861 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:37.861 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:37.861 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:37.861 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:37.861 05:00:39 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:37.861 05:00:39 -- setup/hugepages.sh@89 -- # local node 00:04:37.861 05:00:39 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:37.861 05:00:39 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:37.861 05:00:39 -- setup/hugepages.sh@92 -- # local surp 00:04:37.861 05:00:39 -- setup/hugepages.sh@93 -- # local resv 00:04:37.861 05:00:39 -- setup/hugepages.sh@94 -- # local anon 00:04:37.861 05:00:39 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:37.861 05:00:39 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:37.861 05:00:39 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:37.861 05:00:39 -- setup/common.sh@18 -- # local node= 00:04:37.861 05:00:39 -- setup/common.sh@19 -- # local var val 00:04:37.861 05:00:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:37.861 05:00:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:37.861 05:00:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:37.861 05:00:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:37.861 05:00:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:37.861 05:00:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.861 05:00:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42590156 kB' 'MemAvailable: 46369472 kB' 'Buffers: 2708 kB' 'Cached: 13259968 kB' 'SwapCached: 0 kB' 'Active: 9992832 kB' 'Inactive: 3766524 kB' 'Active(anon): 9591060 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499928 kB' 'Mapped: 186852 kB' 'Shmem: 9094380 kB' 'KReclaimable: 209684 kB' 'Slab: 780580 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 570896 kB' 'KernelStack: 12848 kB' 'PageTables: 8056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 10658668 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.861 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.861 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.862 05:00:39 -- setup/common.sh@33 -- # echo 0 00:04:37.862 05:00:39 -- setup/common.sh@33 -- # return 0 00:04:37.862 05:00:39 -- setup/hugepages.sh@97 -- # anon=0 00:04:37.862 05:00:39 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:37.862 05:00:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:37.862 05:00:39 -- setup/common.sh@18 -- # local node= 00:04:37.862 05:00:39 -- setup/common.sh@19 -- # local var val 00:04:37.862 05:00:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:37.862 05:00:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:37.862 05:00:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:37.862 05:00:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:37.862 05:00:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:37.862 05:00:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42591464 kB' 'MemAvailable: 46370780 kB' 'Buffers: 2708 kB' 'Cached: 13259972 kB' 'SwapCached: 0 kB' 'Active: 9994076 kB' 'Inactive: 3766524 kB' 'Active(anon): 9592304 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501196 kB' 'Mapped: 186936 kB' 'Shmem: 9094384 kB' 'KReclaimable: 209684 kB' 'Slab: 780652 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 570968 kB' 'KernelStack: 12912 kB' 'PageTables: 8268 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 10657396 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198780 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.862 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.862 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.863 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.863 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.864 05:00:39 -- setup/common.sh@33 -- # echo 0 00:04:37.864 05:00:39 -- setup/common.sh@33 -- # return 0 00:04:37.864 05:00:39 -- setup/hugepages.sh@99 -- # surp=0 00:04:37.864 05:00:39 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:37.864 05:00:39 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:37.864 05:00:39 -- setup/common.sh@18 -- # local node= 00:04:37.864 05:00:39 -- setup/common.sh@19 -- # local var val 00:04:37.864 05:00:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:37.864 05:00:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:37.864 05:00:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:37.864 05:00:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:37.864 05:00:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:37.864 05:00:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42591396 kB' 'MemAvailable: 46370712 kB' 'Buffers: 2708 kB' 'Cached: 13259984 kB' 'SwapCached: 0 kB' 'Active: 9994580 kB' 'Inactive: 3766524 kB' 'Active(anon): 9592808 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501712 kB' 'Mapped: 186984 kB' 'Shmem: 9094396 kB' 'KReclaimable: 209684 kB' 'Slab: 780648 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 570964 kB' 'KernelStack: 13056 kB' 'PageTables: 8888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 10657412 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.864 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.864 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.865 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.865 05:00:39 -- setup/common.sh@33 -- # echo 0 00:04:37.865 05:00:39 -- setup/common.sh@33 -- # return 0 00:04:37.865 05:00:39 -- setup/hugepages.sh@100 -- # resv=0 00:04:37.865 05:00:39 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:37.865 nr_hugepages=1025 00:04:37.865 05:00:39 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:37.865 resv_hugepages=0 00:04:37.865 05:00:39 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:37.865 surplus_hugepages=0 00:04:37.865 05:00:39 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:37.865 anon_hugepages=0 00:04:37.865 05:00:39 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:37.865 05:00:39 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:37.865 05:00:39 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:37.865 05:00:39 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:37.865 05:00:39 -- setup/common.sh@18 -- # local node= 00:04:37.865 05:00:39 -- setup/common.sh@19 -- # local var val 00:04:37.865 05:00:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:37.865 05:00:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:37.865 05:00:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:37.865 05:00:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:37.865 05:00:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:37.865 05:00:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.865 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42590532 kB' 'MemAvailable: 46369848 kB' 'Buffers: 2708 kB' 'Cached: 13260000 kB' 'SwapCached: 0 kB' 'Active: 9994292 kB' 'Inactive: 3766524 kB' 'Active(anon): 9592520 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501432 kB' 'Mapped: 186848 kB' 'Shmem: 9094412 kB' 'KReclaimable: 209684 kB' 'Slab: 780640 kB' 'SReclaimable: 209684 kB' 'SUnreclaim: 570956 kB' 'KernelStack: 13120 kB' 'PageTables: 8900 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 10657428 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198908 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.866 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.866 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.867 05:00:39 -- setup/common.sh@33 -- # echo 1025 00:04:37.867 05:00:39 -- setup/common.sh@33 -- # return 0 00:04:37.867 05:00:39 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:37.867 05:00:39 -- setup/hugepages.sh@112 -- # get_nodes 00:04:37.867 05:00:39 -- setup/hugepages.sh@27 -- # local node 00:04:37.867 05:00:39 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:37.867 05:00:39 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:37.867 05:00:39 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:37.867 05:00:39 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:37.867 05:00:39 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:37.867 05:00:39 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:37.867 05:00:39 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:37.867 05:00:39 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:37.867 05:00:39 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:37.867 05:00:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:37.867 05:00:39 -- setup/common.sh@18 -- # local node=0 00:04:37.867 05:00:39 -- setup/common.sh@19 -- # local var val 00:04:37.867 05:00:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:37.867 05:00:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:37.867 05:00:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:37.867 05:00:39 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:37.867 05:00:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:37.867 05:00:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27670240 kB' 'MemUsed: 5204684 kB' 'SwapCached: 0 kB' 'Active: 2632960 kB' 'Inactive: 226608 kB' 'Active(anon): 2459736 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226608 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2723316 kB' 'Mapped: 66468 kB' 'AnonPages: 139440 kB' 'Shmem: 2323484 kB' 'KernelStack: 6152 kB' 'PageTables: 3472 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84780 kB' 'Slab: 402004 kB' 'SReclaimable: 84780 kB' 'SUnreclaim: 317224 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.867 05:00:39 -- setup/common.sh@32 -- # continue 00:04:37.867 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.128 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.128 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@33 -- # echo 0 00:04:38.129 05:00:39 -- setup/common.sh@33 -- # return 0 00:04:38.129 05:00:39 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:38.129 05:00:39 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:38.129 05:00:39 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:38.129 05:00:39 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:38.129 05:00:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:38.129 05:00:39 -- setup/common.sh@18 -- # local node=1 00:04:38.129 05:00:39 -- setup/common.sh@19 -- # local var val 00:04:38.129 05:00:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:38.129 05:00:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:38.129 05:00:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:38.129 05:00:39 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:38.129 05:00:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:38.129 05:00:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 14917336 kB' 'MemUsed: 12743400 kB' 'SwapCached: 0 kB' 'Active: 7361960 kB' 'Inactive: 3539916 kB' 'Active(anon): 7133412 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3539916 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10539400 kB' 'Mapped: 120396 kB' 'AnonPages: 362636 kB' 'Shmem: 6770936 kB' 'KernelStack: 7048 kB' 'PageTables: 5824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 124904 kB' 'Slab: 378636 kB' 'SReclaimable: 124904 kB' 'SUnreclaim: 253732 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.129 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.129 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # continue 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.130 05:00:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.130 05:00:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.130 05:00:39 -- setup/common.sh@33 -- # echo 0 00:04:38.130 05:00:39 -- setup/common.sh@33 -- # return 0 00:04:38.130 05:00:39 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:38.130 05:00:39 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:38.130 05:00:39 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:38.130 05:00:39 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:38.130 05:00:39 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:38.130 node0=512 expecting 513 00:04:38.130 05:00:39 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:38.130 05:00:39 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:38.130 05:00:39 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:38.130 05:00:39 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:38.130 node1=513 expecting 512 00:04:38.130 05:00:39 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:38.130 00:04:38.130 real 0m1.457s 00:04:38.130 user 0m0.583s 00:04:38.130 sys 0m0.837s 00:04:38.130 05:00:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.130 05:00:39 -- common/autotest_common.sh@10 -- # set +x 00:04:38.130 ************************************ 00:04:38.130 END TEST odd_alloc 00:04:38.130 ************************************ 00:04:38.130 05:00:39 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:38.130 05:00:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.130 05:00:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.130 05:00:39 -- common/autotest_common.sh@10 -- # set +x 00:04:38.130 ************************************ 00:04:38.130 START TEST custom_alloc 00:04:38.130 ************************************ 00:04:38.130 05:00:39 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:38.130 05:00:39 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:38.130 05:00:39 -- setup/hugepages.sh@169 -- # local node 00:04:38.130 05:00:39 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:38.130 05:00:39 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:38.130 05:00:39 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:38.130 05:00:39 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:38.130 05:00:39 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:38.130 05:00:39 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:38.130 05:00:39 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:38.130 05:00:39 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:38.130 05:00:39 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:38.130 05:00:39 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:38.130 05:00:39 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:38.130 05:00:39 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:38.130 05:00:39 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:38.130 05:00:39 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:38.130 05:00:39 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:38.130 05:00:39 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:38.130 05:00:39 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:38.130 05:00:39 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:38.130 05:00:39 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:38.130 05:00:39 -- setup/hugepages.sh@83 -- # : 256 00:04:38.130 05:00:39 -- setup/hugepages.sh@84 -- # : 1 00:04:38.130 05:00:39 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:38.130 05:00:39 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:38.130 05:00:39 -- setup/hugepages.sh@83 -- # : 0 00:04:38.130 05:00:39 -- setup/hugepages.sh@84 -- # : 0 00:04:38.131 05:00:39 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:38.131 05:00:39 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:38.131 05:00:39 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:38.131 05:00:39 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:38.131 05:00:39 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:38.131 05:00:39 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:38.131 05:00:39 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:38.131 05:00:39 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:38.131 05:00:39 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:38.131 05:00:39 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:38.131 05:00:39 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:38.131 05:00:39 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:38.131 05:00:39 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:38.131 05:00:39 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:38.131 05:00:39 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:38.131 05:00:39 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:38.131 05:00:39 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:38.131 05:00:39 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:38.131 05:00:39 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:38.131 05:00:39 -- setup/hugepages.sh@78 -- # return 0 00:04:38.131 05:00:39 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:38.131 05:00:39 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:38.131 05:00:39 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:38.131 05:00:39 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:38.131 05:00:39 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:38.131 05:00:39 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:38.131 05:00:39 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:38.131 05:00:39 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:38.131 05:00:39 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:38.131 05:00:39 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:38.131 05:00:39 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:38.131 05:00:39 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:38.131 05:00:39 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:38.131 05:00:39 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:38.131 05:00:39 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:38.131 05:00:39 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:38.131 05:00:39 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:38.131 05:00:39 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:38.131 05:00:39 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:38.131 05:00:39 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:38.131 05:00:39 -- setup/hugepages.sh@78 -- # return 0 00:04:38.131 05:00:39 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:38.131 05:00:39 -- setup/hugepages.sh@187 -- # setup output 00:04:38.131 05:00:39 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:38.131 05:00:39 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:39.071 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:39.071 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:39.071 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:39.071 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:39.071 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:39.071 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:39.071 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:39.071 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:39.071 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:39.071 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:39.071 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:39.071 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:39.071 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:39.071 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:39.071 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:39.071 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:39.071 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:39.338 05:00:40 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:39.338 05:00:40 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:39.338 05:00:40 -- setup/hugepages.sh@89 -- # local node 00:04:39.338 05:00:40 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:39.338 05:00:40 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:39.338 05:00:40 -- setup/hugepages.sh@92 -- # local surp 00:04:39.338 05:00:40 -- setup/hugepages.sh@93 -- # local resv 00:04:39.338 05:00:40 -- setup/hugepages.sh@94 -- # local anon 00:04:39.338 05:00:40 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:39.338 05:00:40 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:39.338 05:00:40 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:39.338 05:00:40 -- setup/common.sh@18 -- # local node= 00:04:39.338 05:00:40 -- setup/common.sh@19 -- # local var val 00:04:39.338 05:00:40 -- setup/common.sh@20 -- # local mem_f mem 00:04:39.338 05:00:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:39.338 05:00:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:39.338 05:00:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:39.338 05:00:40 -- setup/common.sh@28 -- # mapfile -t mem 00:04:39.338 05:00:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.338 05:00:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 41544472 kB' 'MemAvailable: 45323772 kB' 'Buffers: 2708 kB' 'Cached: 13260068 kB' 'SwapCached: 0 kB' 'Active: 9993524 kB' 'Inactive: 3766524 kB' 'Active(anon): 9591752 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500520 kB' 'Mapped: 186984 kB' 'Shmem: 9094480 kB' 'KReclaimable: 209652 kB' 'Slab: 780604 kB' 'SReclaimable: 209652 kB' 'SUnreclaim: 570952 kB' 'KernelStack: 12784 kB' 'PageTables: 7824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 10653576 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198812 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.338 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.338 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.339 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.339 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.340 05:00:40 -- setup/common.sh@33 -- # echo 0 00:04:39.340 05:00:40 -- setup/common.sh@33 -- # return 0 00:04:39.340 05:00:40 -- setup/hugepages.sh@97 -- # anon=0 00:04:39.340 05:00:40 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:39.340 05:00:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:39.340 05:00:40 -- setup/common.sh@18 -- # local node= 00:04:39.340 05:00:40 -- setup/common.sh@19 -- # local var val 00:04:39.340 05:00:40 -- setup/common.sh@20 -- # local mem_f mem 00:04:39.340 05:00:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:39.340 05:00:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:39.340 05:00:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:39.340 05:00:40 -- setup/common.sh@28 -- # mapfile -t mem 00:04:39.340 05:00:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 41545964 kB' 'MemAvailable: 45325264 kB' 'Buffers: 2708 kB' 'Cached: 13260068 kB' 'SwapCached: 0 kB' 'Active: 9993996 kB' 'Inactive: 3766524 kB' 'Active(anon): 9592224 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500976 kB' 'Mapped: 186984 kB' 'Shmem: 9094480 kB' 'KReclaimable: 209652 kB' 'Slab: 780572 kB' 'SReclaimable: 209652 kB' 'SUnreclaim: 570920 kB' 'KernelStack: 12816 kB' 'PageTables: 7912 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 10653588 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198812 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.340 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.340 05:00:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.341 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.341 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.342 05:00:40 -- setup/common.sh@33 -- # echo 0 00:04:39.342 05:00:40 -- setup/common.sh@33 -- # return 0 00:04:39.342 05:00:40 -- setup/hugepages.sh@99 -- # surp=0 00:04:39.342 05:00:40 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:39.342 05:00:40 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:39.342 05:00:40 -- setup/common.sh@18 -- # local node= 00:04:39.342 05:00:40 -- setup/common.sh@19 -- # local var val 00:04:39.342 05:00:40 -- setup/common.sh@20 -- # local mem_f mem 00:04:39.342 05:00:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:39.342 05:00:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:39.342 05:00:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:39.342 05:00:40 -- setup/common.sh@28 -- # mapfile -t mem 00:04:39.342 05:00:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 41546720 kB' 'MemAvailable: 45326020 kB' 'Buffers: 2708 kB' 'Cached: 13260076 kB' 'SwapCached: 0 kB' 'Active: 9995444 kB' 'Inactive: 3766524 kB' 'Active(anon): 9593672 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502416 kB' 'Mapped: 187372 kB' 'Shmem: 9094488 kB' 'KReclaimable: 209652 kB' 'Slab: 780572 kB' 'SReclaimable: 209652 kB' 'SUnreclaim: 570920 kB' 'KernelStack: 12816 kB' 'PageTables: 7804 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 10656280 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.342 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.342 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.343 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.343 05:00:40 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.343 05:00:40 -- setup/common.sh@33 -- # echo 0 00:04:39.343 05:00:40 -- setup/common.sh@33 -- # return 0 00:04:39.343 05:00:40 -- setup/hugepages.sh@100 -- # resv=0 00:04:39.343 05:00:40 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:39.343 nr_hugepages=1536 00:04:39.343 05:00:40 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:39.343 resv_hugepages=0 00:04:39.343 05:00:40 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:39.343 surplus_hugepages=0 00:04:39.343 05:00:40 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:39.343 anon_hugepages=0 00:04:39.343 05:00:40 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:39.343 05:00:40 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:39.344 05:00:40 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:39.344 05:00:40 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:39.344 05:00:40 -- setup/common.sh@18 -- # local node= 00:04:39.344 05:00:40 -- setup/common.sh@19 -- # local var val 00:04:39.344 05:00:40 -- setup/common.sh@20 -- # local mem_f mem 00:04:39.344 05:00:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:39.344 05:00:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:39.344 05:00:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:39.344 05:00:40 -- setup/common.sh@28 -- # mapfile -t mem 00:04:39.344 05:00:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 41547000 kB' 'MemAvailable: 45326300 kB' 'Buffers: 2708 kB' 'Cached: 13260084 kB' 'SwapCached: 0 kB' 'Active: 9998112 kB' 'Inactive: 3766524 kB' 'Active(anon): 9596340 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505100 kB' 'Mapped: 187288 kB' 'Shmem: 9094496 kB' 'KReclaimable: 209652 kB' 'Slab: 780536 kB' 'SReclaimable: 209652 kB' 'SUnreclaim: 570884 kB' 'KernelStack: 12800 kB' 'PageTables: 7740 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 10659740 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198832 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.344 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.344 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.345 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.345 05:00:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.346 05:00:40 -- setup/common.sh@33 -- # echo 1536 00:04:39.346 05:00:40 -- setup/common.sh@33 -- # return 0 00:04:39.346 05:00:40 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:39.346 05:00:40 -- setup/hugepages.sh@112 -- # get_nodes 00:04:39.346 05:00:40 -- setup/hugepages.sh@27 -- # local node 00:04:39.346 05:00:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:39.346 05:00:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:39.346 05:00:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:39.346 05:00:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:39.346 05:00:40 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:39.346 05:00:40 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:39.346 05:00:40 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:39.346 05:00:40 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:39.346 05:00:40 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:39.346 05:00:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:39.346 05:00:40 -- setup/common.sh@18 -- # local node=0 00:04:39.346 05:00:40 -- setup/common.sh@19 -- # local var val 00:04:39.346 05:00:40 -- setup/common.sh@20 -- # local mem_f mem 00:04:39.346 05:00:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:39.346 05:00:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:39.346 05:00:40 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:39.346 05:00:40 -- setup/common.sh@28 -- # mapfile -t mem 00:04:39.346 05:00:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27654872 kB' 'MemUsed: 5220052 kB' 'SwapCached: 0 kB' 'Active: 2634376 kB' 'Inactive: 226608 kB' 'Active(anon): 2461152 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226608 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2723424 kB' 'Mapped: 66624 kB' 'AnonPages: 140840 kB' 'Shmem: 2323592 kB' 'KernelStack: 6184 kB' 'PageTables: 3596 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84780 kB' 'Slab: 401972 kB' 'SReclaimable: 84780 kB' 'SUnreclaim: 317192 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.346 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.346 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@33 -- # echo 0 00:04:39.347 05:00:41 -- setup/common.sh@33 -- # return 0 00:04:39.347 05:00:41 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:39.347 05:00:41 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:39.347 05:00:41 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:39.347 05:00:41 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:39.347 05:00:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:39.347 05:00:41 -- setup/common.sh@18 -- # local node=1 00:04:39.347 05:00:41 -- setup/common.sh@19 -- # local var val 00:04:39.347 05:00:41 -- setup/common.sh@20 -- # local mem_f mem 00:04:39.347 05:00:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:39.347 05:00:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:39.347 05:00:41 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:39.347 05:00:41 -- setup/common.sh@28 -- # mapfile -t mem 00:04:39.347 05:00:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 13891876 kB' 'MemUsed: 13768860 kB' 'SwapCached: 0 kB' 'Active: 7359336 kB' 'Inactive: 3539916 kB' 'Active(anon): 7130788 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3539916 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10539396 kB' 'Mapped: 120816 kB' 'AnonPages: 359888 kB' 'Shmem: 6770932 kB' 'KernelStack: 6664 kB' 'PageTables: 4308 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 124872 kB' 'Slab: 378564 kB' 'SReclaimable: 124872 kB' 'SUnreclaim: 253692 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.347 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.347 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.348 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.348 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.349 05:00:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.349 05:00:41 -- setup/common.sh@32 -- # continue 00:04:39.349 05:00:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.349 05:00:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.349 05:00:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.349 05:00:41 -- setup/common.sh@33 -- # echo 0 00:04:39.349 05:00:41 -- setup/common.sh@33 -- # return 0 00:04:39.349 05:00:41 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:39.349 05:00:41 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:39.349 05:00:41 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:39.349 05:00:41 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:39.349 05:00:41 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:39.349 node0=512 expecting 512 00:04:39.349 05:00:41 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:39.349 05:00:41 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:39.349 05:00:41 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:39.349 05:00:41 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:39.349 node1=1024 expecting 1024 00:04:39.349 05:00:41 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:39.349 00:04:39.349 real 0m1.350s 00:04:39.349 user 0m0.586s 00:04:39.349 sys 0m0.727s 00:04:39.349 05:00:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:39.349 05:00:41 -- common/autotest_common.sh@10 -- # set +x 00:04:39.349 ************************************ 00:04:39.349 END TEST custom_alloc 00:04:39.349 ************************************ 00:04:39.349 05:00:41 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:39.349 05:00:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:39.349 05:00:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:39.349 05:00:41 -- common/autotest_common.sh@10 -- # set +x 00:04:39.349 ************************************ 00:04:39.349 START TEST no_shrink_alloc 00:04:39.349 ************************************ 00:04:39.349 05:00:41 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:39.349 05:00:41 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:39.349 05:00:41 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:39.349 05:00:41 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:39.349 05:00:41 -- setup/hugepages.sh@51 -- # shift 00:04:39.349 05:00:41 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:39.349 05:00:41 -- setup/hugepages.sh@52 -- # local node_ids 00:04:39.349 05:00:41 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:39.349 05:00:41 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:39.349 05:00:41 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:39.349 05:00:41 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:39.349 05:00:41 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:39.349 05:00:41 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:39.349 05:00:41 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:39.349 05:00:41 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:39.349 05:00:41 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:39.349 05:00:41 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:39.349 05:00:41 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:39.349 05:00:41 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:39.349 05:00:41 -- setup/hugepages.sh@73 -- # return 0 00:04:39.349 05:00:41 -- setup/hugepages.sh@198 -- # setup output 00:04:39.349 05:00:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:39.349 05:00:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:40.734 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:40.734 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:40.734 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:40.734 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:40.734 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:40.734 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:40.734 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:40.734 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:40.734 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:40.734 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:40.734 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:40.734 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:40.734 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:40.734 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:40.734 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:40.734 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:40.734 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:40.734 05:00:42 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:40.734 05:00:42 -- setup/hugepages.sh@89 -- # local node 00:04:40.734 05:00:42 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:40.734 05:00:42 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:40.734 05:00:42 -- setup/hugepages.sh@92 -- # local surp 00:04:40.734 05:00:42 -- setup/hugepages.sh@93 -- # local resv 00:04:40.734 05:00:42 -- setup/hugepages.sh@94 -- # local anon 00:04:40.734 05:00:42 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:40.734 05:00:42 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:40.734 05:00:42 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:40.734 05:00:42 -- setup/common.sh@18 -- # local node= 00:04:40.734 05:00:42 -- setup/common.sh@19 -- # local var val 00:04:40.734 05:00:42 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.734 05:00:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.734 05:00:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.734 05:00:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.734 05:00:42 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.734 05:00:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.734 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.734 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.734 05:00:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42567832 kB' 'MemAvailable: 46347132 kB' 'Buffers: 2708 kB' 'Cached: 13260156 kB' 'SwapCached: 0 kB' 'Active: 9992764 kB' 'Inactive: 3766524 kB' 'Active(anon): 9590992 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499656 kB' 'Mapped: 186868 kB' 'Shmem: 9094568 kB' 'KReclaimable: 209652 kB' 'Slab: 780192 kB' 'SReclaimable: 209652 kB' 'SUnreclaim: 570540 kB' 'KernelStack: 12848 kB' 'PageTables: 7836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10653668 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198876 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:40.734 05:00:42 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.734 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.734 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.734 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.734 05:00:42 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.735 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.735 05:00:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.735 05:00:42 -- setup/common.sh@33 -- # echo 0 00:04:40.735 05:00:42 -- setup/common.sh@33 -- # return 0 00:04:40.735 05:00:42 -- setup/hugepages.sh@97 -- # anon=0 00:04:40.735 05:00:42 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:40.735 05:00:42 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:40.735 05:00:42 -- setup/common.sh@18 -- # local node= 00:04:40.735 05:00:42 -- setup/common.sh@19 -- # local var val 00:04:40.735 05:00:42 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.735 05:00:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.736 05:00:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.736 05:00:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.736 05:00:42 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.736 05:00:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42567976 kB' 'MemAvailable: 46347276 kB' 'Buffers: 2708 kB' 'Cached: 13260160 kB' 'SwapCached: 0 kB' 'Active: 9993092 kB' 'Inactive: 3766524 kB' 'Active(anon): 9591320 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500024 kB' 'Mapped: 186868 kB' 'Shmem: 9094572 kB' 'KReclaimable: 209652 kB' 'Slab: 780184 kB' 'SReclaimable: 209652 kB' 'SUnreclaim: 570532 kB' 'KernelStack: 12832 kB' 'PageTables: 7772 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10653676 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198844 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.736 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.736 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.737 05:00:42 -- setup/common.sh@33 -- # echo 0 00:04:40.737 05:00:42 -- setup/common.sh@33 -- # return 0 00:04:40.737 05:00:42 -- setup/hugepages.sh@99 -- # surp=0 00:04:40.737 05:00:42 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:40.737 05:00:42 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:40.737 05:00:42 -- setup/common.sh@18 -- # local node= 00:04:40.737 05:00:42 -- setup/common.sh@19 -- # local var val 00:04:40.737 05:00:42 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.737 05:00:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.737 05:00:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.737 05:00:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.737 05:00:42 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.737 05:00:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42567584 kB' 'MemAvailable: 46346884 kB' 'Buffers: 2708 kB' 'Cached: 13260172 kB' 'SwapCached: 0 kB' 'Active: 9993092 kB' 'Inactive: 3766524 kB' 'Active(anon): 9591320 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499992 kB' 'Mapped: 186860 kB' 'Shmem: 9094584 kB' 'KReclaimable: 209652 kB' 'Slab: 780208 kB' 'SReclaimable: 209652 kB' 'SUnreclaim: 570556 kB' 'KernelStack: 12864 kB' 'PageTables: 7872 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10653692 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198860 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.737 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.737 05:00:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.738 05:00:42 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.738 05:00:42 -- setup/common.sh@33 -- # echo 0 00:04:40.738 05:00:42 -- setup/common.sh@33 -- # return 0 00:04:40.738 05:00:42 -- setup/hugepages.sh@100 -- # resv=0 00:04:40.738 05:00:42 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:40.738 nr_hugepages=1024 00:04:40.738 05:00:42 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:40.738 resv_hugepages=0 00:04:40.738 05:00:42 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:40.738 surplus_hugepages=0 00:04:40.738 05:00:42 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:40.738 anon_hugepages=0 00:04:40.738 05:00:42 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:40.738 05:00:42 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:40.738 05:00:42 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:40.738 05:00:42 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:40.738 05:00:42 -- setup/common.sh@18 -- # local node= 00:04:40.738 05:00:42 -- setup/common.sh@19 -- # local var val 00:04:40.738 05:00:42 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.738 05:00:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.738 05:00:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.738 05:00:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.738 05:00:42 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.738 05:00:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.738 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42567584 kB' 'MemAvailable: 46346884 kB' 'Buffers: 2708 kB' 'Cached: 13260188 kB' 'SwapCached: 0 kB' 'Active: 9993064 kB' 'Inactive: 3766524 kB' 'Active(anon): 9591292 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499956 kB' 'Mapped: 186860 kB' 'Shmem: 9094600 kB' 'KReclaimable: 209652 kB' 'Slab: 780208 kB' 'SReclaimable: 209652 kB' 'SUnreclaim: 570556 kB' 'KernelStack: 12848 kB' 'PageTables: 7824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10653708 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198860 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.739 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.739 05:00:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.740 05:00:42 -- setup/common.sh@33 -- # echo 1024 00:04:40.740 05:00:42 -- setup/common.sh@33 -- # return 0 00:04:40.740 05:00:42 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:40.740 05:00:42 -- setup/hugepages.sh@112 -- # get_nodes 00:04:40.740 05:00:42 -- setup/hugepages.sh@27 -- # local node 00:04:40.740 05:00:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:40.740 05:00:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:40.740 05:00:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:40.740 05:00:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:40.740 05:00:42 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:40.740 05:00:42 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:40.740 05:00:42 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:40.740 05:00:42 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:40.740 05:00:42 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:40.740 05:00:42 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:40.740 05:00:42 -- setup/common.sh@18 -- # local node=0 00:04:40.740 05:00:42 -- setup/common.sh@19 -- # local var val 00:04:40.740 05:00:42 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.740 05:00:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.740 05:00:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:40.740 05:00:42 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:40.740 05:00:42 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.740 05:00:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 26597888 kB' 'MemUsed: 6277036 kB' 'SwapCached: 0 kB' 'Active: 2633160 kB' 'Inactive: 226608 kB' 'Active(anon): 2459936 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226608 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2723508 kB' 'Mapped: 66480 kB' 'AnonPages: 139412 kB' 'Shmem: 2323676 kB' 'KernelStack: 6168 kB' 'PageTables: 3428 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84780 kB' 'Slab: 401760 kB' 'SReclaimable: 84780 kB' 'SUnreclaim: 316980 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.740 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.740 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.741 05:00:42 -- setup/common.sh@32 -- # continue 00:04:40.741 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # continue 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # continue 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # continue 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # continue 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # continue 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # continue 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # continue 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # continue 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # continue 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # continue 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # continue 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # continue 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # continue 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.000 05:00:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.000 05:00:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.000 05:00:42 -- setup/common.sh@33 -- # echo 0 00:04:41.000 05:00:42 -- setup/common.sh@33 -- # return 0 00:04:41.000 05:00:42 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:41.000 05:00:42 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:41.000 05:00:42 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:41.000 05:00:42 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:41.000 05:00:42 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:41.000 node0=1024 expecting 1024 00:04:41.000 05:00:42 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:41.000 05:00:42 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:41.000 05:00:42 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:41.000 05:00:42 -- setup/hugepages.sh@202 -- # setup output 00:04:41.000 05:00:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:41.000 05:00:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:41.936 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:41.937 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:41.937 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:41.937 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:41.937 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:41.937 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:41.937 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:41.937 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:41.937 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:41.937 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:41.937 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:41.937 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:41.937 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:41.937 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:41.937 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:41.937 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:41.937 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:41.937 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:42.199 05:00:43 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:42.199 05:00:43 -- setup/hugepages.sh@89 -- # local node 00:04:42.199 05:00:43 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:42.199 05:00:43 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:42.199 05:00:43 -- setup/hugepages.sh@92 -- # local surp 00:04:42.199 05:00:43 -- setup/hugepages.sh@93 -- # local resv 00:04:42.199 05:00:43 -- setup/hugepages.sh@94 -- # local anon 00:04:42.199 05:00:43 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:42.199 05:00:43 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:42.199 05:00:43 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:42.199 05:00:43 -- setup/common.sh@18 -- # local node= 00:04:42.199 05:00:43 -- setup/common.sh@19 -- # local var val 00:04:42.199 05:00:43 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.199 05:00:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.199 05:00:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.199 05:00:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.199 05:00:43 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.199 05:00:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.199 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.199 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42558040 kB' 'MemAvailable: 46337340 kB' 'Buffers: 2708 kB' 'Cached: 13260232 kB' 'SwapCached: 0 kB' 'Active: 9993348 kB' 'Inactive: 3766524 kB' 'Active(anon): 9591576 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500140 kB' 'Mapped: 186908 kB' 'Shmem: 9094644 kB' 'KReclaimable: 209652 kB' 'Slab: 780280 kB' 'SReclaimable: 209652 kB' 'SUnreclaim: 570628 kB' 'KernelStack: 12832 kB' 'PageTables: 7784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10653876 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198924 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.200 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.200 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.201 05:00:43 -- setup/common.sh@33 -- # echo 0 00:04:42.201 05:00:43 -- setup/common.sh@33 -- # return 0 00:04:42.201 05:00:43 -- setup/hugepages.sh@97 -- # anon=0 00:04:42.201 05:00:43 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:42.201 05:00:43 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:42.201 05:00:43 -- setup/common.sh@18 -- # local node= 00:04:42.201 05:00:43 -- setup/common.sh@19 -- # local var val 00:04:42.201 05:00:43 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.201 05:00:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.201 05:00:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.201 05:00:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.201 05:00:43 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.201 05:00:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42559092 kB' 'MemAvailable: 46338392 kB' 'Buffers: 2708 kB' 'Cached: 13260236 kB' 'SwapCached: 0 kB' 'Active: 9993964 kB' 'Inactive: 3766524 kB' 'Active(anon): 9592192 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500816 kB' 'Mapped: 186984 kB' 'Shmem: 9094648 kB' 'KReclaimable: 209652 kB' 'Slab: 780328 kB' 'SReclaimable: 209652 kB' 'SUnreclaim: 570676 kB' 'KernelStack: 12848 kB' 'PageTables: 7844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10653888 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198908 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.201 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.201 05:00:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.202 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.202 05:00:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.203 05:00:43 -- setup/common.sh@33 -- # echo 0 00:04:42.203 05:00:43 -- setup/common.sh@33 -- # return 0 00:04:42.203 05:00:43 -- setup/hugepages.sh@99 -- # surp=0 00:04:42.203 05:00:43 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:42.203 05:00:43 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:42.203 05:00:43 -- setup/common.sh@18 -- # local node= 00:04:42.203 05:00:43 -- setup/common.sh@19 -- # local var val 00:04:42.203 05:00:43 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.203 05:00:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.203 05:00:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.203 05:00:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.203 05:00:43 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.203 05:00:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42559620 kB' 'MemAvailable: 46338920 kB' 'Buffers: 2708 kB' 'Cached: 13260244 kB' 'SwapCached: 0 kB' 'Active: 9993008 kB' 'Inactive: 3766524 kB' 'Active(anon): 9591236 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499776 kB' 'Mapped: 186872 kB' 'Shmem: 9094656 kB' 'KReclaimable: 209652 kB' 'Slab: 780312 kB' 'SReclaimable: 209652 kB' 'SUnreclaim: 570660 kB' 'KernelStack: 12848 kB' 'PageTables: 7824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10653900 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198924 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.203 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.203 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.204 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.204 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.205 05:00:43 -- setup/common.sh@33 -- # echo 0 00:04:42.205 05:00:43 -- setup/common.sh@33 -- # return 0 00:04:42.205 05:00:43 -- setup/hugepages.sh@100 -- # resv=0 00:04:42.205 05:00:43 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:42.205 nr_hugepages=1024 00:04:42.205 05:00:43 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:42.205 resv_hugepages=0 00:04:42.205 05:00:43 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:42.205 surplus_hugepages=0 00:04:42.205 05:00:43 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:42.205 anon_hugepages=0 00:04:42.205 05:00:43 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:42.205 05:00:43 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:42.205 05:00:43 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:42.205 05:00:43 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:42.205 05:00:43 -- setup/common.sh@18 -- # local node= 00:04:42.205 05:00:43 -- setup/common.sh@19 -- # local var val 00:04:42.205 05:00:43 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.205 05:00:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.205 05:00:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.205 05:00:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.205 05:00:43 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.205 05:00:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42559620 kB' 'MemAvailable: 46338920 kB' 'Buffers: 2708 kB' 'Cached: 13260264 kB' 'SwapCached: 0 kB' 'Active: 9993236 kB' 'Inactive: 3766524 kB' 'Active(anon): 9591464 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500000 kB' 'Mapped: 186872 kB' 'Shmem: 9094676 kB' 'KReclaimable: 209652 kB' 'Slab: 780312 kB' 'SReclaimable: 209652 kB' 'SUnreclaim: 570660 kB' 'KernelStack: 12848 kB' 'PageTables: 7828 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10653916 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198940 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.205 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.205 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.206 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.206 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.207 05:00:43 -- setup/common.sh@33 -- # echo 1024 00:04:42.207 05:00:43 -- setup/common.sh@33 -- # return 0 00:04:42.207 05:00:43 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:42.207 05:00:43 -- setup/hugepages.sh@112 -- # get_nodes 00:04:42.207 05:00:43 -- setup/hugepages.sh@27 -- # local node 00:04:42.207 05:00:43 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:42.207 05:00:43 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:42.207 05:00:43 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:42.207 05:00:43 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:42.207 05:00:43 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:42.207 05:00:43 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:42.207 05:00:43 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:42.207 05:00:43 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:42.207 05:00:43 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:42.207 05:00:43 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:42.207 05:00:43 -- setup/common.sh@18 -- # local node=0 00:04:42.207 05:00:43 -- setup/common.sh@19 -- # local var val 00:04:42.207 05:00:43 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.207 05:00:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.207 05:00:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:42.207 05:00:43 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:42.207 05:00:43 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.207 05:00:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 26598948 kB' 'MemUsed: 6275976 kB' 'SwapCached: 0 kB' 'Active: 2633072 kB' 'Inactive: 226608 kB' 'Active(anon): 2459848 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226608 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2723564 kB' 'Mapped: 66484 kB' 'AnonPages: 139240 kB' 'Shmem: 2323732 kB' 'KernelStack: 6136 kB' 'PageTables: 3380 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84780 kB' 'Slab: 401912 kB' 'SReclaimable: 84780 kB' 'SUnreclaim: 317132 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.207 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.207 05:00:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # continue 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.208 05:00:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.208 05:00:43 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.208 05:00:43 -- setup/common.sh@33 -- # echo 0 00:04:42.208 05:00:43 -- setup/common.sh@33 -- # return 0 00:04:42.208 05:00:43 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:42.208 05:00:43 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:42.208 05:00:43 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:42.208 05:00:43 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:42.208 05:00:43 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:42.208 node0=1024 expecting 1024 00:04:42.208 05:00:43 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:42.208 00:04:42.208 real 0m2.760s 00:04:42.208 user 0m1.130s 00:04:42.208 sys 0m1.552s 00:04:42.208 05:00:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.208 05:00:43 -- common/autotest_common.sh@10 -- # set +x 00:04:42.208 ************************************ 00:04:42.208 END TEST no_shrink_alloc 00:04:42.208 ************************************ 00:04:42.208 05:00:43 -- setup/hugepages.sh@217 -- # clear_hp 00:04:42.208 05:00:43 -- setup/hugepages.sh@37 -- # local node hp 00:04:42.208 05:00:43 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:42.208 05:00:43 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:42.208 05:00:43 -- setup/hugepages.sh@41 -- # echo 0 00:04:42.208 05:00:43 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:42.208 05:00:43 -- setup/hugepages.sh@41 -- # echo 0 00:04:42.208 05:00:43 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:42.208 05:00:43 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:42.208 05:00:43 -- setup/hugepages.sh@41 -- # echo 0 00:04:42.208 05:00:43 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:42.208 05:00:43 -- setup/hugepages.sh@41 -- # echo 0 00:04:42.208 05:00:43 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:42.208 05:00:43 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:42.208 00:04:42.208 real 0m11.322s 00:04:42.208 user 0m4.383s 00:04:42.208 sys 0m5.830s 00:04:42.208 05:00:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.208 05:00:43 -- common/autotest_common.sh@10 -- # set +x 00:04:42.208 ************************************ 00:04:42.208 END TEST hugepages 00:04:42.208 ************************************ 00:04:42.208 05:00:43 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:42.208 05:00:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.208 05:00:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.208 05:00:43 -- common/autotest_common.sh@10 -- # set +x 00:04:42.208 ************************************ 00:04:42.208 START TEST driver 00:04:42.208 ************************************ 00:04:42.208 05:00:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:42.208 * Looking for test storage... 00:04:42.208 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:42.208 05:00:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:42.208 05:00:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:42.208 05:00:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:42.469 05:00:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:42.469 05:00:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:42.469 05:00:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:42.469 05:00:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:42.469 05:00:43 -- scripts/common.sh@335 -- # IFS=.-: 00:04:42.469 05:00:43 -- scripts/common.sh@335 -- # read -ra ver1 00:04:42.469 05:00:43 -- scripts/common.sh@336 -- # IFS=.-: 00:04:42.469 05:00:43 -- scripts/common.sh@336 -- # read -ra ver2 00:04:42.469 05:00:44 -- scripts/common.sh@337 -- # local 'op=<' 00:04:42.469 05:00:44 -- scripts/common.sh@339 -- # ver1_l=2 00:04:42.469 05:00:44 -- scripts/common.sh@340 -- # ver2_l=1 00:04:42.469 05:00:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:42.469 05:00:44 -- scripts/common.sh@343 -- # case "$op" in 00:04:42.469 05:00:44 -- scripts/common.sh@344 -- # : 1 00:04:42.469 05:00:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:42.469 05:00:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:42.469 05:00:44 -- scripts/common.sh@364 -- # decimal 1 00:04:42.469 05:00:44 -- scripts/common.sh@352 -- # local d=1 00:04:42.469 05:00:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:42.469 05:00:44 -- scripts/common.sh@354 -- # echo 1 00:04:42.469 05:00:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:42.469 05:00:44 -- scripts/common.sh@365 -- # decimal 2 00:04:42.469 05:00:44 -- scripts/common.sh@352 -- # local d=2 00:04:42.469 05:00:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:42.469 05:00:44 -- scripts/common.sh@354 -- # echo 2 00:04:42.469 05:00:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:42.469 05:00:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:42.469 05:00:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:42.469 05:00:44 -- scripts/common.sh@367 -- # return 0 00:04:42.469 05:00:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:42.469 05:00:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:42.469 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.469 --rc genhtml_branch_coverage=1 00:04:42.469 --rc genhtml_function_coverage=1 00:04:42.469 --rc genhtml_legend=1 00:04:42.469 --rc geninfo_all_blocks=1 00:04:42.469 --rc geninfo_unexecuted_blocks=1 00:04:42.469 00:04:42.469 ' 00:04:42.469 05:00:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:42.469 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.469 --rc genhtml_branch_coverage=1 00:04:42.469 --rc genhtml_function_coverage=1 00:04:42.469 --rc genhtml_legend=1 00:04:42.469 --rc geninfo_all_blocks=1 00:04:42.469 --rc geninfo_unexecuted_blocks=1 00:04:42.469 00:04:42.469 ' 00:04:42.469 05:00:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:42.469 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.469 --rc genhtml_branch_coverage=1 00:04:42.469 --rc genhtml_function_coverage=1 00:04:42.469 --rc genhtml_legend=1 00:04:42.469 --rc geninfo_all_blocks=1 00:04:42.469 --rc geninfo_unexecuted_blocks=1 00:04:42.469 00:04:42.469 ' 00:04:42.469 05:00:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:42.469 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.469 --rc genhtml_branch_coverage=1 00:04:42.469 --rc genhtml_function_coverage=1 00:04:42.469 --rc genhtml_legend=1 00:04:42.469 --rc geninfo_all_blocks=1 00:04:42.469 --rc geninfo_unexecuted_blocks=1 00:04:42.469 00:04:42.469 ' 00:04:42.469 05:00:44 -- setup/driver.sh@68 -- # setup reset 00:04:42.469 05:00:44 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:42.469 05:00:44 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:45.011 05:00:46 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:45.011 05:00:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.011 05:00:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.011 05:00:46 -- common/autotest_common.sh@10 -- # set +x 00:04:45.011 ************************************ 00:04:45.011 START TEST guess_driver 00:04:45.011 ************************************ 00:04:45.011 05:00:46 -- common/autotest_common.sh@1114 -- # guess_driver 00:04:45.011 05:00:46 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:45.011 05:00:46 -- setup/driver.sh@47 -- # local fail=0 00:04:45.011 05:00:46 -- setup/driver.sh@49 -- # pick_driver 00:04:45.011 05:00:46 -- setup/driver.sh@36 -- # vfio 00:04:45.011 05:00:46 -- setup/driver.sh@21 -- # local iommu_grups 00:04:45.011 05:00:46 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:45.011 05:00:46 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:45.011 05:00:46 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:45.011 05:00:46 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:45.011 05:00:46 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:45.011 05:00:46 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:45.011 05:00:46 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:45.011 05:00:46 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:45.011 05:00:46 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:45.011 05:00:46 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:45.011 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:45.011 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:45.011 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:45.011 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:45.011 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:45.011 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:45.011 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:45.011 05:00:46 -- setup/driver.sh@30 -- # return 0 00:04:45.011 05:00:46 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:45.011 05:00:46 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:45.011 05:00:46 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:45.011 05:00:46 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:45.011 Looking for driver=vfio-pci 00:04:45.011 05:00:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:45.011 05:00:46 -- setup/driver.sh@45 -- # setup output config 00:04:45.011 05:00:46 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:45.011 05:00:46 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:45.950 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:45.950 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:45.950 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:45.950 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:45.950 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:45.950 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:45.950 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:45.950 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:45.950 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:45.950 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:45.950 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:45.950 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:45.950 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:45.950 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:45.950 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:45.950 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:45.950 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:45.950 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:45.950 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:45.950 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:45.950 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:45.950 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:45.950 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:45.950 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:45.950 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:45.950 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:45.950 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:45.951 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:45.951 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:45.951 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:46.211 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:46.211 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:46.211 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:46.211 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:46.211 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:46.211 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:46.211 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:46.211 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:46.211 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:46.211 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:46.211 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:46.211 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:46.211 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:46.211 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:46.211 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:46.211 05:00:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:46.211 05:00:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:46.211 05:00:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:47.150 05:00:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:47.150 05:00:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:47.150 05:00:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:47.150 05:00:48 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:47.150 05:00:48 -- setup/driver.sh@65 -- # setup reset 00:04:47.150 05:00:48 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:47.150 05:00:48 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:49.687 00:04:49.687 real 0m4.935s 00:04:49.687 user 0m1.074s 00:04:49.687 sys 0m1.985s 00:04:49.687 05:00:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.687 05:00:51 -- common/autotest_common.sh@10 -- # set +x 00:04:49.687 ************************************ 00:04:49.687 END TEST guess_driver 00:04:49.687 ************************************ 00:04:49.687 00:04:49.687 real 0m7.567s 00:04:49.687 user 0m1.745s 00:04:49.687 sys 0m3.006s 00:04:49.687 05:00:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.687 05:00:51 -- common/autotest_common.sh@10 -- # set +x 00:04:49.687 ************************************ 00:04:49.687 END TEST driver 00:04:49.687 ************************************ 00:04:49.945 05:00:51 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:49.945 05:00:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:49.945 05:00:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.945 05:00:51 -- common/autotest_common.sh@10 -- # set +x 00:04:49.945 ************************************ 00:04:49.945 START TEST devices 00:04:49.945 ************************************ 00:04:49.945 05:00:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:49.945 * Looking for test storage... 00:04:49.945 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:49.945 05:00:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:49.945 05:00:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:49.945 05:00:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:49.945 05:00:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:49.945 05:00:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:49.945 05:00:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:49.945 05:00:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:49.945 05:00:51 -- scripts/common.sh@335 -- # IFS=.-: 00:04:49.945 05:00:51 -- scripts/common.sh@335 -- # read -ra ver1 00:04:49.945 05:00:51 -- scripts/common.sh@336 -- # IFS=.-: 00:04:49.945 05:00:51 -- scripts/common.sh@336 -- # read -ra ver2 00:04:49.945 05:00:51 -- scripts/common.sh@337 -- # local 'op=<' 00:04:49.945 05:00:51 -- scripts/common.sh@339 -- # ver1_l=2 00:04:49.945 05:00:51 -- scripts/common.sh@340 -- # ver2_l=1 00:04:49.945 05:00:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:49.945 05:00:51 -- scripts/common.sh@343 -- # case "$op" in 00:04:49.945 05:00:51 -- scripts/common.sh@344 -- # : 1 00:04:49.945 05:00:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:49.945 05:00:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:49.945 05:00:51 -- scripts/common.sh@364 -- # decimal 1 00:04:49.945 05:00:51 -- scripts/common.sh@352 -- # local d=1 00:04:49.945 05:00:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:49.945 05:00:51 -- scripts/common.sh@354 -- # echo 1 00:04:49.945 05:00:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:49.945 05:00:51 -- scripts/common.sh@365 -- # decimal 2 00:04:49.945 05:00:51 -- scripts/common.sh@352 -- # local d=2 00:04:49.945 05:00:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:49.945 05:00:51 -- scripts/common.sh@354 -- # echo 2 00:04:49.945 05:00:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:49.945 05:00:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:49.945 05:00:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:49.945 05:00:51 -- scripts/common.sh@367 -- # return 0 00:04:49.945 05:00:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:49.945 05:00:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:49.945 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.945 --rc genhtml_branch_coverage=1 00:04:49.945 --rc genhtml_function_coverage=1 00:04:49.945 --rc genhtml_legend=1 00:04:49.945 --rc geninfo_all_blocks=1 00:04:49.945 --rc geninfo_unexecuted_blocks=1 00:04:49.945 00:04:49.945 ' 00:04:49.945 05:00:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:49.945 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.945 --rc genhtml_branch_coverage=1 00:04:49.945 --rc genhtml_function_coverage=1 00:04:49.945 --rc genhtml_legend=1 00:04:49.945 --rc geninfo_all_blocks=1 00:04:49.945 --rc geninfo_unexecuted_blocks=1 00:04:49.945 00:04:49.945 ' 00:04:49.945 05:00:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:49.945 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.945 --rc genhtml_branch_coverage=1 00:04:49.945 --rc genhtml_function_coverage=1 00:04:49.945 --rc genhtml_legend=1 00:04:49.945 --rc geninfo_all_blocks=1 00:04:49.945 --rc geninfo_unexecuted_blocks=1 00:04:49.945 00:04:49.945 ' 00:04:49.945 05:00:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:49.945 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.945 --rc genhtml_branch_coverage=1 00:04:49.945 --rc genhtml_function_coverage=1 00:04:49.945 --rc genhtml_legend=1 00:04:49.945 --rc geninfo_all_blocks=1 00:04:49.945 --rc geninfo_unexecuted_blocks=1 00:04:49.945 00:04:49.945 ' 00:04:49.945 05:00:51 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:49.945 05:00:51 -- setup/devices.sh@192 -- # setup reset 00:04:49.945 05:00:51 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:49.945 05:00:51 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:51.851 05:00:53 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:51.851 05:00:53 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:51.851 05:00:53 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:51.851 05:00:53 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:51.851 05:00:53 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:51.851 05:00:53 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:51.851 05:00:53 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:51.851 05:00:53 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:51.851 05:00:53 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:51.851 05:00:53 -- setup/devices.sh@196 -- # blocks=() 00:04:51.851 05:00:53 -- setup/devices.sh@196 -- # declare -a blocks 00:04:51.851 05:00:53 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:51.851 05:00:53 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:51.851 05:00:53 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:51.851 05:00:53 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:51.851 05:00:53 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:51.851 05:00:53 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:51.851 05:00:53 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:04:51.851 05:00:53 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:51.851 05:00:53 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:51.851 05:00:53 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:04:51.851 05:00:53 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:51.851 No valid GPT data, bailing 00:04:51.851 05:00:53 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:51.851 05:00:53 -- scripts/common.sh@393 -- # pt= 00:04:51.851 05:00:53 -- scripts/common.sh@394 -- # return 1 00:04:51.851 05:00:53 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:51.851 05:00:53 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:51.851 05:00:53 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:51.851 05:00:53 -- setup/common.sh@80 -- # echo 1000204886016 00:04:51.851 05:00:53 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:04:51.851 05:00:53 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:51.851 05:00:53 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:04:51.851 05:00:53 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:51.851 05:00:53 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:51.851 05:00:53 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:51.851 05:00:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.851 05:00:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.851 05:00:53 -- common/autotest_common.sh@10 -- # set +x 00:04:51.851 ************************************ 00:04:51.851 START TEST nvme_mount 00:04:51.851 ************************************ 00:04:51.851 05:00:53 -- common/autotest_common.sh@1114 -- # nvme_mount 00:04:51.851 05:00:53 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:51.851 05:00:53 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:51.851 05:00:53 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:51.851 05:00:53 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:51.851 05:00:53 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:51.851 05:00:53 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:51.851 05:00:53 -- setup/common.sh@40 -- # local part_no=1 00:04:51.851 05:00:53 -- setup/common.sh@41 -- # local size=1073741824 00:04:51.851 05:00:53 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:51.851 05:00:53 -- setup/common.sh@44 -- # parts=() 00:04:51.851 05:00:53 -- setup/common.sh@44 -- # local parts 00:04:51.851 05:00:53 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:51.851 05:00:53 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:51.851 05:00:53 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:51.851 05:00:53 -- setup/common.sh@46 -- # (( part++ )) 00:04:51.851 05:00:53 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:51.851 05:00:53 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:51.851 05:00:53 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:51.851 05:00:53 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:04:52.792 Creating new GPT entries in memory. 00:04:52.792 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:52.792 other utilities. 00:04:52.792 05:00:54 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:52.792 05:00:54 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:52.793 05:00:54 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:52.793 05:00:54 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:52.793 05:00:54 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:53.732 Creating new GPT entries in memory. 00:04:53.732 The operation has completed successfully. 00:04:53.732 05:00:55 -- setup/common.sh@57 -- # (( part++ )) 00:04:53.732 05:00:55 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:53.732 05:00:55 -- setup/common.sh@62 -- # wait 3161705 00:04:53.732 05:00:55 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:53.732 05:00:55 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:04:53.732 05:00:55 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:53.732 05:00:55 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:04:53.732 05:00:55 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:04:53.732 05:00:55 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:53.732 05:00:55 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:53.732 05:00:55 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:53.732 05:00:55 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:04:53.732 05:00:55 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:53.732 05:00:55 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:53.732 05:00:55 -- setup/devices.sh@53 -- # local found=0 00:04:53.732 05:00:55 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:53.732 05:00:55 -- setup/devices.sh@56 -- # : 00:04:53.732 05:00:55 -- setup/devices.sh@59 -- # local pci status 00:04:53.732 05:00:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.732 05:00:55 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:53.732 05:00:55 -- setup/devices.sh@47 -- # setup output config 00:04:53.732 05:00:55 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:53.732 05:00:55 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:04:54.672 05:00:56 -- setup/devices.sh@63 -- # found=1 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.672 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.672 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.673 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.673 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.673 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.673 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.673 05:00:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.673 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.932 05:00:56 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:54.932 05:00:56 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:54.932 05:00:56 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:54.933 05:00:56 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:54.933 05:00:56 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:54.933 05:00:56 -- setup/devices.sh@110 -- # cleanup_nvme 00:04:54.933 05:00:56 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:54.933 05:00:56 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:54.933 05:00:56 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:54.933 05:00:56 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:54.933 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:54.933 05:00:56 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:54.933 05:00:56 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:55.229 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:55.229 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:55.229 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:55.229 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:55.230 05:00:56 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:04:55.230 05:00:56 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:04:55.230 05:00:56 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:55.230 05:00:56 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:04:55.230 05:00:56 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:04:55.230 05:00:56 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:55.230 05:00:56 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:55.230 05:00:56 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:55.230 05:00:56 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:04:55.230 05:00:56 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:55.230 05:00:56 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:55.230 05:00:56 -- setup/devices.sh@53 -- # local found=0 00:04:55.230 05:00:56 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:55.230 05:00:56 -- setup/devices.sh@56 -- # : 00:04:55.230 05:00:56 -- setup/devices.sh@59 -- # local pci status 00:04:55.230 05:00:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.230 05:00:56 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:55.230 05:00:56 -- setup/devices.sh@47 -- # setup output config 00:04:55.230 05:00:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:55.230 05:00:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:56.191 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.191 05:00:57 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:04:56.191 05:00:57 -- setup/devices.sh@63 -- # found=1 00:04:56.191 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:56.450 05:00:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:58 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:56.450 05:00:58 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:56.450 05:00:58 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:56.450 05:00:58 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:56.450 05:00:58 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:56.450 05:00:58 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:56.450 05:00:58 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:04:56.450 05:00:58 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:56.450 05:00:58 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:04:56.450 05:00:58 -- setup/devices.sh@50 -- # local mount_point= 00:04:56.450 05:00:58 -- setup/devices.sh@51 -- # local test_file= 00:04:56.450 05:00:58 -- setup/devices.sh@53 -- # local found=0 00:04:56.450 05:00:58 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:56.450 05:00:58 -- setup/devices.sh@59 -- # local pci status 00:04:56.450 05:00:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.450 05:00:58 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:56.450 05:00:58 -- setup/devices.sh@47 -- # setup output config 00:04:56.450 05:00:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:56.450 05:00:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:57.827 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.827 05:00:59 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:04:57.827 05:00:59 -- setup/devices.sh@63 -- # found=1 00:04:57.827 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.827 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.827 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.828 05:00:59 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:57.828 05:00:59 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:57.828 05:00:59 -- setup/devices.sh@68 -- # return 0 00:04:57.828 05:00:59 -- setup/devices.sh@128 -- # cleanup_nvme 00:04:57.828 05:00:59 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:57.828 05:00:59 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:57.828 05:00:59 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:57.828 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:57.828 00:04:57.828 real 0m6.332s 00:04:57.828 user 0m1.484s 00:04:57.828 sys 0m2.441s 00:04:57.828 05:00:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:57.828 05:00:59 -- common/autotest_common.sh@10 -- # set +x 00:04:57.828 ************************************ 00:04:57.828 END TEST nvme_mount 00:04:57.828 ************************************ 00:04:57.828 05:00:59 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:04:57.828 05:00:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:57.828 05:00:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:57.828 05:00:59 -- common/autotest_common.sh@10 -- # set +x 00:04:57.828 ************************************ 00:04:57.828 START TEST dm_mount 00:04:57.828 ************************************ 00:04:57.828 05:00:59 -- common/autotest_common.sh@1114 -- # dm_mount 00:04:57.828 05:00:59 -- setup/devices.sh@144 -- # pv=nvme0n1 00:04:57.828 05:00:59 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:04:57.828 05:00:59 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:04:57.828 05:00:59 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:04:57.828 05:00:59 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:57.828 05:00:59 -- setup/common.sh@40 -- # local part_no=2 00:04:57.828 05:00:59 -- setup/common.sh@41 -- # local size=1073741824 00:04:57.828 05:00:59 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:57.828 05:00:59 -- setup/common.sh@44 -- # parts=() 00:04:57.828 05:00:59 -- setup/common.sh@44 -- # local parts 00:04:57.828 05:00:59 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:57.828 05:00:59 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:57.828 05:00:59 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:57.828 05:00:59 -- setup/common.sh@46 -- # (( part++ )) 00:04:57.828 05:00:59 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:57.828 05:00:59 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:57.828 05:00:59 -- setup/common.sh@46 -- # (( part++ )) 00:04:57.828 05:00:59 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:57.828 05:00:59 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:57.828 05:00:59 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:57.828 05:00:59 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:04:59.207 Creating new GPT entries in memory. 00:04:59.207 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:59.207 other utilities. 00:04:59.207 05:01:00 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:59.207 05:01:00 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:59.207 05:01:00 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:59.207 05:01:00 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:59.207 05:01:00 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:00.148 Creating new GPT entries in memory. 00:05:00.148 The operation has completed successfully. 00:05:00.148 05:01:01 -- setup/common.sh@57 -- # (( part++ )) 00:05:00.148 05:01:01 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:00.148 05:01:01 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:00.148 05:01:01 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:00.148 05:01:01 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:01.088 The operation has completed successfully. 00:05:01.088 05:01:02 -- setup/common.sh@57 -- # (( part++ )) 00:05:01.088 05:01:02 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:01.088 05:01:02 -- setup/common.sh@62 -- # wait 3164170 00:05:01.088 05:01:02 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:01.088 05:01:02 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:01.088 05:01:02 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:01.088 05:01:02 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:01.088 05:01:02 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:01.088 05:01:02 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:01.088 05:01:02 -- setup/devices.sh@161 -- # break 00:05:01.088 05:01:02 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:01.088 05:01:02 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:01.088 05:01:02 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:01.088 05:01:02 -- setup/devices.sh@166 -- # dm=dm-0 00:05:01.088 05:01:02 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:01.088 05:01:02 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:01.088 05:01:02 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:01.088 05:01:02 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:01.088 05:01:02 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:01.088 05:01:02 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:01.088 05:01:02 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:01.088 05:01:02 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:01.088 05:01:02 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:01.088 05:01:02 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:01.088 05:01:02 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:01.088 05:01:02 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:01.088 05:01:02 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:01.088 05:01:02 -- setup/devices.sh@53 -- # local found=0 00:05:01.088 05:01:02 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:01.088 05:01:02 -- setup/devices.sh@56 -- # : 00:05:01.088 05:01:02 -- setup/devices.sh@59 -- # local pci status 00:05:01.088 05:01:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.088 05:01:02 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:01.088 05:01:02 -- setup/devices.sh@47 -- # setup output config 00:05:01.088 05:01:02 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:01.088 05:01:02 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:02.025 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:02.026 05:01:03 -- setup/devices.sh@63 -- # found=1 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.026 05:01:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.026 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.285 05:01:03 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:02.285 05:01:03 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:02.285 05:01:03 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:02.285 05:01:03 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:02.285 05:01:03 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:02.285 05:01:03 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:02.285 05:01:03 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:02.285 05:01:03 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:02.285 05:01:03 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:02.285 05:01:03 -- setup/devices.sh@50 -- # local mount_point= 00:05:02.285 05:01:03 -- setup/devices.sh@51 -- # local test_file= 00:05:02.285 05:01:03 -- setup/devices.sh@53 -- # local found=0 00:05:02.285 05:01:03 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:02.285 05:01:03 -- setup/devices.sh@59 -- # local pci status 00:05:02.285 05:01:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.285 05:01:03 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:02.285 05:01:03 -- setup/devices.sh@47 -- # setup output config 00:05:02.285 05:01:03 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:02.285 05:01:03 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:03.663 05:01:05 -- setup/devices.sh@63 -- # found=1 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.663 05:01:05 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:03.663 05:01:05 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:03.663 05:01:05 -- setup/devices.sh@68 -- # return 0 00:05:03.663 05:01:05 -- setup/devices.sh@187 -- # cleanup_dm 00:05:03.663 05:01:05 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:03.663 05:01:05 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:03.663 05:01:05 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:03.663 05:01:05 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:03.663 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:03.663 05:01:05 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:03.663 00:05:03.663 real 0m5.788s 00:05:03.663 user 0m0.923s 00:05:03.663 sys 0m1.737s 00:05:03.663 05:01:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:03.663 05:01:05 -- common/autotest_common.sh@10 -- # set +x 00:05:03.663 ************************************ 00:05:03.663 END TEST dm_mount 00:05:03.663 ************************************ 00:05:03.663 05:01:05 -- setup/devices.sh@1 -- # cleanup 00:05:03.663 05:01:05 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:03.663 05:01:05 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:03.663 05:01:05 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:03.663 05:01:05 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:03.663 05:01:05 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:03.921 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:03.921 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:03.921 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:03.921 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:03.921 05:01:05 -- setup/devices.sh@12 -- # cleanup_dm 00:05:03.921 05:01:05 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:03.921 05:01:05 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:03.921 05:01:05 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:03.921 05:01:05 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:03.921 05:01:05 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:03.921 05:01:05 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:03.921 00:05:03.921 real 0m14.178s 00:05:03.921 user 0m3.140s 00:05:03.921 sys 0m5.268s 00:05:03.921 05:01:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:03.921 05:01:05 -- common/autotest_common.sh@10 -- # set +x 00:05:03.921 ************************************ 00:05:03.921 END TEST devices 00:05:03.921 ************************************ 00:05:03.921 00:05:03.921 real 0m43.628s 00:05:03.921 user 0m12.606s 00:05:03.921 sys 0m19.400s 00:05:03.921 05:01:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:03.921 05:01:05 -- common/autotest_common.sh@10 -- # set +x 00:05:03.921 ************************************ 00:05:03.921 END TEST setup.sh 00:05:03.921 ************************************ 00:05:03.921 05:01:05 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:05.301 Hugepages 00:05:05.301 node hugesize free / total 00:05:05.301 node0 1048576kB 0 / 0 00:05:05.301 node0 2048kB 2048 / 2048 00:05:05.301 node1 1048576kB 0 / 0 00:05:05.301 node1 2048kB 0 / 0 00:05:05.301 00:05:05.301 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:05.301 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:05.301 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:05.301 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:05.301 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:05.301 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:05.301 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:05.301 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:05.301 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:05.301 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:05.301 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:05.301 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:05.301 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:05.301 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:05.301 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:05.301 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:05.301 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:05.301 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:05.301 05:01:06 -- spdk/autotest.sh@128 -- # uname -s 00:05:05.301 05:01:06 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:05:05.301 05:01:06 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:05:05.301 05:01:06 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:06.677 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:06.678 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:06.678 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:06.678 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:06.678 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:06.678 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:06.678 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:06.678 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:06.678 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:06.678 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:06.678 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:06.678 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:06.678 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:06.678 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:06.678 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:06.678 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:07.626 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:07.626 05:01:09 -- common/autotest_common.sh@1527 -- # sleep 1 00:05:09.007 05:01:10 -- common/autotest_common.sh@1528 -- # bdfs=() 00:05:09.007 05:01:10 -- common/autotest_common.sh@1528 -- # local bdfs 00:05:09.007 05:01:10 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:05:09.007 05:01:10 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:05:09.007 05:01:10 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:09.007 05:01:10 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:09.007 05:01:10 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:09.007 05:01:10 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:09.007 05:01:10 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:09.007 05:01:10 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:09.007 05:01:10 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:09.007 05:01:10 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:09.946 Waiting for block devices as requested 00:05:09.946 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:09.946 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:10.205 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:10.205 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:10.205 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:10.205 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:10.464 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:10.464 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:10.464 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:10.464 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:10.725 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:10.725 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:10.725 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:10.725 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:10.985 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:10.985 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:10.985 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:11.243 05:01:12 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:05:11.243 05:01:12 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:11.243 05:01:12 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:05:11.243 05:01:12 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:05:11.243 05:01:12 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:11.243 05:01:12 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:11.243 05:01:12 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:11.243 05:01:12 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:05:11.243 05:01:12 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:05:11.243 05:01:12 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:05:11.243 05:01:12 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:11.243 05:01:12 -- common/autotest_common.sh@1540 -- # grep oacs 00:05:11.243 05:01:12 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:11.243 05:01:12 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:05:11.243 05:01:12 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:05:11.243 05:01:12 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:05:11.243 05:01:12 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:05:11.243 05:01:12 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:05:11.243 05:01:12 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:05:11.243 05:01:12 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:05:11.243 05:01:12 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:05:11.243 05:01:12 -- common/autotest_common.sh@1552 -- # continue 00:05:11.243 05:01:12 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:05:11.243 05:01:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:11.243 05:01:12 -- common/autotest_common.sh@10 -- # set +x 00:05:11.243 05:01:12 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:05:11.243 05:01:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:11.243 05:01:12 -- common/autotest_common.sh@10 -- # set +x 00:05:11.243 05:01:12 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:12.622 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:12.622 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:12.622 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:12.622 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:12.622 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:12.622 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:12.622 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:12.622 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:12.622 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:12.622 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:12.622 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:12.622 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:12.622 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:12.622 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:12.622 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:12.622 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:13.562 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:13.562 05:01:15 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:05:13.562 05:01:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:13.562 05:01:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.562 05:01:15 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:05:13.562 05:01:15 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:05:13.562 05:01:15 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:05:13.562 05:01:15 -- common/autotest_common.sh@1572 -- # bdfs=() 00:05:13.562 05:01:15 -- common/autotest_common.sh@1572 -- # local bdfs 00:05:13.562 05:01:15 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:05:13.562 05:01:15 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:13.562 05:01:15 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:13.562 05:01:15 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:13.562 05:01:15 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:13.562 05:01:15 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:13.562 05:01:15 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:13.562 05:01:15 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:13.562 05:01:15 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:05:13.562 05:01:15 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:13.562 05:01:15 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:05:13.562 05:01:15 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:13.562 05:01:15 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:05:13.562 05:01:15 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:05:13.562 05:01:15 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:05:13.562 05:01:15 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=3169597 00:05:13.562 05:01:15 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:13.562 05:01:15 -- common/autotest_common.sh@1593 -- # waitforlisten 3169597 00:05:13.562 05:01:15 -- common/autotest_common.sh@829 -- # '[' -z 3169597 ']' 00:05:13.562 05:01:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:13.562 05:01:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:13.563 05:01:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:13.563 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:13.563 05:01:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:13.563 05:01:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.563 [2024-11-26 05:01:15.296173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:13.563 [2024-11-26 05:01:15.296265] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3169597 ] 00:05:13.563 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.821 [2024-11-26 05:01:15.356433] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:13.821 [2024-11-26 05:01:15.440406] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:13.821 [2024-11-26 05:01:15.440592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:14.756 05:01:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:14.756 05:01:16 -- common/autotest_common.sh@862 -- # return 0 00:05:14.756 05:01:16 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:14.756 05:01:16 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:14.756 05:01:16 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:18.051 nvme0n1 00:05:18.051 05:01:19 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:18.051 [2024-11-26 05:01:19.623970] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:18.051 [2024-11-26 05:01:19.624036] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:18.051 request: 00:05:18.051 { 00:05:18.051 "nvme_ctrlr_name": "nvme0", 00:05:18.051 "password": "test", 00:05:18.051 "method": "bdev_nvme_opal_revert", 00:05:18.051 "req_id": 1 00:05:18.051 } 00:05:18.051 Got JSON-RPC error response 00:05:18.051 response: 00:05:18.051 { 00:05:18.051 "code": -32603, 00:05:18.051 "message": "Internal error" 00:05:18.051 } 00:05:18.051 05:01:19 -- common/autotest_common.sh@1599 -- # true 00:05:18.051 05:01:19 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:18.051 05:01:19 -- common/autotest_common.sh@1603 -- # killprocess 3169597 00:05:18.051 05:01:19 -- common/autotest_common.sh@936 -- # '[' -z 3169597 ']' 00:05:18.051 05:01:19 -- common/autotest_common.sh@940 -- # kill -0 3169597 00:05:18.051 05:01:19 -- common/autotest_common.sh@941 -- # uname 00:05:18.051 05:01:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:18.051 05:01:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3169597 00:05:18.051 05:01:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:18.051 05:01:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:18.051 05:01:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3169597' 00:05:18.051 killing process with pid 3169597 00:05:18.051 05:01:19 -- common/autotest_common.sh@955 -- # kill 3169597 00:05:18.051 05:01:19 -- common/autotest_common.sh@960 -- # wait 3169597 00:05:19.958 05:01:21 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:19.958 05:01:21 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:19.958 05:01:21 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:19.958 05:01:21 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:19.958 05:01:21 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:19.958 05:01:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:19.958 05:01:21 -- common/autotest_common.sh@10 -- # set +x 00:05:19.958 05:01:21 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:19.958 05:01:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:19.958 05:01:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.958 05:01:21 -- common/autotest_common.sh@10 -- # set +x 00:05:19.958 ************************************ 00:05:19.958 START TEST env 00:05:19.958 ************************************ 00:05:19.958 05:01:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:19.958 * Looking for test storage... 00:05:19.958 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:19.958 05:01:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:19.958 05:01:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:19.958 05:01:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:19.958 05:01:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:19.958 05:01:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:19.958 05:01:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:19.958 05:01:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:19.958 05:01:21 -- scripts/common.sh@335 -- # IFS=.-: 00:05:19.958 05:01:21 -- scripts/common.sh@335 -- # read -ra ver1 00:05:19.958 05:01:21 -- scripts/common.sh@336 -- # IFS=.-: 00:05:19.958 05:01:21 -- scripts/common.sh@336 -- # read -ra ver2 00:05:19.958 05:01:21 -- scripts/common.sh@337 -- # local 'op=<' 00:05:19.958 05:01:21 -- scripts/common.sh@339 -- # ver1_l=2 00:05:19.958 05:01:21 -- scripts/common.sh@340 -- # ver2_l=1 00:05:19.958 05:01:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:19.958 05:01:21 -- scripts/common.sh@343 -- # case "$op" in 00:05:19.958 05:01:21 -- scripts/common.sh@344 -- # : 1 00:05:19.958 05:01:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:19.958 05:01:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:19.958 05:01:21 -- scripts/common.sh@364 -- # decimal 1 00:05:19.959 05:01:21 -- scripts/common.sh@352 -- # local d=1 00:05:19.959 05:01:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:19.959 05:01:21 -- scripts/common.sh@354 -- # echo 1 00:05:19.959 05:01:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:19.959 05:01:21 -- scripts/common.sh@365 -- # decimal 2 00:05:19.959 05:01:21 -- scripts/common.sh@352 -- # local d=2 00:05:19.959 05:01:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:19.959 05:01:21 -- scripts/common.sh@354 -- # echo 2 00:05:19.959 05:01:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:19.959 05:01:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:19.959 05:01:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:19.959 05:01:21 -- scripts/common.sh@367 -- # return 0 00:05:19.959 05:01:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:19.959 05:01:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:19.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:19.959 --rc genhtml_branch_coverage=1 00:05:19.959 --rc genhtml_function_coverage=1 00:05:19.959 --rc genhtml_legend=1 00:05:19.959 --rc geninfo_all_blocks=1 00:05:19.959 --rc geninfo_unexecuted_blocks=1 00:05:19.959 00:05:19.959 ' 00:05:19.959 05:01:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:19.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:19.959 --rc genhtml_branch_coverage=1 00:05:19.959 --rc genhtml_function_coverage=1 00:05:19.959 --rc genhtml_legend=1 00:05:19.959 --rc geninfo_all_blocks=1 00:05:19.959 --rc geninfo_unexecuted_blocks=1 00:05:19.959 00:05:19.959 ' 00:05:19.959 05:01:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:19.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:19.959 --rc genhtml_branch_coverage=1 00:05:19.959 --rc genhtml_function_coverage=1 00:05:19.959 --rc genhtml_legend=1 00:05:19.959 --rc geninfo_all_blocks=1 00:05:19.959 --rc geninfo_unexecuted_blocks=1 00:05:19.959 00:05:19.959 ' 00:05:19.959 05:01:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:19.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:19.959 --rc genhtml_branch_coverage=1 00:05:19.959 --rc genhtml_function_coverage=1 00:05:19.959 --rc genhtml_legend=1 00:05:19.959 --rc geninfo_all_blocks=1 00:05:19.959 --rc geninfo_unexecuted_blocks=1 00:05:19.959 00:05:19.959 ' 00:05:19.959 05:01:21 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:19.959 05:01:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:19.959 05:01:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.959 05:01:21 -- common/autotest_common.sh@10 -- # set +x 00:05:19.959 ************************************ 00:05:19.959 START TEST env_memory 00:05:19.959 ************************************ 00:05:19.959 05:01:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:19.959 00:05:19.959 00:05:19.959 CUnit - A unit testing framework for C - Version 2.1-3 00:05:19.959 http://cunit.sourceforge.net/ 00:05:19.959 00:05:19.959 00:05:19.959 Suite: memory 00:05:19.959 Test: alloc and free memory map ...[2024-11-26 05:01:21.655572] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:19.959 passed 00:05:19.959 Test: mem map translation ...[2024-11-26 05:01:21.675252] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:19.959 [2024-11-26 05:01:21.675276] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:19.959 [2024-11-26 05:01:21.675325] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:19.959 [2024-11-26 05:01:21.675337] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:19.959 passed 00:05:19.959 Test: mem map registration ...[2024-11-26 05:01:21.716100] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:19.959 [2024-11-26 05:01:21.716120] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:20.219 passed 00:05:20.219 Test: mem map adjacent registrations ...passed 00:05:20.219 00:05:20.219 Run Summary: Type Total Ran Passed Failed Inactive 00:05:20.219 suites 1 1 n/a 0 0 00:05:20.219 tests 4 4 4 0 0 00:05:20.219 asserts 152 152 152 0 n/a 00:05:20.219 00:05:20.219 Elapsed time = 0.143 seconds 00:05:20.219 00:05:20.219 real 0m0.151s 00:05:20.219 user 0m0.140s 00:05:20.219 sys 0m0.010s 00:05:20.219 05:01:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.219 05:01:21 -- common/autotest_common.sh@10 -- # set +x 00:05:20.219 ************************************ 00:05:20.219 END TEST env_memory 00:05:20.219 ************************************ 00:05:20.219 05:01:21 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:20.219 05:01:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:20.219 05:01:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:20.219 05:01:21 -- common/autotest_common.sh@10 -- # set +x 00:05:20.219 ************************************ 00:05:20.219 START TEST env_vtophys 00:05:20.219 ************************************ 00:05:20.219 05:01:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:20.219 EAL: lib.eal log level changed from notice to debug 00:05:20.219 EAL: Detected lcore 0 as core 0 on socket 0 00:05:20.219 EAL: Detected lcore 1 as core 1 on socket 0 00:05:20.219 EAL: Detected lcore 2 as core 2 on socket 0 00:05:20.219 EAL: Detected lcore 3 as core 3 on socket 0 00:05:20.219 EAL: Detected lcore 4 as core 4 on socket 0 00:05:20.219 EAL: Detected lcore 5 as core 5 on socket 0 00:05:20.219 EAL: Detected lcore 6 as core 8 on socket 0 00:05:20.219 EAL: Detected lcore 7 as core 9 on socket 0 00:05:20.219 EAL: Detected lcore 8 as core 10 on socket 0 00:05:20.219 EAL: Detected lcore 9 as core 11 on socket 0 00:05:20.219 EAL: Detected lcore 10 as core 12 on socket 0 00:05:20.219 EAL: Detected lcore 11 as core 13 on socket 0 00:05:20.219 EAL: Detected lcore 12 as core 0 on socket 1 00:05:20.219 EAL: Detected lcore 13 as core 1 on socket 1 00:05:20.219 EAL: Detected lcore 14 as core 2 on socket 1 00:05:20.219 EAL: Detected lcore 15 as core 3 on socket 1 00:05:20.219 EAL: Detected lcore 16 as core 4 on socket 1 00:05:20.219 EAL: Detected lcore 17 as core 5 on socket 1 00:05:20.219 EAL: Detected lcore 18 as core 8 on socket 1 00:05:20.219 EAL: Detected lcore 19 as core 9 on socket 1 00:05:20.219 EAL: Detected lcore 20 as core 10 on socket 1 00:05:20.219 EAL: Detected lcore 21 as core 11 on socket 1 00:05:20.219 EAL: Detected lcore 22 as core 12 on socket 1 00:05:20.219 EAL: Detected lcore 23 as core 13 on socket 1 00:05:20.219 EAL: Detected lcore 24 as core 0 on socket 0 00:05:20.219 EAL: Detected lcore 25 as core 1 on socket 0 00:05:20.220 EAL: Detected lcore 26 as core 2 on socket 0 00:05:20.220 EAL: Detected lcore 27 as core 3 on socket 0 00:05:20.220 EAL: Detected lcore 28 as core 4 on socket 0 00:05:20.220 EAL: Detected lcore 29 as core 5 on socket 0 00:05:20.220 EAL: Detected lcore 30 as core 8 on socket 0 00:05:20.220 EAL: Detected lcore 31 as core 9 on socket 0 00:05:20.220 EAL: Detected lcore 32 as core 10 on socket 0 00:05:20.220 EAL: Detected lcore 33 as core 11 on socket 0 00:05:20.220 EAL: Detected lcore 34 as core 12 on socket 0 00:05:20.220 EAL: Detected lcore 35 as core 13 on socket 0 00:05:20.220 EAL: Detected lcore 36 as core 0 on socket 1 00:05:20.220 EAL: Detected lcore 37 as core 1 on socket 1 00:05:20.220 EAL: Detected lcore 38 as core 2 on socket 1 00:05:20.220 EAL: Detected lcore 39 as core 3 on socket 1 00:05:20.220 EAL: Detected lcore 40 as core 4 on socket 1 00:05:20.220 EAL: Detected lcore 41 as core 5 on socket 1 00:05:20.220 EAL: Detected lcore 42 as core 8 on socket 1 00:05:20.220 EAL: Detected lcore 43 as core 9 on socket 1 00:05:20.220 EAL: Detected lcore 44 as core 10 on socket 1 00:05:20.220 EAL: Detected lcore 45 as core 11 on socket 1 00:05:20.220 EAL: Detected lcore 46 as core 12 on socket 1 00:05:20.220 EAL: Detected lcore 47 as core 13 on socket 1 00:05:20.220 EAL: Maximum logical cores by configuration: 128 00:05:20.220 EAL: Detected CPU lcores: 48 00:05:20.220 EAL: Detected NUMA nodes: 2 00:05:20.220 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:05:20.220 EAL: Detected shared linkage of DPDK 00:05:20.220 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24.0 00:05:20.220 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24.0 00:05:20.220 EAL: Registered [vdev] bus. 00:05:20.220 EAL: bus.vdev log level changed from disabled to notice 00:05:20.220 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24.0 00:05:20.220 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24.0 00:05:20.220 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:20.220 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:20.220 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:05:20.220 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:05:20.220 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:05:20.220 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:05:20.220 EAL: No shared files mode enabled, IPC will be disabled 00:05:20.220 EAL: No shared files mode enabled, IPC is disabled 00:05:20.220 EAL: Bus pci wants IOVA as 'DC' 00:05:20.220 EAL: Bus vdev wants IOVA as 'DC' 00:05:20.220 EAL: Buses did not request a specific IOVA mode. 00:05:20.220 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:20.220 EAL: Selected IOVA mode 'VA' 00:05:20.220 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.220 EAL: Probing VFIO support... 00:05:20.220 EAL: IOMMU type 1 (Type 1) is supported 00:05:20.220 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:20.220 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:20.220 EAL: VFIO support initialized 00:05:20.220 EAL: Ask a virtual area of 0x2e000 bytes 00:05:20.220 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:20.220 EAL: Setting up physically contiguous memory... 00:05:20.220 EAL: Setting maximum number of open files to 524288 00:05:20.220 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:20.220 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:20.220 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:20.220 EAL: Ask a virtual area of 0x61000 bytes 00:05:20.220 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:20.220 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:20.220 EAL: Ask a virtual area of 0x400000000 bytes 00:05:20.220 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:20.220 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:20.220 EAL: Ask a virtual area of 0x61000 bytes 00:05:20.220 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:20.220 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:20.220 EAL: Ask a virtual area of 0x400000000 bytes 00:05:20.220 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:20.220 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:20.220 EAL: Ask a virtual area of 0x61000 bytes 00:05:20.220 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:20.220 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:20.220 EAL: Ask a virtual area of 0x400000000 bytes 00:05:20.220 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:20.220 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:20.220 EAL: Ask a virtual area of 0x61000 bytes 00:05:20.220 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:20.220 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:20.220 EAL: Ask a virtual area of 0x400000000 bytes 00:05:20.220 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:20.220 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:20.220 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:20.220 EAL: Ask a virtual area of 0x61000 bytes 00:05:20.220 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:20.220 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:20.220 EAL: Ask a virtual area of 0x400000000 bytes 00:05:20.220 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:20.220 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:20.220 EAL: Ask a virtual area of 0x61000 bytes 00:05:20.220 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:20.220 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:20.220 EAL: Ask a virtual area of 0x400000000 bytes 00:05:20.220 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:20.220 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:20.220 EAL: Ask a virtual area of 0x61000 bytes 00:05:20.220 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:20.220 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:20.220 EAL: Ask a virtual area of 0x400000000 bytes 00:05:20.220 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:20.220 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:20.220 EAL: Ask a virtual area of 0x61000 bytes 00:05:20.220 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:20.220 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:20.220 EAL: Ask a virtual area of 0x400000000 bytes 00:05:20.220 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:20.220 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:20.220 EAL: Hugepages will be freed exactly as allocated. 00:05:20.220 EAL: No shared files mode enabled, IPC is disabled 00:05:20.220 EAL: No shared files mode enabled, IPC is disabled 00:05:20.220 EAL: TSC frequency is ~2700000 KHz 00:05:20.220 EAL: Main lcore 0 is ready (tid=7ff06c7daa00;cpuset=[0]) 00:05:20.220 EAL: Trying to obtain current memory policy. 00:05:20.220 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:20.220 EAL: Restoring previous memory policy: 0 00:05:20.220 EAL: request: mp_malloc_sync 00:05:20.220 EAL: No shared files mode enabled, IPC is disabled 00:05:20.220 EAL: Heap on socket 0 was expanded by 2MB 00:05:20.220 EAL: No shared files mode enabled, IPC is disabled 00:05:20.220 EAL: No shared files mode enabled, IPC is disabled 00:05:20.220 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:20.220 EAL: Mem event callback 'spdk:(nil)' registered 00:05:20.220 00:05:20.220 00:05:20.220 CUnit - A unit testing framework for C - Version 2.1-3 00:05:20.221 http://cunit.sourceforge.net/ 00:05:20.221 00:05:20.221 00:05:20.221 Suite: components_suite 00:05:20.221 Test: vtophys_malloc_test ...passed 00:05:20.221 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:20.221 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:20.221 EAL: Restoring previous memory policy: 4 00:05:20.221 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.221 EAL: request: mp_malloc_sync 00:05:20.221 EAL: No shared files mode enabled, IPC is disabled 00:05:20.221 EAL: Heap on socket 0 was expanded by 4MB 00:05:20.221 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.221 EAL: request: mp_malloc_sync 00:05:20.221 EAL: No shared files mode enabled, IPC is disabled 00:05:20.221 EAL: Heap on socket 0 was shrunk by 4MB 00:05:20.221 EAL: Trying to obtain current memory policy. 00:05:20.221 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:20.221 EAL: Restoring previous memory policy: 4 00:05:20.221 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.221 EAL: request: mp_malloc_sync 00:05:20.221 EAL: No shared files mode enabled, IPC is disabled 00:05:20.221 EAL: Heap on socket 0 was expanded by 6MB 00:05:20.221 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.221 EAL: request: mp_malloc_sync 00:05:20.221 EAL: No shared files mode enabled, IPC is disabled 00:05:20.221 EAL: Heap on socket 0 was shrunk by 6MB 00:05:20.221 EAL: Trying to obtain current memory policy. 00:05:20.221 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:20.221 EAL: Restoring previous memory policy: 4 00:05:20.221 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.221 EAL: request: mp_malloc_sync 00:05:20.221 EAL: No shared files mode enabled, IPC is disabled 00:05:20.221 EAL: Heap on socket 0 was expanded by 10MB 00:05:20.221 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.221 EAL: request: mp_malloc_sync 00:05:20.221 EAL: No shared files mode enabled, IPC is disabled 00:05:20.221 EAL: Heap on socket 0 was shrunk by 10MB 00:05:20.221 EAL: Trying to obtain current memory policy. 00:05:20.221 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:20.221 EAL: Restoring previous memory policy: 4 00:05:20.221 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.221 EAL: request: mp_malloc_sync 00:05:20.221 EAL: No shared files mode enabled, IPC is disabled 00:05:20.221 EAL: Heap on socket 0 was expanded by 18MB 00:05:20.221 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.221 EAL: request: mp_malloc_sync 00:05:20.221 EAL: No shared files mode enabled, IPC is disabled 00:05:20.221 EAL: Heap on socket 0 was shrunk by 18MB 00:05:20.221 EAL: Trying to obtain current memory policy. 00:05:20.221 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:20.221 EAL: Restoring previous memory policy: 4 00:05:20.221 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.221 EAL: request: mp_malloc_sync 00:05:20.221 EAL: No shared files mode enabled, IPC is disabled 00:05:20.221 EAL: Heap on socket 0 was expanded by 34MB 00:05:20.221 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.221 EAL: request: mp_malloc_sync 00:05:20.221 EAL: No shared files mode enabled, IPC is disabled 00:05:20.221 EAL: Heap on socket 0 was shrunk by 34MB 00:05:20.221 EAL: Trying to obtain current memory policy. 00:05:20.221 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:20.221 EAL: Restoring previous memory policy: 4 00:05:20.221 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.221 EAL: request: mp_malloc_sync 00:05:20.221 EAL: No shared files mode enabled, IPC is disabled 00:05:20.221 EAL: Heap on socket 0 was expanded by 66MB 00:05:20.221 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.221 EAL: request: mp_malloc_sync 00:05:20.221 EAL: No shared files mode enabled, IPC is disabled 00:05:20.221 EAL: Heap on socket 0 was shrunk by 66MB 00:05:20.221 EAL: Trying to obtain current memory policy. 00:05:20.221 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:20.221 EAL: Restoring previous memory policy: 4 00:05:20.221 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.221 EAL: request: mp_malloc_sync 00:05:20.221 EAL: No shared files mode enabled, IPC is disabled 00:05:20.221 EAL: Heap on socket 0 was expanded by 130MB 00:05:20.481 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.481 EAL: request: mp_malloc_sync 00:05:20.481 EAL: No shared files mode enabled, IPC is disabled 00:05:20.481 EAL: Heap on socket 0 was shrunk by 130MB 00:05:20.481 EAL: Trying to obtain current memory policy. 00:05:20.481 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:20.481 EAL: Restoring previous memory policy: 4 00:05:20.481 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.481 EAL: request: mp_malloc_sync 00:05:20.481 EAL: No shared files mode enabled, IPC is disabled 00:05:20.481 EAL: Heap on socket 0 was expanded by 258MB 00:05:20.481 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.481 EAL: request: mp_malloc_sync 00:05:20.481 EAL: No shared files mode enabled, IPC is disabled 00:05:20.481 EAL: Heap on socket 0 was shrunk by 258MB 00:05:20.481 EAL: Trying to obtain current memory policy. 00:05:20.481 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:20.741 EAL: Restoring previous memory policy: 4 00:05:20.741 EAL: Calling mem event callback 'spdk:(nil)' 00:05:20.741 EAL: request: mp_malloc_sync 00:05:20.741 EAL: No shared files mode enabled, IPC is disabled 00:05:20.741 EAL: Heap on socket 0 was expanded by 514MB 00:05:20.741 EAL: Calling mem event callback 'spdk:(nil)' 00:05:21.001 EAL: request: mp_malloc_sync 00:05:21.001 EAL: No shared files mode enabled, IPC is disabled 00:05:21.001 EAL: Heap on socket 0 was shrunk by 514MB 00:05:21.001 EAL: Trying to obtain current memory policy. 00:05:21.001 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:21.259 EAL: Restoring previous memory policy: 4 00:05:21.259 EAL: Calling mem event callback 'spdk:(nil)' 00:05:21.259 EAL: request: mp_malloc_sync 00:05:21.259 EAL: No shared files mode enabled, IPC is disabled 00:05:21.259 EAL: Heap on socket 0 was expanded by 1026MB 00:05:21.517 EAL: Calling mem event callback 'spdk:(nil)' 00:05:21.517 EAL: request: mp_malloc_sync 00:05:21.517 EAL: No shared files mode enabled, IPC is disabled 00:05:21.517 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:21.517 passed 00:05:21.517 00:05:21.517 Run Summary: Type Total Ran Passed Failed Inactive 00:05:21.517 suites 1 1 n/a 0 0 00:05:21.517 tests 2 2 2 0 0 00:05:21.517 asserts 497 497 497 0 n/a 00:05:21.517 00:05:21.517 Elapsed time = 1.353 seconds 00:05:21.517 EAL: Calling mem event callback 'spdk:(nil)' 00:05:21.517 EAL: request: mp_malloc_sync 00:05:21.517 EAL: No shared files mode enabled, IPC is disabled 00:05:21.517 EAL: Heap on socket 0 was shrunk by 2MB 00:05:21.517 EAL: No shared files mode enabled, IPC is disabled 00:05:21.517 EAL: No shared files mode enabled, IPC is disabled 00:05:21.517 EAL: No shared files mode enabled, IPC is disabled 00:05:21.517 00:05:21.517 real 0m1.474s 00:05:21.517 user 0m0.835s 00:05:21.517 sys 0m0.607s 00:05:21.517 05:01:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.517 05:01:23 -- common/autotest_common.sh@10 -- # set +x 00:05:21.517 ************************************ 00:05:21.517 END TEST env_vtophys 00:05:21.518 ************************************ 00:05:21.778 05:01:23 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:21.778 05:01:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:21.778 05:01:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.778 05:01:23 -- common/autotest_common.sh@10 -- # set +x 00:05:21.778 ************************************ 00:05:21.778 START TEST env_pci 00:05:21.778 ************************************ 00:05:21.778 05:01:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:21.778 00:05:21.778 00:05:21.778 CUnit - A unit testing framework for C - Version 2.1-3 00:05:21.778 http://cunit.sourceforge.net/ 00:05:21.778 00:05:21.778 00:05:21.778 Suite: pci 00:05:21.778 Test: pci_hook ...[2024-11-26 05:01:23.310134] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3170647 has claimed it 00:05:21.778 EAL: Cannot find device (10000:00:01.0) 00:05:21.778 EAL: Failed to attach device on primary process 00:05:21.778 passed 00:05:21.778 00:05:21.778 Run Summary: Type Total Ran Passed Failed Inactive 00:05:21.778 suites 1 1 n/a 0 0 00:05:21.778 tests 1 1 1 0 0 00:05:21.778 asserts 25 25 25 0 n/a 00:05:21.778 00:05:21.778 Elapsed time = 0.022 seconds 00:05:21.778 00:05:21.778 real 0m0.035s 00:05:21.778 user 0m0.009s 00:05:21.778 sys 0m0.026s 00:05:21.778 05:01:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.778 05:01:23 -- common/autotest_common.sh@10 -- # set +x 00:05:21.778 ************************************ 00:05:21.778 END TEST env_pci 00:05:21.778 ************************************ 00:05:21.778 05:01:23 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:21.778 05:01:23 -- env/env.sh@15 -- # uname 00:05:21.778 05:01:23 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:21.778 05:01:23 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:21.778 05:01:23 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:21.778 05:01:23 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:21.778 05:01:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.778 05:01:23 -- common/autotest_common.sh@10 -- # set +x 00:05:21.778 ************************************ 00:05:21.778 START TEST env_dpdk_post_init 00:05:21.778 ************************************ 00:05:21.778 05:01:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:21.778 EAL: Detected CPU lcores: 48 00:05:21.778 EAL: Detected NUMA nodes: 2 00:05:21.778 EAL: Detected shared linkage of DPDK 00:05:21.778 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:21.778 EAL: Selected IOVA mode 'VA' 00:05:21.778 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.778 EAL: VFIO support initialized 00:05:21.778 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:21.778 EAL: Using IOMMU type 1 (Type 1) 00:05:21.778 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:21.778 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:21.778 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:21.778 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:21.778 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:21.778 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:22.037 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:22.037 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:22.037 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:22.037 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:22.037 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:22.037 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:22.037 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:22.037 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:22.037 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:22.037 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:22.975 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:26.266 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:26.266 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:26.266 Starting DPDK initialization... 00:05:26.266 Starting SPDK post initialization... 00:05:26.266 SPDK NVMe probe 00:05:26.266 Attaching to 0000:88:00.0 00:05:26.266 Attached to 0000:88:00.0 00:05:26.266 Cleaning up... 00:05:26.266 00:05:26.266 real 0m4.425s 00:05:26.266 user 0m3.316s 00:05:26.266 sys 0m0.168s 00:05:26.266 05:01:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.266 05:01:27 -- common/autotest_common.sh@10 -- # set +x 00:05:26.266 ************************************ 00:05:26.266 END TEST env_dpdk_post_init 00:05:26.266 ************************************ 00:05:26.266 05:01:27 -- env/env.sh@26 -- # uname 00:05:26.266 05:01:27 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:26.266 05:01:27 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:26.266 05:01:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:26.266 05:01:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.266 05:01:27 -- common/autotest_common.sh@10 -- # set +x 00:05:26.266 ************************************ 00:05:26.266 START TEST env_mem_callbacks 00:05:26.266 ************************************ 00:05:26.266 05:01:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:26.266 EAL: Detected CPU lcores: 48 00:05:26.266 EAL: Detected NUMA nodes: 2 00:05:26.266 EAL: Detected shared linkage of DPDK 00:05:26.266 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:26.266 EAL: Selected IOVA mode 'VA' 00:05:26.266 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.266 EAL: VFIO support initialized 00:05:26.266 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:26.266 00:05:26.266 00:05:26.266 CUnit - A unit testing framework for C - Version 2.1-3 00:05:26.266 http://cunit.sourceforge.net/ 00:05:26.266 00:05:26.266 00:05:26.266 Suite: memory 00:05:26.266 Test: test ... 00:05:26.266 register 0x200000200000 2097152 00:05:26.266 malloc 3145728 00:05:26.266 register 0x200000400000 4194304 00:05:26.266 buf 0x200000500000 len 3145728 PASSED 00:05:26.266 malloc 64 00:05:26.266 buf 0x2000004fff40 len 64 PASSED 00:05:26.266 malloc 4194304 00:05:26.266 register 0x200000800000 6291456 00:05:26.266 buf 0x200000a00000 len 4194304 PASSED 00:05:26.266 free 0x200000500000 3145728 00:05:26.266 free 0x2000004fff40 64 00:05:26.266 unregister 0x200000400000 4194304 PASSED 00:05:26.266 free 0x200000a00000 4194304 00:05:26.266 unregister 0x200000800000 6291456 PASSED 00:05:26.266 malloc 8388608 00:05:26.266 register 0x200000400000 10485760 00:05:26.266 buf 0x200000600000 len 8388608 PASSED 00:05:26.266 free 0x200000600000 8388608 00:05:26.266 unregister 0x200000400000 10485760 PASSED 00:05:26.266 passed 00:05:26.266 00:05:26.266 Run Summary: Type Total Ran Passed Failed Inactive 00:05:26.266 suites 1 1 n/a 0 0 00:05:26.266 tests 1 1 1 0 0 00:05:26.266 asserts 15 15 15 0 n/a 00:05:26.266 00:05:26.266 Elapsed time = 0.005 seconds 00:05:26.266 00:05:26.266 real 0m0.044s 00:05:26.266 user 0m0.015s 00:05:26.266 sys 0m0.028s 00:05:26.266 05:01:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.266 05:01:27 -- common/autotest_common.sh@10 -- # set +x 00:05:26.266 ************************************ 00:05:26.266 END TEST env_mem_callbacks 00:05:26.266 ************************************ 00:05:26.266 00:05:26.266 real 0m6.393s 00:05:26.266 user 0m4.460s 00:05:26.266 sys 0m0.989s 00:05:26.266 05:01:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.266 05:01:27 -- common/autotest_common.sh@10 -- # set +x 00:05:26.266 ************************************ 00:05:26.266 END TEST env 00:05:26.266 ************************************ 00:05:26.266 05:01:27 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:26.266 05:01:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:26.267 05:01:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.267 05:01:27 -- common/autotest_common.sh@10 -- # set +x 00:05:26.267 ************************************ 00:05:26.267 START TEST rpc 00:05:26.267 ************************************ 00:05:26.267 05:01:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:26.267 * Looking for test storage... 00:05:26.267 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:26.267 05:01:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:26.267 05:01:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:26.267 05:01:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:26.525 05:01:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:26.526 05:01:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:26.526 05:01:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:26.526 05:01:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:26.526 05:01:28 -- scripts/common.sh@335 -- # IFS=.-: 00:05:26.526 05:01:28 -- scripts/common.sh@335 -- # read -ra ver1 00:05:26.526 05:01:28 -- scripts/common.sh@336 -- # IFS=.-: 00:05:26.526 05:01:28 -- scripts/common.sh@336 -- # read -ra ver2 00:05:26.526 05:01:28 -- scripts/common.sh@337 -- # local 'op=<' 00:05:26.526 05:01:28 -- scripts/common.sh@339 -- # ver1_l=2 00:05:26.526 05:01:28 -- scripts/common.sh@340 -- # ver2_l=1 00:05:26.526 05:01:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:26.526 05:01:28 -- scripts/common.sh@343 -- # case "$op" in 00:05:26.526 05:01:28 -- scripts/common.sh@344 -- # : 1 00:05:26.526 05:01:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:26.526 05:01:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:26.526 05:01:28 -- scripts/common.sh@364 -- # decimal 1 00:05:26.526 05:01:28 -- scripts/common.sh@352 -- # local d=1 00:05:26.526 05:01:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:26.526 05:01:28 -- scripts/common.sh@354 -- # echo 1 00:05:26.526 05:01:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:26.526 05:01:28 -- scripts/common.sh@365 -- # decimal 2 00:05:26.526 05:01:28 -- scripts/common.sh@352 -- # local d=2 00:05:26.526 05:01:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:26.526 05:01:28 -- scripts/common.sh@354 -- # echo 2 00:05:26.526 05:01:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:26.526 05:01:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:26.526 05:01:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:26.526 05:01:28 -- scripts/common.sh@367 -- # return 0 00:05:26.526 05:01:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:26.526 05:01:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:26.526 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:26.526 --rc genhtml_branch_coverage=1 00:05:26.526 --rc genhtml_function_coverage=1 00:05:26.526 --rc genhtml_legend=1 00:05:26.526 --rc geninfo_all_blocks=1 00:05:26.526 --rc geninfo_unexecuted_blocks=1 00:05:26.526 00:05:26.526 ' 00:05:26.526 05:01:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:26.526 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:26.526 --rc genhtml_branch_coverage=1 00:05:26.526 --rc genhtml_function_coverage=1 00:05:26.526 --rc genhtml_legend=1 00:05:26.526 --rc geninfo_all_blocks=1 00:05:26.526 --rc geninfo_unexecuted_blocks=1 00:05:26.526 00:05:26.526 ' 00:05:26.526 05:01:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:26.526 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:26.526 --rc genhtml_branch_coverage=1 00:05:26.526 --rc genhtml_function_coverage=1 00:05:26.526 --rc genhtml_legend=1 00:05:26.526 --rc geninfo_all_blocks=1 00:05:26.526 --rc geninfo_unexecuted_blocks=1 00:05:26.526 00:05:26.526 ' 00:05:26.526 05:01:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:26.526 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:26.526 --rc genhtml_branch_coverage=1 00:05:26.526 --rc genhtml_function_coverage=1 00:05:26.526 --rc genhtml_legend=1 00:05:26.526 --rc geninfo_all_blocks=1 00:05:26.526 --rc geninfo_unexecuted_blocks=1 00:05:26.526 00:05:26.526 ' 00:05:26.526 05:01:28 -- rpc/rpc.sh@65 -- # spdk_pid=3171318 00:05:26.526 05:01:28 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:26.526 05:01:28 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:26.526 05:01:28 -- rpc/rpc.sh@67 -- # waitforlisten 3171318 00:05:26.526 05:01:28 -- common/autotest_common.sh@829 -- # '[' -z 3171318 ']' 00:05:26.526 05:01:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:26.526 05:01:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:26.526 05:01:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:26.526 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:26.526 05:01:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:26.526 05:01:28 -- common/autotest_common.sh@10 -- # set +x 00:05:26.526 [2024-11-26 05:01:28.089039] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.526 [2024-11-26 05:01:28.089119] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3171318 ] 00:05:26.526 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.526 [2024-11-26 05:01:28.154962] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.526 [2024-11-26 05:01:28.244930] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:26.526 [2024-11-26 05:01:28.245119] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:26.526 [2024-11-26 05:01:28.245141] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3171318' to capture a snapshot of events at runtime. 00:05:26.526 [2024-11-26 05:01:28.245155] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3171318 for offline analysis/debug. 00:05:26.526 [2024-11-26 05:01:28.245188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.464 05:01:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:27.464 05:01:29 -- common/autotest_common.sh@862 -- # return 0 00:05:27.464 05:01:29 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:27.464 05:01:29 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:27.464 05:01:29 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:27.464 05:01:29 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:27.464 05:01:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.464 05:01:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.464 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.464 ************************************ 00:05:27.464 START TEST rpc_integrity 00:05:27.464 ************************************ 00:05:27.464 05:01:29 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:27.464 05:01:29 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:27.464 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.464 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.464 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.464 05:01:29 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:27.464 05:01:29 -- rpc/rpc.sh@13 -- # jq length 00:05:27.464 05:01:29 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:27.464 05:01:29 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:27.464 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.464 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.464 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.464 05:01:29 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:27.464 05:01:29 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:27.464 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.464 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.464 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.464 05:01:29 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:27.464 { 00:05:27.464 "name": "Malloc0", 00:05:27.464 "aliases": [ 00:05:27.464 "6ed25c30-c841-49e2-b5b1-fb67dca26cd1" 00:05:27.464 ], 00:05:27.464 "product_name": "Malloc disk", 00:05:27.464 "block_size": 512, 00:05:27.464 "num_blocks": 16384, 00:05:27.464 "uuid": "6ed25c30-c841-49e2-b5b1-fb67dca26cd1", 00:05:27.464 "assigned_rate_limits": { 00:05:27.464 "rw_ios_per_sec": 0, 00:05:27.464 "rw_mbytes_per_sec": 0, 00:05:27.464 "r_mbytes_per_sec": 0, 00:05:27.464 "w_mbytes_per_sec": 0 00:05:27.464 }, 00:05:27.464 "claimed": false, 00:05:27.464 "zoned": false, 00:05:27.464 "supported_io_types": { 00:05:27.464 "read": true, 00:05:27.464 "write": true, 00:05:27.464 "unmap": true, 00:05:27.464 "write_zeroes": true, 00:05:27.464 "flush": true, 00:05:27.464 "reset": true, 00:05:27.464 "compare": false, 00:05:27.464 "compare_and_write": false, 00:05:27.464 "abort": true, 00:05:27.464 "nvme_admin": false, 00:05:27.464 "nvme_io": false 00:05:27.464 }, 00:05:27.464 "memory_domains": [ 00:05:27.464 { 00:05:27.464 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:27.464 "dma_device_type": 2 00:05:27.464 } 00:05:27.464 ], 00:05:27.464 "driver_specific": {} 00:05:27.464 } 00:05:27.464 ]' 00:05:27.464 05:01:29 -- rpc/rpc.sh@17 -- # jq length 00:05:27.464 05:01:29 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:27.464 05:01:29 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:27.464 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.464 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.464 [2024-11-26 05:01:29.154587] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:27.464 [2024-11-26 05:01:29.154641] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:27.464 [2024-11-26 05:01:29.154668] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x9dcbf0 00:05:27.464 [2024-11-26 05:01:29.154684] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:27.464 [2024-11-26 05:01:29.156217] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:27.464 [2024-11-26 05:01:29.156245] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:27.464 Passthru0 00:05:27.464 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.464 05:01:29 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:27.464 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.464 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.464 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.464 05:01:29 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:27.464 { 00:05:27.464 "name": "Malloc0", 00:05:27.464 "aliases": [ 00:05:27.464 "6ed25c30-c841-49e2-b5b1-fb67dca26cd1" 00:05:27.464 ], 00:05:27.464 "product_name": "Malloc disk", 00:05:27.464 "block_size": 512, 00:05:27.464 "num_blocks": 16384, 00:05:27.464 "uuid": "6ed25c30-c841-49e2-b5b1-fb67dca26cd1", 00:05:27.464 "assigned_rate_limits": { 00:05:27.464 "rw_ios_per_sec": 0, 00:05:27.464 "rw_mbytes_per_sec": 0, 00:05:27.464 "r_mbytes_per_sec": 0, 00:05:27.464 "w_mbytes_per_sec": 0 00:05:27.464 }, 00:05:27.464 "claimed": true, 00:05:27.464 "claim_type": "exclusive_write", 00:05:27.464 "zoned": false, 00:05:27.464 "supported_io_types": { 00:05:27.464 "read": true, 00:05:27.464 "write": true, 00:05:27.464 "unmap": true, 00:05:27.464 "write_zeroes": true, 00:05:27.464 "flush": true, 00:05:27.464 "reset": true, 00:05:27.464 "compare": false, 00:05:27.464 "compare_and_write": false, 00:05:27.464 "abort": true, 00:05:27.464 "nvme_admin": false, 00:05:27.464 "nvme_io": false 00:05:27.464 }, 00:05:27.464 "memory_domains": [ 00:05:27.464 { 00:05:27.464 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:27.464 "dma_device_type": 2 00:05:27.464 } 00:05:27.464 ], 00:05:27.464 "driver_specific": {} 00:05:27.464 }, 00:05:27.464 { 00:05:27.464 "name": "Passthru0", 00:05:27.464 "aliases": [ 00:05:27.464 "bb579b6f-00be-5b9a-9c60-82488956f43c" 00:05:27.464 ], 00:05:27.464 "product_name": "passthru", 00:05:27.464 "block_size": 512, 00:05:27.464 "num_blocks": 16384, 00:05:27.464 "uuid": "bb579b6f-00be-5b9a-9c60-82488956f43c", 00:05:27.464 "assigned_rate_limits": { 00:05:27.464 "rw_ios_per_sec": 0, 00:05:27.464 "rw_mbytes_per_sec": 0, 00:05:27.464 "r_mbytes_per_sec": 0, 00:05:27.464 "w_mbytes_per_sec": 0 00:05:27.464 }, 00:05:27.464 "claimed": false, 00:05:27.464 "zoned": false, 00:05:27.464 "supported_io_types": { 00:05:27.464 "read": true, 00:05:27.464 "write": true, 00:05:27.464 "unmap": true, 00:05:27.464 "write_zeroes": true, 00:05:27.464 "flush": true, 00:05:27.464 "reset": true, 00:05:27.464 "compare": false, 00:05:27.464 "compare_and_write": false, 00:05:27.464 "abort": true, 00:05:27.464 "nvme_admin": false, 00:05:27.464 "nvme_io": false 00:05:27.464 }, 00:05:27.464 "memory_domains": [ 00:05:27.464 { 00:05:27.464 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:27.464 "dma_device_type": 2 00:05:27.464 } 00:05:27.464 ], 00:05:27.464 "driver_specific": { 00:05:27.464 "passthru": { 00:05:27.464 "name": "Passthru0", 00:05:27.464 "base_bdev_name": "Malloc0" 00:05:27.464 } 00:05:27.464 } 00:05:27.464 } 00:05:27.464 ]' 00:05:27.464 05:01:29 -- rpc/rpc.sh@21 -- # jq length 00:05:27.465 05:01:29 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:27.465 05:01:29 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:27.465 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.465 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.465 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.465 05:01:29 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:27.465 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.465 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.465 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.465 05:01:29 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:27.724 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.724 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.724 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.724 05:01:29 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:27.724 05:01:29 -- rpc/rpc.sh@26 -- # jq length 00:05:27.724 05:01:29 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:27.724 00:05:27.724 real 0m0.230s 00:05:27.724 user 0m0.154s 00:05:27.724 sys 0m0.016s 00:05:27.724 05:01:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.724 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.724 ************************************ 00:05:27.724 END TEST rpc_integrity 00:05:27.724 ************************************ 00:05:27.724 05:01:29 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:27.724 05:01:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.724 05:01:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.724 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.724 ************************************ 00:05:27.724 START TEST rpc_plugins 00:05:27.724 ************************************ 00:05:27.724 05:01:29 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:27.724 05:01:29 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:27.724 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.724 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.724 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.724 05:01:29 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:27.724 05:01:29 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:27.724 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.724 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.725 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.725 05:01:29 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:27.725 { 00:05:27.725 "name": "Malloc1", 00:05:27.725 "aliases": [ 00:05:27.725 "586aff85-1ea9-4bd6-a9a2-46d60ca6c289" 00:05:27.725 ], 00:05:27.725 "product_name": "Malloc disk", 00:05:27.725 "block_size": 4096, 00:05:27.725 "num_blocks": 256, 00:05:27.725 "uuid": "586aff85-1ea9-4bd6-a9a2-46d60ca6c289", 00:05:27.725 "assigned_rate_limits": { 00:05:27.725 "rw_ios_per_sec": 0, 00:05:27.725 "rw_mbytes_per_sec": 0, 00:05:27.725 "r_mbytes_per_sec": 0, 00:05:27.725 "w_mbytes_per_sec": 0 00:05:27.725 }, 00:05:27.725 "claimed": false, 00:05:27.725 "zoned": false, 00:05:27.725 "supported_io_types": { 00:05:27.725 "read": true, 00:05:27.725 "write": true, 00:05:27.725 "unmap": true, 00:05:27.725 "write_zeroes": true, 00:05:27.725 "flush": true, 00:05:27.725 "reset": true, 00:05:27.725 "compare": false, 00:05:27.725 "compare_and_write": false, 00:05:27.725 "abort": true, 00:05:27.725 "nvme_admin": false, 00:05:27.725 "nvme_io": false 00:05:27.725 }, 00:05:27.725 "memory_domains": [ 00:05:27.725 { 00:05:27.725 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:27.725 "dma_device_type": 2 00:05:27.725 } 00:05:27.725 ], 00:05:27.725 "driver_specific": {} 00:05:27.725 } 00:05:27.725 ]' 00:05:27.725 05:01:29 -- rpc/rpc.sh@32 -- # jq length 00:05:27.725 05:01:29 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:27.725 05:01:29 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:27.725 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.725 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.725 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.725 05:01:29 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:27.725 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.725 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.725 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.725 05:01:29 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:27.725 05:01:29 -- rpc/rpc.sh@36 -- # jq length 00:05:27.725 05:01:29 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:27.725 00:05:27.725 real 0m0.113s 00:05:27.725 user 0m0.071s 00:05:27.725 sys 0m0.012s 00:05:27.725 05:01:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.725 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.725 ************************************ 00:05:27.725 END TEST rpc_plugins 00:05:27.725 ************************************ 00:05:27.725 05:01:29 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:27.725 05:01:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.725 05:01:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.725 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.725 ************************************ 00:05:27.725 START TEST rpc_trace_cmd_test 00:05:27.725 ************************************ 00:05:27.725 05:01:29 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:27.725 05:01:29 -- rpc/rpc.sh@40 -- # local info 00:05:27.725 05:01:29 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:27.725 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.725 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.725 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.725 05:01:29 -- rpc/rpc.sh@42 -- # info='{ 00:05:27.725 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3171318", 00:05:27.725 "tpoint_group_mask": "0x8", 00:05:27.725 "iscsi_conn": { 00:05:27.725 "mask": "0x2", 00:05:27.725 "tpoint_mask": "0x0" 00:05:27.725 }, 00:05:27.725 "scsi": { 00:05:27.725 "mask": "0x4", 00:05:27.725 "tpoint_mask": "0x0" 00:05:27.725 }, 00:05:27.725 "bdev": { 00:05:27.725 "mask": "0x8", 00:05:27.725 "tpoint_mask": "0xffffffffffffffff" 00:05:27.725 }, 00:05:27.725 "nvmf_rdma": { 00:05:27.725 "mask": "0x10", 00:05:27.725 "tpoint_mask": "0x0" 00:05:27.725 }, 00:05:27.725 "nvmf_tcp": { 00:05:27.725 "mask": "0x20", 00:05:27.725 "tpoint_mask": "0x0" 00:05:27.725 }, 00:05:27.725 "ftl": { 00:05:27.725 "mask": "0x40", 00:05:27.725 "tpoint_mask": "0x0" 00:05:27.725 }, 00:05:27.725 "blobfs": { 00:05:27.725 "mask": "0x80", 00:05:27.725 "tpoint_mask": "0x0" 00:05:27.725 }, 00:05:27.725 "dsa": { 00:05:27.725 "mask": "0x200", 00:05:27.725 "tpoint_mask": "0x0" 00:05:27.725 }, 00:05:27.725 "thread": { 00:05:27.725 "mask": "0x400", 00:05:27.725 "tpoint_mask": "0x0" 00:05:27.725 }, 00:05:27.725 "nvme_pcie": { 00:05:27.725 "mask": "0x800", 00:05:27.725 "tpoint_mask": "0x0" 00:05:27.725 }, 00:05:27.725 "iaa": { 00:05:27.725 "mask": "0x1000", 00:05:27.725 "tpoint_mask": "0x0" 00:05:27.725 }, 00:05:27.725 "nvme_tcp": { 00:05:27.725 "mask": "0x2000", 00:05:27.725 "tpoint_mask": "0x0" 00:05:27.725 }, 00:05:27.725 "bdev_nvme": { 00:05:27.725 "mask": "0x4000", 00:05:27.725 "tpoint_mask": "0x0" 00:05:27.725 } 00:05:27.725 }' 00:05:27.725 05:01:29 -- rpc/rpc.sh@43 -- # jq length 00:05:27.984 05:01:29 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:27.984 05:01:29 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:27.984 05:01:29 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:27.984 05:01:29 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:27.984 05:01:29 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:27.984 05:01:29 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:27.984 05:01:29 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:27.984 05:01:29 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:27.984 05:01:29 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:27.984 00:05:27.984 real 0m0.198s 00:05:27.984 user 0m0.175s 00:05:27.984 sys 0m0.013s 00:05:27.984 05:01:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.984 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.984 ************************************ 00:05:27.984 END TEST rpc_trace_cmd_test 00:05:27.984 ************************************ 00:05:27.984 05:01:29 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:27.984 05:01:29 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:27.984 05:01:29 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:27.984 05:01:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.984 05:01:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.984 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.984 ************************************ 00:05:27.984 START TEST rpc_daemon_integrity 00:05:27.984 ************************************ 00:05:27.984 05:01:29 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:27.984 05:01:29 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:27.984 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.984 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.984 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.984 05:01:29 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:27.984 05:01:29 -- rpc/rpc.sh@13 -- # jq length 00:05:27.984 05:01:29 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:27.984 05:01:29 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:27.984 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.984 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.984 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.984 05:01:29 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:27.984 05:01:29 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:27.984 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.984 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:27.984 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.984 05:01:29 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:27.984 { 00:05:27.984 "name": "Malloc2", 00:05:27.984 "aliases": [ 00:05:27.984 "33789521-523c-41f7-b987-ea2db6971488" 00:05:27.984 ], 00:05:27.984 "product_name": "Malloc disk", 00:05:27.984 "block_size": 512, 00:05:27.984 "num_blocks": 16384, 00:05:27.984 "uuid": "33789521-523c-41f7-b987-ea2db6971488", 00:05:27.984 "assigned_rate_limits": { 00:05:27.984 "rw_ios_per_sec": 0, 00:05:27.984 "rw_mbytes_per_sec": 0, 00:05:27.984 "r_mbytes_per_sec": 0, 00:05:27.984 "w_mbytes_per_sec": 0 00:05:27.984 }, 00:05:27.984 "claimed": false, 00:05:27.984 "zoned": false, 00:05:27.984 "supported_io_types": { 00:05:27.984 "read": true, 00:05:27.984 "write": true, 00:05:27.984 "unmap": true, 00:05:27.984 "write_zeroes": true, 00:05:27.984 "flush": true, 00:05:27.984 "reset": true, 00:05:27.984 "compare": false, 00:05:27.984 "compare_and_write": false, 00:05:27.984 "abort": true, 00:05:27.984 "nvme_admin": false, 00:05:27.984 "nvme_io": false 00:05:27.984 }, 00:05:27.984 "memory_domains": [ 00:05:27.984 { 00:05:27.984 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:27.984 "dma_device_type": 2 00:05:27.984 } 00:05:27.984 ], 00:05:27.984 "driver_specific": {} 00:05:27.984 } 00:05:27.984 ]' 00:05:27.984 05:01:29 -- rpc/rpc.sh@17 -- # jq length 00:05:28.246 05:01:29 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:28.246 05:01:29 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:28.246 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:28.246 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:28.246 [2024-11-26 05:01:29.768363] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:28.246 [2024-11-26 05:01:29.768411] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:28.246 [2024-11-26 05:01:29.768436] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xb7c940 00:05:28.246 [2024-11-26 05:01:29.768451] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:28.246 [2024-11-26 05:01:29.769807] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:28.246 [2024-11-26 05:01:29.769832] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:28.246 Passthru0 00:05:28.246 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:28.246 05:01:29 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:28.246 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:28.246 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:28.246 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:28.246 05:01:29 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:28.246 { 00:05:28.246 "name": "Malloc2", 00:05:28.246 "aliases": [ 00:05:28.246 "33789521-523c-41f7-b987-ea2db6971488" 00:05:28.246 ], 00:05:28.246 "product_name": "Malloc disk", 00:05:28.246 "block_size": 512, 00:05:28.246 "num_blocks": 16384, 00:05:28.246 "uuid": "33789521-523c-41f7-b987-ea2db6971488", 00:05:28.246 "assigned_rate_limits": { 00:05:28.246 "rw_ios_per_sec": 0, 00:05:28.246 "rw_mbytes_per_sec": 0, 00:05:28.246 "r_mbytes_per_sec": 0, 00:05:28.246 "w_mbytes_per_sec": 0 00:05:28.246 }, 00:05:28.246 "claimed": true, 00:05:28.246 "claim_type": "exclusive_write", 00:05:28.246 "zoned": false, 00:05:28.246 "supported_io_types": { 00:05:28.246 "read": true, 00:05:28.246 "write": true, 00:05:28.246 "unmap": true, 00:05:28.246 "write_zeroes": true, 00:05:28.246 "flush": true, 00:05:28.246 "reset": true, 00:05:28.246 "compare": false, 00:05:28.246 "compare_and_write": false, 00:05:28.246 "abort": true, 00:05:28.246 "nvme_admin": false, 00:05:28.246 "nvme_io": false 00:05:28.246 }, 00:05:28.246 "memory_domains": [ 00:05:28.246 { 00:05:28.246 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:28.246 "dma_device_type": 2 00:05:28.246 } 00:05:28.246 ], 00:05:28.246 "driver_specific": {} 00:05:28.246 }, 00:05:28.246 { 00:05:28.246 "name": "Passthru0", 00:05:28.246 "aliases": [ 00:05:28.246 "5bf00a92-5ad0-56de-a1d0-7b8480a71a25" 00:05:28.246 ], 00:05:28.246 "product_name": "passthru", 00:05:28.246 "block_size": 512, 00:05:28.246 "num_blocks": 16384, 00:05:28.246 "uuid": "5bf00a92-5ad0-56de-a1d0-7b8480a71a25", 00:05:28.246 "assigned_rate_limits": { 00:05:28.246 "rw_ios_per_sec": 0, 00:05:28.246 "rw_mbytes_per_sec": 0, 00:05:28.246 "r_mbytes_per_sec": 0, 00:05:28.246 "w_mbytes_per_sec": 0 00:05:28.246 }, 00:05:28.246 "claimed": false, 00:05:28.246 "zoned": false, 00:05:28.246 "supported_io_types": { 00:05:28.246 "read": true, 00:05:28.246 "write": true, 00:05:28.246 "unmap": true, 00:05:28.246 "write_zeroes": true, 00:05:28.246 "flush": true, 00:05:28.246 "reset": true, 00:05:28.246 "compare": false, 00:05:28.246 "compare_and_write": false, 00:05:28.246 "abort": true, 00:05:28.246 "nvme_admin": false, 00:05:28.246 "nvme_io": false 00:05:28.246 }, 00:05:28.246 "memory_domains": [ 00:05:28.246 { 00:05:28.246 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:28.246 "dma_device_type": 2 00:05:28.246 } 00:05:28.246 ], 00:05:28.246 "driver_specific": { 00:05:28.246 "passthru": { 00:05:28.246 "name": "Passthru0", 00:05:28.246 "base_bdev_name": "Malloc2" 00:05:28.246 } 00:05:28.246 } 00:05:28.246 } 00:05:28.246 ]' 00:05:28.246 05:01:29 -- rpc/rpc.sh@21 -- # jq length 00:05:28.246 05:01:29 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:28.246 05:01:29 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:28.246 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:28.246 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:28.246 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:28.246 05:01:29 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:28.246 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:28.246 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:28.246 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:28.246 05:01:29 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:28.246 05:01:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:28.246 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:28.246 05:01:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:28.246 05:01:29 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:28.246 05:01:29 -- rpc/rpc.sh@26 -- # jq length 00:05:28.246 05:01:29 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:28.246 00:05:28.246 real 0m0.222s 00:05:28.246 user 0m0.151s 00:05:28.246 sys 0m0.020s 00:05:28.246 05:01:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.246 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:05:28.246 ************************************ 00:05:28.246 END TEST rpc_daemon_integrity 00:05:28.246 ************************************ 00:05:28.246 05:01:29 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:28.246 05:01:29 -- rpc/rpc.sh@84 -- # killprocess 3171318 00:05:28.246 05:01:29 -- common/autotest_common.sh@936 -- # '[' -z 3171318 ']' 00:05:28.246 05:01:29 -- common/autotest_common.sh@940 -- # kill -0 3171318 00:05:28.246 05:01:29 -- common/autotest_common.sh@941 -- # uname 00:05:28.246 05:01:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:28.246 05:01:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3171318 00:05:28.246 05:01:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:28.246 05:01:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:28.246 05:01:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3171318' 00:05:28.246 killing process with pid 3171318 00:05:28.246 05:01:29 -- common/autotest_common.sh@955 -- # kill 3171318 00:05:28.246 05:01:29 -- common/autotest_common.sh@960 -- # wait 3171318 00:05:28.815 00:05:28.815 real 0m2.446s 00:05:28.815 user 0m3.082s 00:05:28.815 sys 0m0.598s 00:05:28.815 05:01:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.815 05:01:30 -- common/autotest_common.sh@10 -- # set +x 00:05:28.815 ************************************ 00:05:28.815 END TEST rpc 00:05:28.815 ************************************ 00:05:28.815 05:01:30 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:28.815 05:01:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:28.815 05:01:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.815 05:01:30 -- common/autotest_common.sh@10 -- # set +x 00:05:28.815 ************************************ 00:05:28.815 START TEST rpc_client 00:05:28.815 ************************************ 00:05:28.815 05:01:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:28.815 * Looking for test storage... 00:05:28.815 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:28.815 05:01:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:28.815 05:01:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:28.815 05:01:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:28.815 05:01:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:28.815 05:01:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:28.815 05:01:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:28.815 05:01:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:28.815 05:01:30 -- scripts/common.sh@335 -- # IFS=.-: 00:05:28.815 05:01:30 -- scripts/common.sh@335 -- # read -ra ver1 00:05:28.815 05:01:30 -- scripts/common.sh@336 -- # IFS=.-: 00:05:28.815 05:01:30 -- scripts/common.sh@336 -- # read -ra ver2 00:05:28.815 05:01:30 -- scripts/common.sh@337 -- # local 'op=<' 00:05:28.815 05:01:30 -- scripts/common.sh@339 -- # ver1_l=2 00:05:28.815 05:01:30 -- scripts/common.sh@340 -- # ver2_l=1 00:05:28.815 05:01:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:28.815 05:01:30 -- scripts/common.sh@343 -- # case "$op" in 00:05:28.815 05:01:30 -- scripts/common.sh@344 -- # : 1 00:05:28.815 05:01:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:28.815 05:01:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:28.815 05:01:30 -- scripts/common.sh@364 -- # decimal 1 00:05:28.815 05:01:30 -- scripts/common.sh@352 -- # local d=1 00:05:28.815 05:01:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:28.815 05:01:30 -- scripts/common.sh@354 -- # echo 1 00:05:28.815 05:01:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:28.815 05:01:30 -- scripts/common.sh@365 -- # decimal 2 00:05:28.815 05:01:30 -- scripts/common.sh@352 -- # local d=2 00:05:28.815 05:01:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:28.815 05:01:30 -- scripts/common.sh@354 -- # echo 2 00:05:28.815 05:01:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:28.815 05:01:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:28.815 05:01:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:28.815 05:01:30 -- scripts/common.sh@367 -- # return 0 00:05:28.815 05:01:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:28.815 05:01:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:28.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:28.815 --rc genhtml_branch_coverage=1 00:05:28.815 --rc genhtml_function_coverage=1 00:05:28.815 --rc genhtml_legend=1 00:05:28.815 --rc geninfo_all_blocks=1 00:05:28.815 --rc geninfo_unexecuted_blocks=1 00:05:28.815 00:05:28.815 ' 00:05:28.815 05:01:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:28.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:28.815 --rc genhtml_branch_coverage=1 00:05:28.815 --rc genhtml_function_coverage=1 00:05:28.815 --rc genhtml_legend=1 00:05:28.815 --rc geninfo_all_blocks=1 00:05:28.815 --rc geninfo_unexecuted_blocks=1 00:05:28.815 00:05:28.815 ' 00:05:28.815 05:01:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:28.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:28.815 --rc genhtml_branch_coverage=1 00:05:28.816 --rc genhtml_function_coverage=1 00:05:28.816 --rc genhtml_legend=1 00:05:28.816 --rc geninfo_all_blocks=1 00:05:28.816 --rc geninfo_unexecuted_blocks=1 00:05:28.816 00:05:28.816 ' 00:05:28.816 05:01:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:28.816 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:28.816 --rc genhtml_branch_coverage=1 00:05:28.816 --rc genhtml_function_coverage=1 00:05:28.816 --rc genhtml_legend=1 00:05:28.816 --rc geninfo_all_blocks=1 00:05:28.816 --rc geninfo_unexecuted_blocks=1 00:05:28.816 00:05:28.816 ' 00:05:28.816 05:01:30 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:28.816 OK 00:05:28.816 05:01:30 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:28.816 00:05:28.816 real 0m0.154s 00:05:28.816 user 0m0.102s 00:05:28.816 sys 0m0.061s 00:05:28.816 05:01:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.816 05:01:30 -- common/autotest_common.sh@10 -- # set +x 00:05:28.816 ************************************ 00:05:28.816 END TEST rpc_client 00:05:28.816 ************************************ 00:05:28.816 05:01:30 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:28.816 05:01:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:28.816 05:01:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.816 05:01:30 -- common/autotest_common.sh@10 -- # set +x 00:05:28.816 ************************************ 00:05:28.816 START TEST json_config 00:05:28.816 ************************************ 00:05:28.816 05:01:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:29.075 05:01:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:29.075 05:01:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:29.075 05:01:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:29.075 05:01:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:29.075 05:01:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:29.075 05:01:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:29.075 05:01:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:29.075 05:01:30 -- scripts/common.sh@335 -- # IFS=.-: 00:05:29.075 05:01:30 -- scripts/common.sh@335 -- # read -ra ver1 00:05:29.075 05:01:30 -- scripts/common.sh@336 -- # IFS=.-: 00:05:29.075 05:01:30 -- scripts/common.sh@336 -- # read -ra ver2 00:05:29.075 05:01:30 -- scripts/common.sh@337 -- # local 'op=<' 00:05:29.075 05:01:30 -- scripts/common.sh@339 -- # ver1_l=2 00:05:29.075 05:01:30 -- scripts/common.sh@340 -- # ver2_l=1 00:05:29.075 05:01:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:29.075 05:01:30 -- scripts/common.sh@343 -- # case "$op" in 00:05:29.075 05:01:30 -- scripts/common.sh@344 -- # : 1 00:05:29.075 05:01:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:29.075 05:01:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:29.075 05:01:30 -- scripts/common.sh@364 -- # decimal 1 00:05:29.075 05:01:30 -- scripts/common.sh@352 -- # local d=1 00:05:29.075 05:01:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:29.075 05:01:30 -- scripts/common.sh@354 -- # echo 1 00:05:29.075 05:01:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:29.075 05:01:30 -- scripts/common.sh@365 -- # decimal 2 00:05:29.075 05:01:30 -- scripts/common.sh@352 -- # local d=2 00:05:29.075 05:01:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:29.075 05:01:30 -- scripts/common.sh@354 -- # echo 2 00:05:29.075 05:01:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:29.075 05:01:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:29.075 05:01:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:29.075 05:01:30 -- scripts/common.sh@367 -- # return 0 00:05:29.075 05:01:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:29.075 05:01:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:29.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:29.075 --rc genhtml_branch_coverage=1 00:05:29.075 --rc genhtml_function_coverage=1 00:05:29.075 --rc genhtml_legend=1 00:05:29.075 --rc geninfo_all_blocks=1 00:05:29.075 --rc geninfo_unexecuted_blocks=1 00:05:29.075 00:05:29.075 ' 00:05:29.075 05:01:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:29.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:29.075 --rc genhtml_branch_coverage=1 00:05:29.075 --rc genhtml_function_coverage=1 00:05:29.075 --rc genhtml_legend=1 00:05:29.075 --rc geninfo_all_blocks=1 00:05:29.075 --rc geninfo_unexecuted_blocks=1 00:05:29.075 00:05:29.075 ' 00:05:29.075 05:01:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:29.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:29.075 --rc genhtml_branch_coverage=1 00:05:29.075 --rc genhtml_function_coverage=1 00:05:29.075 --rc genhtml_legend=1 00:05:29.075 --rc geninfo_all_blocks=1 00:05:29.075 --rc geninfo_unexecuted_blocks=1 00:05:29.075 00:05:29.075 ' 00:05:29.075 05:01:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:29.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:29.075 --rc genhtml_branch_coverage=1 00:05:29.075 --rc genhtml_function_coverage=1 00:05:29.075 --rc genhtml_legend=1 00:05:29.075 --rc geninfo_all_blocks=1 00:05:29.075 --rc geninfo_unexecuted_blocks=1 00:05:29.075 00:05:29.075 ' 00:05:29.075 05:01:30 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:29.075 05:01:30 -- nvmf/common.sh@7 -- # uname -s 00:05:29.075 05:01:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:29.075 05:01:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:29.075 05:01:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:29.075 05:01:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:29.075 05:01:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:29.075 05:01:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:29.075 05:01:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:29.075 05:01:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:29.075 05:01:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:29.075 05:01:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:29.075 05:01:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:29.075 05:01:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:29.075 05:01:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:29.075 05:01:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:29.075 05:01:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:29.075 05:01:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:29.075 05:01:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:29.075 05:01:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:29.075 05:01:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:29.075 05:01:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:29.075 05:01:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:29.075 05:01:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:29.075 05:01:30 -- paths/export.sh@5 -- # export PATH 00:05:29.075 05:01:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:29.075 05:01:30 -- nvmf/common.sh@46 -- # : 0 00:05:29.075 05:01:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:29.075 05:01:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:29.075 05:01:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:29.075 05:01:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:29.075 05:01:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:29.075 05:01:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:29.075 05:01:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:29.075 05:01:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:29.075 05:01:30 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:29.075 05:01:30 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:29.075 05:01:30 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:29.075 05:01:30 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:29.075 05:01:30 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:29.075 05:01:30 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:29.076 05:01:30 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:29.076 05:01:30 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:29.076 05:01:30 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:29.076 05:01:30 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:29.076 05:01:30 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:29.076 05:01:30 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:29.076 05:01:30 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:29.076 05:01:30 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:29.076 05:01:30 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:29.076 INFO: JSON configuration test init 00:05:29.076 05:01:30 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:29.076 05:01:30 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:29.076 05:01:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:29.076 05:01:30 -- common/autotest_common.sh@10 -- # set +x 00:05:29.076 05:01:30 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:29.076 05:01:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:29.076 05:01:30 -- common/autotest_common.sh@10 -- # set +x 00:05:29.076 05:01:30 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:29.076 05:01:30 -- json_config/json_config.sh@98 -- # local app=target 00:05:29.076 05:01:30 -- json_config/json_config.sh@99 -- # shift 00:05:29.076 05:01:30 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:29.076 05:01:30 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:29.076 05:01:30 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:29.076 05:01:30 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:29.076 05:01:30 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:29.076 05:01:30 -- json_config/json_config.sh@111 -- # app_pid[$app]=3171814 00:05:29.076 05:01:30 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:29.076 05:01:30 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:29.076 Waiting for target to run... 00:05:29.076 05:01:30 -- json_config/json_config.sh@114 -- # waitforlisten 3171814 /var/tmp/spdk_tgt.sock 00:05:29.076 05:01:30 -- common/autotest_common.sh@829 -- # '[' -z 3171814 ']' 00:05:29.076 05:01:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:29.076 05:01:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:29.076 05:01:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:29.076 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:29.076 05:01:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:29.076 05:01:30 -- common/autotest_common.sh@10 -- # set +x 00:05:29.076 [2024-11-26 05:01:30.741612] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.076 [2024-11-26 05:01:30.741706] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3171814 ] 00:05:29.076 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.644 [2024-11-26 05:01:31.258064] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.644 [2024-11-26 05:01:31.332097] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:29.644 [2024-11-26 05:01:31.332298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.210 05:01:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:30.210 05:01:31 -- common/autotest_common.sh@862 -- # return 0 00:05:30.210 05:01:31 -- json_config/json_config.sh@115 -- # echo '' 00:05:30.210 00:05:30.210 05:01:31 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:30.210 05:01:31 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:30.210 05:01:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:30.210 05:01:31 -- common/autotest_common.sh@10 -- # set +x 00:05:30.210 05:01:31 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:30.210 05:01:31 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:30.210 05:01:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:30.210 05:01:31 -- common/autotest_common.sh@10 -- # set +x 00:05:30.210 05:01:31 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:30.210 05:01:31 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:30.210 05:01:31 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:33.590 05:01:34 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:33.590 05:01:34 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:33.590 05:01:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:33.590 05:01:34 -- common/autotest_common.sh@10 -- # set +x 00:05:33.590 05:01:34 -- json_config/json_config.sh@48 -- # local ret=0 00:05:33.590 05:01:34 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:33.590 05:01:34 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:33.590 05:01:34 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:33.590 05:01:34 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:33.590 05:01:34 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:33.590 05:01:35 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:33.590 05:01:35 -- json_config/json_config.sh@51 -- # local get_types 00:05:33.590 05:01:35 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:33.590 05:01:35 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:33.590 05:01:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:33.590 05:01:35 -- common/autotest_common.sh@10 -- # set +x 00:05:33.590 05:01:35 -- json_config/json_config.sh@58 -- # return 0 00:05:33.590 05:01:35 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:33.590 05:01:35 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:33.590 05:01:35 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:33.590 05:01:35 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:33.590 05:01:35 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:33.590 05:01:35 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:33.590 05:01:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:33.590 05:01:35 -- common/autotest_common.sh@10 -- # set +x 00:05:33.590 05:01:35 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:33.590 05:01:35 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:33.590 05:01:35 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:33.590 05:01:35 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:33.590 05:01:35 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:33.848 MallocForNvmf0 00:05:33.848 05:01:35 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:33.848 05:01:35 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:34.106 MallocForNvmf1 00:05:34.106 05:01:35 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:34.106 05:01:35 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:34.364 [2024-11-26 05:01:35.965397] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:34.364 05:01:35 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:34.364 05:01:35 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:34.622 05:01:36 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:34.622 05:01:36 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:34.880 05:01:36 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:34.880 05:01:36 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:35.138 05:01:36 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:35.138 05:01:36 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:35.398 [2024-11-26 05:01:36.964728] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:35.398 05:01:36 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:35.398 05:01:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:35.398 05:01:36 -- common/autotest_common.sh@10 -- # set +x 00:05:35.398 05:01:37 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:35.398 05:01:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:35.398 05:01:37 -- common/autotest_common.sh@10 -- # set +x 00:05:35.398 05:01:37 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:35.398 05:01:37 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:35.398 05:01:37 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:35.658 MallocBdevForConfigChangeCheck 00:05:35.658 05:01:37 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:35.658 05:01:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:35.658 05:01:37 -- common/autotest_common.sh@10 -- # set +x 00:05:35.658 05:01:37 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:35.658 05:01:37 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:35.917 05:01:37 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:35.917 INFO: shutting down applications... 00:05:35.917 05:01:37 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:35.917 05:01:37 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:35.917 05:01:37 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:35.917 05:01:37 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:37.828 Calling clear_iscsi_subsystem 00:05:37.828 Calling clear_nvmf_subsystem 00:05:37.828 Calling clear_nbd_subsystem 00:05:37.828 Calling clear_ublk_subsystem 00:05:37.828 Calling clear_vhost_blk_subsystem 00:05:37.828 Calling clear_vhost_scsi_subsystem 00:05:37.828 Calling clear_scheduler_subsystem 00:05:37.828 Calling clear_bdev_subsystem 00:05:37.828 Calling clear_accel_subsystem 00:05:37.828 Calling clear_vmd_subsystem 00:05:37.828 Calling clear_sock_subsystem 00:05:37.828 Calling clear_iobuf_subsystem 00:05:37.828 05:01:39 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:37.828 05:01:39 -- json_config/json_config.sh@396 -- # count=100 00:05:37.828 05:01:39 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:37.828 05:01:39 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:37.828 05:01:39 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:37.828 05:01:39 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:38.086 05:01:39 -- json_config/json_config.sh@398 -- # break 00:05:38.086 05:01:39 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:38.086 05:01:39 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:38.086 05:01:39 -- json_config/json_config.sh@120 -- # local app=target 00:05:38.086 05:01:39 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:38.086 05:01:39 -- json_config/json_config.sh@124 -- # [[ -n 3171814 ]] 00:05:38.086 05:01:39 -- json_config/json_config.sh@127 -- # kill -SIGINT 3171814 00:05:38.086 05:01:39 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:38.086 05:01:39 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:38.086 05:01:39 -- json_config/json_config.sh@130 -- # kill -0 3171814 00:05:38.086 05:01:39 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:38.654 05:01:40 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:38.654 05:01:40 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:38.654 05:01:40 -- json_config/json_config.sh@130 -- # kill -0 3171814 00:05:38.654 05:01:40 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:38.654 05:01:40 -- json_config/json_config.sh@132 -- # break 00:05:38.654 05:01:40 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:38.654 05:01:40 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:38.654 SPDK target shutdown done 00:05:38.654 05:01:40 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:38.654 INFO: relaunching applications... 00:05:38.654 05:01:40 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:38.654 05:01:40 -- json_config/json_config.sh@98 -- # local app=target 00:05:38.654 05:01:40 -- json_config/json_config.sh@99 -- # shift 00:05:38.654 05:01:40 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:38.654 05:01:40 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:38.654 05:01:40 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:38.654 05:01:40 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:38.654 05:01:40 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:38.654 05:01:40 -- json_config/json_config.sh@111 -- # app_pid[$app]=3173163 00:05:38.654 05:01:40 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:38.654 05:01:40 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:38.654 Waiting for target to run... 00:05:38.654 05:01:40 -- json_config/json_config.sh@114 -- # waitforlisten 3173163 /var/tmp/spdk_tgt.sock 00:05:38.654 05:01:40 -- common/autotest_common.sh@829 -- # '[' -z 3173163 ']' 00:05:38.654 05:01:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:38.655 05:01:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:38.655 05:01:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:38.655 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:38.655 05:01:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:38.655 05:01:40 -- common/autotest_common.sh@10 -- # set +x 00:05:38.655 [2024-11-26 05:01:40.279417] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:38.655 [2024-11-26 05:01:40.279518] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3173163 ] 00:05:38.655 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.914 [2024-11-26 05:01:40.647888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.172 [2024-11-26 05:01:40.708885] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:39.172 [2024-11-26 05:01:40.709087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.466 [2024-11-26 05:01:43.726562] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:42.466 [2024-11-26 05:01:43.759123] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:42.466 05:01:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:42.466 05:01:44 -- common/autotest_common.sh@862 -- # return 0 00:05:42.466 05:01:44 -- json_config/json_config.sh@115 -- # echo '' 00:05:42.466 00:05:42.466 05:01:44 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:42.466 05:01:44 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:42.466 INFO: Checking if target configuration is the same... 00:05:42.466 05:01:44 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:42.466 05:01:44 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:42.466 05:01:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:42.466 + '[' 2 -ne 2 ']' 00:05:42.466 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:42.466 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:42.466 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:42.466 +++ basename /dev/fd/62 00:05:42.466 ++ mktemp /tmp/62.XXX 00:05:42.726 + tmp_file_1=/tmp/62.4Qf 00:05:42.726 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:42.726 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:42.726 + tmp_file_2=/tmp/spdk_tgt_config.json.veX 00:05:42.727 + ret=0 00:05:42.727 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:42.987 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:42.987 + diff -u /tmp/62.4Qf /tmp/spdk_tgt_config.json.veX 00:05:42.987 + echo 'INFO: JSON config files are the same' 00:05:42.987 INFO: JSON config files are the same 00:05:42.987 + rm /tmp/62.4Qf /tmp/spdk_tgt_config.json.veX 00:05:42.987 + exit 0 00:05:42.987 05:01:44 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:42.987 05:01:44 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:42.987 INFO: changing configuration and checking if this can be detected... 00:05:42.987 05:01:44 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:42.987 05:01:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:43.246 05:01:44 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:43.246 05:01:44 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:43.246 05:01:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:43.246 + '[' 2 -ne 2 ']' 00:05:43.246 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:43.246 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:43.246 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:43.246 +++ basename /dev/fd/62 00:05:43.246 ++ mktemp /tmp/62.XXX 00:05:43.246 + tmp_file_1=/tmp/62.gpL 00:05:43.246 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:43.246 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:43.247 + tmp_file_2=/tmp/spdk_tgt_config.json.lev 00:05:43.247 + ret=0 00:05:43.247 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:43.814 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:43.814 + diff -u /tmp/62.gpL /tmp/spdk_tgt_config.json.lev 00:05:43.814 + ret=1 00:05:43.814 + echo '=== Start of file: /tmp/62.gpL ===' 00:05:43.814 + cat /tmp/62.gpL 00:05:43.814 + echo '=== End of file: /tmp/62.gpL ===' 00:05:43.814 + echo '' 00:05:43.814 + echo '=== Start of file: /tmp/spdk_tgt_config.json.lev ===' 00:05:43.814 + cat /tmp/spdk_tgt_config.json.lev 00:05:43.814 + echo '=== End of file: /tmp/spdk_tgt_config.json.lev ===' 00:05:43.814 + echo '' 00:05:43.814 + rm /tmp/62.gpL /tmp/spdk_tgt_config.json.lev 00:05:43.814 + exit 1 00:05:43.814 05:01:45 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:43.814 INFO: configuration change detected. 00:05:43.814 05:01:45 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:43.814 05:01:45 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:43.814 05:01:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:43.814 05:01:45 -- common/autotest_common.sh@10 -- # set +x 00:05:43.814 05:01:45 -- json_config/json_config.sh@360 -- # local ret=0 00:05:43.814 05:01:45 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:43.814 05:01:45 -- json_config/json_config.sh@370 -- # [[ -n 3173163 ]] 00:05:43.814 05:01:45 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:43.814 05:01:45 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:43.814 05:01:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:43.814 05:01:45 -- common/autotest_common.sh@10 -- # set +x 00:05:43.814 05:01:45 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:43.814 05:01:45 -- json_config/json_config.sh@246 -- # uname -s 00:05:43.814 05:01:45 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:43.814 05:01:45 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:43.814 05:01:45 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:43.814 05:01:45 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:43.814 05:01:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:43.814 05:01:45 -- common/autotest_common.sh@10 -- # set +x 00:05:43.815 05:01:45 -- json_config/json_config.sh@376 -- # killprocess 3173163 00:05:43.815 05:01:45 -- common/autotest_common.sh@936 -- # '[' -z 3173163 ']' 00:05:43.815 05:01:45 -- common/autotest_common.sh@940 -- # kill -0 3173163 00:05:43.815 05:01:45 -- common/autotest_common.sh@941 -- # uname 00:05:43.815 05:01:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:43.815 05:01:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3173163 00:05:43.815 05:01:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:43.815 05:01:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:43.815 05:01:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3173163' 00:05:43.815 killing process with pid 3173163 00:05:43.815 05:01:45 -- common/autotest_common.sh@955 -- # kill 3173163 00:05:43.815 05:01:45 -- common/autotest_common.sh@960 -- # wait 3173163 00:05:45.725 05:01:47 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:45.725 05:01:47 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:45.725 05:01:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:45.725 05:01:47 -- common/autotest_common.sh@10 -- # set +x 00:05:45.725 05:01:47 -- json_config/json_config.sh@381 -- # return 0 00:05:45.725 05:01:47 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:45.725 INFO: Success 00:05:45.725 00:05:45.725 real 0m16.482s 00:05:45.725 user 0m19.009s 00:05:45.725 sys 0m2.140s 00:05:45.725 05:01:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.725 05:01:47 -- common/autotest_common.sh@10 -- # set +x 00:05:45.725 ************************************ 00:05:45.725 END TEST json_config 00:05:45.725 ************************************ 00:05:45.725 05:01:47 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:45.725 05:01:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:45.725 05:01:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.725 05:01:47 -- common/autotest_common.sh@10 -- # set +x 00:05:45.725 ************************************ 00:05:45.725 START TEST json_config_extra_key 00:05:45.725 ************************************ 00:05:45.725 05:01:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:45.725 05:01:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:45.725 05:01:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:45.725 05:01:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:45.725 05:01:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:45.725 05:01:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:45.725 05:01:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:45.725 05:01:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:45.725 05:01:47 -- scripts/common.sh@335 -- # IFS=.-: 00:05:45.725 05:01:47 -- scripts/common.sh@335 -- # read -ra ver1 00:05:45.725 05:01:47 -- scripts/common.sh@336 -- # IFS=.-: 00:05:45.725 05:01:47 -- scripts/common.sh@336 -- # read -ra ver2 00:05:45.725 05:01:47 -- scripts/common.sh@337 -- # local 'op=<' 00:05:45.725 05:01:47 -- scripts/common.sh@339 -- # ver1_l=2 00:05:45.725 05:01:47 -- scripts/common.sh@340 -- # ver2_l=1 00:05:45.725 05:01:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:45.725 05:01:47 -- scripts/common.sh@343 -- # case "$op" in 00:05:45.725 05:01:47 -- scripts/common.sh@344 -- # : 1 00:05:45.725 05:01:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:45.725 05:01:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:45.725 05:01:47 -- scripts/common.sh@364 -- # decimal 1 00:05:45.725 05:01:47 -- scripts/common.sh@352 -- # local d=1 00:05:45.725 05:01:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:45.725 05:01:47 -- scripts/common.sh@354 -- # echo 1 00:05:45.725 05:01:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:45.725 05:01:47 -- scripts/common.sh@365 -- # decimal 2 00:05:45.725 05:01:47 -- scripts/common.sh@352 -- # local d=2 00:05:45.725 05:01:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:45.725 05:01:47 -- scripts/common.sh@354 -- # echo 2 00:05:45.725 05:01:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:45.725 05:01:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:45.725 05:01:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:45.725 05:01:47 -- scripts/common.sh@367 -- # return 0 00:05:45.725 05:01:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:45.725 05:01:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:45.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:45.726 --rc genhtml_branch_coverage=1 00:05:45.726 --rc genhtml_function_coverage=1 00:05:45.726 --rc genhtml_legend=1 00:05:45.726 --rc geninfo_all_blocks=1 00:05:45.726 --rc geninfo_unexecuted_blocks=1 00:05:45.726 00:05:45.726 ' 00:05:45.726 05:01:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:45.726 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:45.726 --rc genhtml_branch_coverage=1 00:05:45.726 --rc genhtml_function_coverage=1 00:05:45.726 --rc genhtml_legend=1 00:05:45.726 --rc geninfo_all_blocks=1 00:05:45.726 --rc geninfo_unexecuted_blocks=1 00:05:45.726 00:05:45.726 ' 00:05:45.726 05:01:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:45.726 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:45.726 --rc genhtml_branch_coverage=1 00:05:45.726 --rc genhtml_function_coverage=1 00:05:45.726 --rc genhtml_legend=1 00:05:45.726 --rc geninfo_all_blocks=1 00:05:45.726 --rc geninfo_unexecuted_blocks=1 00:05:45.726 00:05:45.726 ' 00:05:45.726 05:01:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:45.726 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:45.726 --rc genhtml_branch_coverage=1 00:05:45.726 --rc genhtml_function_coverage=1 00:05:45.726 --rc genhtml_legend=1 00:05:45.726 --rc geninfo_all_blocks=1 00:05:45.726 --rc geninfo_unexecuted_blocks=1 00:05:45.726 00:05:45.726 ' 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:45.726 05:01:47 -- nvmf/common.sh@7 -- # uname -s 00:05:45.726 05:01:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:45.726 05:01:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:45.726 05:01:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:45.726 05:01:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:45.726 05:01:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:45.726 05:01:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:45.726 05:01:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:45.726 05:01:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:45.726 05:01:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:45.726 05:01:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:45.726 05:01:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:45.726 05:01:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:45.726 05:01:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:45.726 05:01:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:45.726 05:01:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:45.726 05:01:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:45.726 05:01:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:45.726 05:01:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:45.726 05:01:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:45.726 05:01:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:45.726 05:01:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:45.726 05:01:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:45.726 05:01:47 -- paths/export.sh@5 -- # export PATH 00:05:45.726 05:01:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:45.726 05:01:47 -- nvmf/common.sh@46 -- # : 0 00:05:45.726 05:01:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:45.726 05:01:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:45.726 05:01:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:45.726 05:01:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:45.726 05:01:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:45.726 05:01:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:45.726 05:01:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:45.726 05:01:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:45.726 INFO: launching applications... 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=3174111 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:45.726 Waiting for target to run... 00:05:45.726 05:01:47 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 3174111 /var/tmp/spdk_tgt.sock 00:05:45.726 05:01:47 -- common/autotest_common.sh@829 -- # '[' -z 3174111 ']' 00:05:45.726 05:01:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:45.726 05:01:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:45.726 05:01:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:45.726 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:45.726 05:01:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:45.726 05:01:47 -- common/autotest_common.sh@10 -- # set +x 00:05:45.726 [2024-11-26 05:01:47.243258] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.726 [2024-11-26 05:01:47.243357] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3174111 ] 00:05:45.726 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.985 [2024-11-26 05:01:47.584546] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.985 [2024-11-26 05:01:47.645719] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:45.985 [2024-11-26 05:01:47.645919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.555 05:01:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:46.555 05:01:48 -- common/autotest_common.sh@862 -- # return 0 00:05:46.555 05:01:48 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:46.555 00:05:46.555 05:01:48 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:46.555 INFO: shutting down applications... 00:05:46.555 05:01:48 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:46.555 05:01:48 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:46.555 05:01:48 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:46.555 05:01:48 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 3174111 ]] 00:05:46.555 05:01:48 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 3174111 00:05:46.555 05:01:48 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:46.555 05:01:48 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:46.555 05:01:48 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3174111 00:05:46.555 05:01:48 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:05:47.123 05:01:48 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:05:47.123 05:01:48 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:47.123 05:01:48 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3174111 00:05:47.123 05:01:48 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:05:47.123 05:01:48 -- json_config/json_config_extra_key.sh@52 -- # break 00:05:47.123 05:01:48 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:05:47.123 05:01:48 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:05:47.123 SPDK target shutdown done 00:05:47.123 05:01:48 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:05:47.123 Success 00:05:47.123 00:05:47.123 real 0m1.641s 00:05:47.123 user 0m1.631s 00:05:47.123 sys 0m0.431s 00:05:47.123 05:01:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:47.123 05:01:48 -- common/autotest_common.sh@10 -- # set +x 00:05:47.123 ************************************ 00:05:47.123 END TEST json_config_extra_key 00:05:47.123 ************************************ 00:05:47.123 05:01:48 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:47.123 05:01:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:47.123 05:01:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.123 05:01:48 -- common/autotest_common.sh@10 -- # set +x 00:05:47.123 ************************************ 00:05:47.123 START TEST alias_rpc 00:05:47.123 ************************************ 00:05:47.123 05:01:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:47.123 * Looking for test storage... 00:05:47.123 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:05:47.123 05:01:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:47.123 05:01:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:47.123 05:01:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:47.123 05:01:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:47.123 05:01:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:47.123 05:01:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:47.123 05:01:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:47.123 05:01:48 -- scripts/common.sh@335 -- # IFS=.-: 00:05:47.123 05:01:48 -- scripts/common.sh@335 -- # read -ra ver1 00:05:47.123 05:01:48 -- scripts/common.sh@336 -- # IFS=.-: 00:05:47.123 05:01:48 -- scripts/common.sh@336 -- # read -ra ver2 00:05:47.123 05:01:48 -- scripts/common.sh@337 -- # local 'op=<' 00:05:47.123 05:01:48 -- scripts/common.sh@339 -- # ver1_l=2 00:05:47.123 05:01:48 -- scripts/common.sh@340 -- # ver2_l=1 00:05:47.123 05:01:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:47.123 05:01:48 -- scripts/common.sh@343 -- # case "$op" in 00:05:47.123 05:01:48 -- scripts/common.sh@344 -- # : 1 00:05:47.123 05:01:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:47.123 05:01:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:47.123 05:01:48 -- scripts/common.sh@364 -- # decimal 1 00:05:47.123 05:01:48 -- scripts/common.sh@352 -- # local d=1 00:05:47.123 05:01:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:47.123 05:01:48 -- scripts/common.sh@354 -- # echo 1 00:05:47.123 05:01:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:47.123 05:01:48 -- scripts/common.sh@365 -- # decimal 2 00:05:47.123 05:01:48 -- scripts/common.sh@352 -- # local d=2 00:05:47.123 05:01:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:47.124 05:01:48 -- scripts/common.sh@354 -- # echo 2 00:05:47.124 05:01:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:47.124 05:01:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:47.124 05:01:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:47.124 05:01:48 -- scripts/common.sh@367 -- # return 0 00:05:47.124 05:01:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:47.124 05:01:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:47.124 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:47.124 --rc genhtml_branch_coverage=1 00:05:47.124 --rc genhtml_function_coverage=1 00:05:47.124 --rc genhtml_legend=1 00:05:47.124 --rc geninfo_all_blocks=1 00:05:47.124 --rc geninfo_unexecuted_blocks=1 00:05:47.124 00:05:47.124 ' 00:05:47.124 05:01:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:47.124 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:47.124 --rc genhtml_branch_coverage=1 00:05:47.124 --rc genhtml_function_coverage=1 00:05:47.124 --rc genhtml_legend=1 00:05:47.124 --rc geninfo_all_blocks=1 00:05:47.124 --rc geninfo_unexecuted_blocks=1 00:05:47.124 00:05:47.124 ' 00:05:47.124 05:01:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:47.124 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:47.124 --rc genhtml_branch_coverage=1 00:05:47.124 --rc genhtml_function_coverage=1 00:05:47.124 --rc genhtml_legend=1 00:05:47.124 --rc geninfo_all_blocks=1 00:05:47.124 --rc geninfo_unexecuted_blocks=1 00:05:47.124 00:05:47.124 ' 00:05:47.124 05:01:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:47.124 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:47.124 --rc genhtml_branch_coverage=1 00:05:47.124 --rc genhtml_function_coverage=1 00:05:47.124 --rc genhtml_legend=1 00:05:47.124 --rc geninfo_all_blocks=1 00:05:47.124 --rc geninfo_unexecuted_blocks=1 00:05:47.124 00:05:47.124 ' 00:05:47.124 05:01:48 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:47.124 05:01:48 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3174385 00:05:47.124 05:01:48 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:47.124 05:01:48 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3174385 00:05:47.124 05:01:48 -- common/autotest_common.sh@829 -- # '[' -z 3174385 ']' 00:05:47.124 05:01:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:47.124 05:01:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:47.124 05:01:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:47.124 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:47.124 05:01:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:47.124 05:01:48 -- common/autotest_common.sh@10 -- # set +x 00:05:47.384 [2024-11-26 05:01:48.922209] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.384 [2024-11-26 05:01:48.922287] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3174385 ] 00:05:47.384 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.384 [2024-11-26 05:01:48.978731] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.384 [2024-11-26 05:01:49.064011] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:47.384 [2024-11-26 05:01:49.064193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.319 05:01:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:48.319 05:01:49 -- common/autotest_common.sh@862 -- # return 0 00:05:48.319 05:01:49 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:48.579 05:01:50 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3174385 00:05:48.579 05:01:50 -- common/autotest_common.sh@936 -- # '[' -z 3174385 ']' 00:05:48.579 05:01:50 -- common/autotest_common.sh@940 -- # kill -0 3174385 00:05:48.579 05:01:50 -- common/autotest_common.sh@941 -- # uname 00:05:48.579 05:01:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:48.579 05:01:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3174385 00:05:48.579 05:01:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:48.579 05:01:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:48.579 05:01:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3174385' 00:05:48.579 killing process with pid 3174385 00:05:48.579 05:01:50 -- common/autotest_common.sh@955 -- # kill 3174385 00:05:48.579 05:01:50 -- common/autotest_common.sh@960 -- # wait 3174385 00:05:49.148 00:05:49.148 real 0m1.871s 00:05:49.148 user 0m2.169s 00:05:49.148 sys 0m0.467s 00:05:49.148 05:01:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:49.148 05:01:50 -- common/autotest_common.sh@10 -- # set +x 00:05:49.148 ************************************ 00:05:49.148 END TEST alias_rpc 00:05:49.148 ************************************ 00:05:49.148 05:01:50 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:05:49.148 05:01:50 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:49.148 05:01:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:49.148 05:01:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.148 05:01:50 -- common/autotest_common.sh@10 -- # set +x 00:05:49.148 ************************************ 00:05:49.148 START TEST spdkcli_tcp 00:05:49.148 ************************************ 00:05:49.148 05:01:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:49.148 * Looking for test storage... 00:05:49.148 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:05:49.148 05:01:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:49.148 05:01:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:49.148 05:01:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:49.148 05:01:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:49.148 05:01:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:49.148 05:01:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:49.148 05:01:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:49.148 05:01:50 -- scripts/common.sh@335 -- # IFS=.-: 00:05:49.148 05:01:50 -- scripts/common.sh@335 -- # read -ra ver1 00:05:49.148 05:01:50 -- scripts/common.sh@336 -- # IFS=.-: 00:05:49.148 05:01:50 -- scripts/common.sh@336 -- # read -ra ver2 00:05:49.148 05:01:50 -- scripts/common.sh@337 -- # local 'op=<' 00:05:49.148 05:01:50 -- scripts/common.sh@339 -- # ver1_l=2 00:05:49.148 05:01:50 -- scripts/common.sh@340 -- # ver2_l=1 00:05:49.149 05:01:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:49.149 05:01:50 -- scripts/common.sh@343 -- # case "$op" in 00:05:49.149 05:01:50 -- scripts/common.sh@344 -- # : 1 00:05:49.149 05:01:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:49.149 05:01:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:49.149 05:01:50 -- scripts/common.sh@364 -- # decimal 1 00:05:49.149 05:01:50 -- scripts/common.sh@352 -- # local d=1 00:05:49.149 05:01:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:49.149 05:01:50 -- scripts/common.sh@354 -- # echo 1 00:05:49.149 05:01:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:49.149 05:01:50 -- scripts/common.sh@365 -- # decimal 2 00:05:49.149 05:01:50 -- scripts/common.sh@352 -- # local d=2 00:05:49.149 05:01:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:49.149 05:01:50 -- scripts/common.sh@354 -- # echo 2 00:05:49.149 05:01:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:49.149 05:01:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:49.149 05:01:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:49.149 05:01:50 -- scripts/common.sh@367 -- # return 0 00:05:49.149 05:01:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:49.149 05:01:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:49.149 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:49.149 --rc genhtml_branch_coverage=1 00:05:49.149 --rc genhtml_function_coverage=1 00:05:49.149 --rc genhtml_legend=1 00:05:49.149 --rc geninfo_all_blocks=1 00:05:49.149 --rc geninfo_unexecuted_blocks=1 00:05:49.149 00:05:49.149 ' 00:05:49.149 05:01:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:49.149 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:49.149 --rc genhtml_branch_coverage=1 00:05:49.149 --rc genhtml_function_coverage=1 00:05:49.149 --rc genhtml_legend=1 00:05:49.149 --rc geninfo_all_blocks=1 00:05:49.149 --rc geninfo_unexecuted_blocks=1 00:05:49.149 00:05:49.149 ' 00:05:49.149 05:01:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:49.149 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:49.149 --rc genhtml_branch_coverage=1 00:05:49.149 --rc genhtml_function_coverage=1 00:05:49.149 --rc genhtml_legend=1 00:05:49.149 --rc geninfo_all_blocks=1 00:05:49.149 --rc geninfo_unexecuted_blocks=1 00:05:49.149 00:05:49.149 ' 00:05:49.149 05:01:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:49.149 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:49.149 --rc genhtml_branch_coverage=1 00:05:49.149 --rc genhtml_function_coverage=1 00:05:49.149 --rc genhtml_legend=1 00:05:49.149 --rc geninfo_all_blocks=1 00:05:49.149 --rc geninfo_unexecuted_blocks=1 00:05:49.149 00:05:49.149 ' 00:05:49.149 05:01:50 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:05:49.149 05:01:50 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:49.149 05:01:50 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:05:49.149 05:01:50 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:49.149 05:01:50 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:49.149 05:01:50 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:49.149 05:01:50 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:49.149 05:01:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:49.149 05:01:50 -- common/autotest_common.sh@10 -- # set +x 00:05:49.149 05:01:50 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3174649 00:05:49.149 05:01:50 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:49.149 05:01:50 -- spdkcli/tcp.sh@27 -- # waitforlisten 3174649 00:05:49.149 05:01:50 -- common/autotest_common.sh@829 -- # '[' -z 3174649 ']' 00:05:49.149 05:01:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:49.149 05:01:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:49.149 05:01:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:49.149 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:49.149 05:01:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:49.149 05:01:50 -- common/autotest_common.sh@10 -- # set +x 00:05:49.149 [2024-11-26 05:01:50.830855] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:49.149 [2024-11-26 05:01:50.830978] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3174649 ] 00:05:49.149 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.149 [2024-11-26 05:01:50.889353] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:49.408 [2024-11-26 05:01:50.974371] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:49.408 [2024-11-26 05:01:50.974732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:49.409 [2024-11-26 05:01:50.974738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.346 05:01:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:50.346 05:01:51 -- common/autotest_common.sh@862 -- # return 0 00:05:50.346 05:01:51 -- spdkcli/tcp.sh@31 -- # socat_pid=3174783 00:05:50.346 05:01:51 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:50.346 05:01:51 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:50.346 [ 00:05:50.346 "bdev_malloc_delete", 00:05:50.346 "bdev_malloc_create", 00:05:50.346 "bdev_null_resize", 00:05:50.346 "bdev_null_delete", 00:05:50.346 "bdev_null_create", 00:05:50.346 "bdev_nvme_cuse_unregister", 00:05:50.346 "bdev_nvme_cuse_register", 00:05:50.347 "bdev_opal_new_user", 00:05:50.347 "bdev_opal_set_lock_state", 00:05:50.347 "bdev_opal_delete", 00:05:50.347 "bdev_opal_get_info", 00:05:50.347 "bdev_opal_create", 00:05:50.347 "bdev_nvme_opal_revert", 00:05:50.347 "bdev_nvme_opal_init", 00:05:50.347 "bdev_nvme_send_cmd", 00:05:50.347 "bdev_nvme_get_path_iostat", 00:05:50.347 "bdev_nvme_get_mdns_discovery_info", 00:05:50.347 "bdev_nvme_stop_mdns_discovery", 00:05:50.347 "bdev_nvme_start_mdns_discovery", 00:05:50.347 "bdev_nvme_set_multipath_policy", 00:05:50.347 "bdev_nvme_set_preferred_path", 00:05:50.347 "bdev_nvme_get_io_paths", 00:05:50.347 "bdev_nvme_remove_error_injection", 00:05:50.347 "bdev_nvme_add_error_injection", 00:05:50.347 "bdev_nvme_get_discovery_info", 00:05:50.347 "bdev_nvme_stop_discovery", 00:05:50.347 "bdev_nvme_start_discovery", 00:05:50.347 "bdev_nvme_get_controller_health_info", 00:05:50.347 "bdev_nvme_disable_controller", 00:05:50.347 "bdev_nvme_enable_controller", 00:05:50.347 "bdev_nvme_reset_controller", 00:05:50.347 "bdev_nvme_get_transport_statistics", 00:05:50.347 "bdev_nvme_apply_firmware", 00:05:50.347 "bdev_nvme_detach_controller", 00:05:50.347 "bdev_nvme_get_controllers", 00:05:50.347 "bdev_nvme_attach_controller", 00:05:50.347 "bdev_nvme_set_hotplug", 00:05:50.347 "bdev_nvme_set_options", 00:05:50.347 "bdev_passthru_delete", 00:05:50.347 "bdev_passthru_create", 00:05:50.347 "bdev_lvol_grow_lvstore", 00:05:50.347 "bdev_lvol_get_lvols", 00:05:50.347 "bdev_lvol_get_lvstores", 00:05:50.347 "bdev_lvol_delete", 00:05:50.347 "bdev_lvol_set_read_only", 00:05:50.347 "bdev_lvol_resize", 00:05:50.347 "bdev_lvol_decouple_parent", 00:05:50.347 "bdev_lvol_inflate", 00:05:50.347 "bdev_lvol_rename", 00:05:50.347 "bdev_lvol_clone_bdev", 00:05:50.347 "bdev_lvol_clone", 00:05:50.347 "bdev_lvol_snapshot", 00:05:50.347 "bdev_lvol_create", 00:05:50.347 "bdev_lvol_delete_lvstore", 00:05:50.347 "bdev_lvol_rename_lvstore", 00:05:50.347 "bdev_lvol_create_lvstore", 00:05:50.347 "bdev_raid_set_options", 00:05:50.347 "bdev_raid_remove_base_bdev", 00:05:50.347 "bdev_raid_add_base_bdev", 00:05:50.347 "bdev_raid_delete", 00:05:50.347 "bdev_raid_create", 00:05:50.347 "bdev_raid_get_bdevs", 00:05:50.347 "bdev_error_inject_error", 00:05:50.347 "bdev_error_delete", 00:05:50.347 "bdev_error_create", 00:05:50.347 "bdev_split_delete", 00:05:50.347 "bdev_split_create", 00:05:50.347 "bdev_delay_delete", 00:05:50.347 "bdev_delay_create", 00:05:50.347 "bdev_delay_update_latency", 00:05:50.347 "bdev_zone_block_delete", 00:05:50.347 "bdev_zone_block_create", 00:05:50.347 "blobfs_create", 00:05:50.347 "blobfs_detect", 00:05:50.347 "blobfs_set_cache_size", 00:05:50.347 "bdev_aio_delete", 00:05:50.347 "bdev_aio_rescan", 00:05:50.347 "bdev_aio_create", 00:05:50.347 "bdev_ftl_set_property", 00:05:50.347 "bdev_ftl_get_properties", 00:05:50.347 "bdev_ftl_get_stats", 00:05:50.347 "bdev_ftl_unmap", 00:05:50.347 "bdev_ftl_unload", 00:05:50.347 "bdev_ftl_delete", 00:05:50.347 "bdev_ftl_load", 00:05:50.347 "bdev_ftl_create", 00:05:50.347 "bdev_virtio_attach_controller", 00:05:50.347 "bdev_virtio_scsi_get_devices", 00:05:50.347 "bdev_virtio_detach_controller", 00:05:50.347 "bdev_virtio_blk_set_hotplug", 00:05:50.347 "bdev_iscsi_delete", 00:05:50.347 "bdev_iscsi_create", 00:05:50.347 "bdev_iscsi_set_options", 00:05:50.347 "accel_error_inject_error", 00:05:50.347 "ioat_scan_accel_module", 00:05:50.347 "dsa_scan_accel_module", 00:05:50.347 "iaa_scan_accel_module", 00:05:50.347 "vfu_virtio_create_scsi_endpoint", 00:05:50.347 "vfu_virtio_scsi_remove_target", 00:05:50.347 "vfu_virtio_scsi_add_target", 00:05:50.347 "vfu_virtio_create_blk_endpoint", 00:05:50.347 "vfu_virtio_delete_endpoint", 00:05:50.347 "iscsi_set_options", 00:05:50.347 "iscsi_get_auth_groups", 00:05:50.347 "iscsi_auth_group_remove_secret", 00:05:50.347 "iscsi_auth_group_add_secret", 00:05:50.347 "iscsi_delete_auth_group", 00:05:50.347 "iscsi_create_auth_group", 00:05:50.347 "iscsi_set_discovery_auth", 00:05:50.347 "iscsi_get_options", 00:05:50.347 "iscsi_target_node_request_logout", 00:05:50.347 "iscsi_target_node_set_redirect", 00:05:50.347 "iscsi_target_node_set_auth", 00:05:50.347 "iscsi_target_node_add_lun", 00:05:50.347 "iscsi_get_connections", 00:05:50.347 "iscsi_portal_group_set_auth", 00:05:50.347 "iscsi_start_portal_group", 00:05:50.347 "iscsi_delete_portal_group", 00:05:50.347 "iscsi_create_portal_group", 00:05:50.347 "iscsi_get_portal_groups", 00:05:50.347 "iscsi_delete_target_node", 00:05:50.347 "iscsi_target_node_remove_pg_ig_maps", 00:05:50.347 "iscsi_target_node_add_pg_ig_maps", 00:05:50.347 "iscsi_create_target_node", 00:05:50.347 "iscsi_get_target_nodes", 00:05:50.347 "iscsi_delete_initiator_group", 00:05:50.347 "iscsi_initiator_group_remove_initiators", 00:05:50.347 "iscsi_initiator_group_add_initiators", 00:05:50.347 "iscsi_create_initiator_group", 00:05:50.347 "iscsi_get_initiator_groups", 00:05:50.347 "nvmf_set_crdt", 00:05:50.347 "nvmf_set_config", 00:05:50.347 "nvmf_set_max_subsystems", 00:05:50.347 "nvmf_subsystem_get_listeners", 00:05:50.347 "nvmf_subsystem_get_qpairs", 00:05:50.347 "nvmf_subsystem_get_controllers", 00:05:50.347 "nvmf_get_stats", 00:05:50.347 "nvmf_get_transports", 00:05:50.347 "nvmf_create_transport", 00:05:50.347 "nvmf_get_targets", 00:05:50.347 "nvmf_delete_target", 00:05:50.347 "nvmf_create_target", 00:05:50.347 "nvmf_subsystem_allow_any_host", 00:05:50.347 "nvmf_subsystem_remove_host", 00:05:50.347 "nvmf_subsystem_add_host", 00:05:50.347 "nvmf_subsystem_remove_ns", 00:05:50.347 "nvmf_subsystem_add_ns", 00:05:50.347 "nvmf_subsystem_listener_set_ana_state", 00:05:50.347 "nvmf_discovery_get_referrals", 00:05:50.347 "nvmf_discovery_remove_referral", 00:05:50.347 "nvmf_discovery_add_referral", 00:05:50.347 "nvmf_subsystem_remove_listener", 00:05:50.347 "nvmf_subsystem_add_listener", 00:05:50.347 "nvmf_delete_subsystem", 00:05:50.347 "nvmf_create_subsystem", 00:05:50.347 "nvmf_get_subsystems", 00:05:50.347 "env_dpdk_get_mem_stats", 00:05:50.347 "nbd_get_disks", 00:05:50.347 "nbd_stop_disk", 00:05:50.347 "nbd_start_disk", 00:05:50.347 "ublk_recover_disk", 00:05:50.347 "ublk_get_disks", 00:05:50.347 "ublk_stop_disk", 00:05:50.347 "ublk_start_disk", 00:05:50.347 "ublk_destroy_target", 00:05:50.347 "ublk_create_target", 00:05:50.347 "virtio_blk_create_transport", 00:05:50.347 "virtio_blk_get_transports", 00:05:50.347 "vhost_controller_set_coalescing", 00:05:50.347 "vhost_get_controllers", 00:05:50.347 "vhost_delete_controller", 00:05:50.347 "vhost_create_blk_controller", 00:05:50.347 "vhost_scsi_controller_remove_target", 00:05:50.347 "vhost_scsi_controller_add_target", 00:05:50.347 "vhost_start_scsi_controller", 00:05:50.347 "vhost_create_scsi_controller", 00:05:50.347 "thread_set_cpumask", 00:05:50.347 "framework_get_scheduler", 00:05:50.347 "framework_set_scheduler", 00:05:50.347 "framework_get_reactors", 00:05:50.347 "thread_get_io_channels", 00:05:50.347 "thread_get_pollers", 00:05:50.347 "thread_get_stats", 00:05:50.347 "framework_monitor_context_switch", 00:05:50.347 "spdk_kill_instance", 00:05:50.347 "log_enable_timestamps", 00:05:50.347 "log_get_flags", 00:05:50.347 "log_clear_flag", 00:05:50.347 "log_set_flag", 00:05:50.347 "log_get_level", 00:05:50.347 "log_set_level", 00:05:50.347 "log_get_print_level", 00:05:50.347 "log_set_print_level", 00:05:50.347 "framework_enable_cpumask_locks", 00:05:50.347 "framework_disable_cpumask_locks", 00:05:50.347 "framework_wait_init", 00:05:50.347 "framework_start_init", 00:05:50.347 "scsi_get_devices", 00:05:50.347 "bdev_get_histogram", 00:05:50.347 "bdev_enable_histogram", 00:05:50.347 "bdev_set_qos_limit", 00:05:50.347 "bdev_set_qd_sampling_period", 00:05:50.347 "bdev_get_bdevs", 00:05:50.347 "bdev_reset_iostat", 00:05:50.347 "bdev_get_iostat", 00:05:50.347 "bdev_examine", 00:05:50.347 "bdev_wait_for_examine", 00:05:50.347 "bdev_set_options", 00:05:50.347 "notify_get_notifications", 00:05:50.347 "notify_get_types", 00:05:50.347 "accel_get_stats", 00:05:50.347 "accel_set_options", 00:05:50.347 "accel_set_driver", 00:05:50.347 "accel_crypto_key_destroy", 00:05:50.347 "accel_crypto_keys_get", 00:05:50.347 "accel_crypto_key_create", 00:05:50.347 "accel_assign_opc", 00:05:50.347 "accel_get_module_info", 00:05:50.347 "accel_get_opc_assignments", 00:05:50.347 "vmd_rescan", 00:05:50.347 "vmd_remove_device", 00:05:50.347 "vmd_enable", 00:05:50.347 "sock_set_default_impl", 00:05:50.347 "sock_impl_set_options", 00:05:50.347 "sock_impl_get_options", 00:05:50.347 "iobuf_get_stats", 00:05:50.347 "iobuf_set_options", 00:05:50.347 "framework_get_pci_devices", 00:05:50.347 "framework_get_config", 00:05:50.347 "framework_get_subsystems", 00:05:50.347 "vfu_tgt_set_base_path", 00:05:50.347 "trace_get_info", 00:05:50.347 "trace_get_tpoint_group_mask", 00:05:50.347 "trace_disable_tpoint_group", 00:05:50.347 "trace_enable_tpoint_group", 00:05:50.347 "trace_clear_tpoint_mask", 00:05:50.347 "trace_set_tpoint_mask", 00:05:50.347 "spdk_get_version", 00:05:50.347 "rpc_get_methods" 00:05:50.347 ] 00:05:50.348 05:01:52 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:50.348 05:01:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:50.348 05:01:52 -- common/autotest_common.sh@10 -- # set +x 00:05:50.348 05:01:52 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:50.348 05:01:52 -- spdkcli/tcp.sh@38 -- # killprocess 3174649 00:05:50.348 05:01:52 -- common/autotest_common.sh@936 -- # '[' -z 3174649 ']' 00:05:50.348 05:01:52 -- common/autotest_common.sh@940 -- # kill -0 3174649 00:05:50.348 05:01:52 -- common/autotest_common.sh@941 -- # uname 00:05:50.348 05:01:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:50.348 05:01:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3174649 00:05:50.348 05:01:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:50.348 05:01:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:50.348 05:01:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3174649' 00:05:50.348 killing process with pid 3174649 00:05:50.348 05:01:52 -- common/autotest_common.sh@955 -- # kill 3174649 00:05:50.608 05:01:52 -- common/autotest_common.sh@960 -- # wait 3174649 00:05:50.867 00:05:50.867 real 0m1.869s 00:05:50.867 user 0m3.578s 00:05:50.867 sys 0m0.518s 00:05:50.867 05:01:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.867 05:01:52 -- common/autotest_common.sh@10 -- # set +x 00:05:50.867 ************************************ 00:05:50.867 END TEST spdkcli_tcp 00:05:50.867 ************************************ 00:05:50.867 05:01:52 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:50.867 05:01:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:50.867 05:01:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.867 05:01:52 -- common/autotest_common.sh@10 -- # set +x 00:05:50.867 ************************************ 00:05:50.867 START TEST dpdk_mem_utility 00:05:50.867 ************************************ 00:05:50.867 05:01:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:50.867 * Looking for test storage... 00:05:50.867 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:05:50.867 05:01:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:50.867 05:01:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:50.867 05:01:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:51.125 05:01:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:51.125 05:01:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:51.125 05:01:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:51.125 05:01:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:51.125 05:01:52 -- scripts/common.sh@335 -- # IFS=.-: 00:05:51.125 05:01:52 -- scripts/common.sh@335 -- # read -ra ver1 00:05:51.125 05:01:52 -- scripts/common.sh@336 -- # IFS=.-: 00:05:51.125 05:01:52 -- scripts/common.sh@336 -- # read -ra ver2 00:05:51.125 05:01:52 -- scripts/common.sh@337 -- # local 'op=<' 00:05:51.125 05:01:52 -- scripts/common.sh@339 -- # ver1_l=2 00:05:51.125 05:01:52 -- scripts/common.sh@340 -- # ver2_l=1 00:05:51.125 05:01:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:51.125 05:01:52 -- scripts/common.sh@343 -- # case "$op" in 00:05:51.125 05:01:52 -- scripts/common.sh@344 -- # : 1 00:05:51.125 05:01:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:51.125 05:01:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:51.125 05:01:52 -- scripts/common.sh@364 -- # decimal 1 00:05:51.125 05:01:52 -- scripts/common.sh@352 -- # local d=1 00:05:51.125 05:01:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:51.125 05:01:52 -- scripts/common.sh@354 -- # echo 1 00:05:51.125 05:01:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:51.125 05:01:52 -- scripts/common.sh@365 -- # decimal 2 00:05:51.125 05:01:52 -- scripts/common.sh@352 -- # local d=2 00:05:51.125 05:01:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:51.125 05:01:52 -- scripts/common.sh@354 -- # echo 2 00:05:51.125 05:01:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:51.125 05:01:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:51.125 05:01:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:51.125 05:01:52 -- scripts/common.sh@367 -- # return 0 00:05:51.125 05:01:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:51.125 05:01:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:51.125 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.125 --rc genhtml_branch_coverage=1 00:05:51.125 --rc genhtml_function_coverage=1 00:05:51.125 --rc genhtml_legend=1 00:05:51.125 --rc geninfo_all_blocks=1 00:05:51.125 --rc geninfo_unexecuted_blocks=1 00:05:51.125 00:05:51.125 ' 00:05:51.125 05:01:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:51.125 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.125 --rc genhtml_branch_coverage=1 00:05:51.125 --rc genhtml_function_coverage=1 00:05:51.125 --rc genhtml_legend=1 00:05:51.125 --rc geninfo_all_blocks=1 00:05:51.125 --rc geninfo_unexecuted_blocks=1 00:05:51.125 00:05:51.125 ' 00:05:51.125 05:01:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:51.125 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.125 --rc genhtml_branch_coverage=1 00:05:51.125 --rc genhtml_function_coverage=1 00:05:51.125 --rc genhtml_legend=1 00:05:51.125 --rc geninfo_all_blocks=1 00:05:51.125 --rc geninfo_unexecuted_blocks=1 00:05:51.125 00:05:51.125 ' 00:05:51.125 05:01:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:51.125 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.125 --rc genhtml_branch_coverage=1 00:05:51.125 --rc genhtml_function_coverage=1 00:05:51.125 --rc genhtml_legend=1 00:05:51.125 --rc geninfo_all_blocks=1 00:05:51.125 --rc geninfo_unexecuted_blocks=1 00:05:51.125 00:05:51.125 ' 00:05:51.125 05:01:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:51.125 05:01:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3174988 00:05:51.125 05:01:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:51.125 05:01:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3174988 00:05:51.125 05:01:52 -- common/autotest_common.sh@829 -- # '[' -z 3174988 ']' 00:05:51.125 05:01:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:51.125 05:01:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:51.125 05:01:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:51.125 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:51.125 05:01:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:51.125 05:01:52 -- common/autotest_common.sh@10 -- # set +x 00:05:51.125 [2024-11-26 05:01:52.717146] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:51.125 [2024-11-26 05:01:52.717223] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3174988 ] 00:05:51.125 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.125 [2024-11-26 05:01:52.774307] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.125 [2024-11-26 05:01:52.860410] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:51.125 [2024-11-26 05:01:52.860608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.066 05:01:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:52.066 05:01:53 -- common/autotest_common.sh@862 -- # return 0 00:05:52.066 05:01:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:52.066 05:01:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:52.066 05:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.066 05:01:53 -- common/autotest_common.sh@10 -- # set +x 00:05:52.066 { 00:05:52.066 "filename": "/tmp/spdk_mem_dump.txt" 00:05:52.066 } 00:05:52.066 05:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.066 05:01:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:52.066 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:52.066 1 heaps totaling size 814.000000 MiB 00:05:52.066 size: 814.000000 MiB heap id: 0 00:05:52.066 end heaps---------- 00:05:52.066 8 mempools totaling size 598.116089 MiB 00:05:52.066 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:52.066 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:52.066 size: 84.521057 MiB name: bdev_io_3174988 00:05:52.066 size: 51.011292 MiB name: evtpool_3174988 00:05:52.066 size: 50.003479 MiB name: msgpool_3174988 00:05:52.066 size: 21.763794 MiB name: PDU_Pool 00:05:52.066 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:52.066 size: 0.026123 MiB name: Session_Pool 00:05:52.066 end mempools------- 00:05:52.066 6 memzones totaling size 4.142822 MiB 00:05:52.066 size: 1.000366 MiB name: RG_ring_0_3174988 00:05:52.066 size: 1.000366 MiB name: RG_ring_1_3174988 00:05:52.066 size: 1.000366 MiB name: RG_ring_4_3174988 00:05:52.066 size: 1.000366 MiB name: RG_ring_5_3174988 00:05:52.066 size: 0.125366 MiB name: RG_ring_2_3174988 00:05:52.066 size: 0.015991 MiB name: RG_ring_3_3174988 00:05:52.066 end memzones------- 00:05:52.066 05:01:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:52.066 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:52.066 list of free elements. size: 12.519348 MiB 00:05:52.066 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:52.066 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:52.066 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:52.066 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:52.066 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:52.066 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:52.066 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:52.066 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:52.066 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:52.066 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:52.066 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:52.066 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:52.066 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:52.066 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:52.066 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:52.066 list of standard malloc elements. size: 199.218079 MiB 00:05:52.066 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:52.066 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:52.066 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:52.066 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:52.066 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:52.066 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:52.066 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:52.066 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:52.066 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:52.066 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:52.066 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:52.066 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:52.066 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:52.066 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:52.066 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:52.066 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:52.066 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:52.066 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:52.066 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:52.066 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:52.066 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:52.066 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:52.066 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:52.066 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:52.066 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:52.066 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:52.066 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:52.066 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:52.066 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:52.066 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:52.066 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:52.066 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:52.066 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:52.066 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:52.066 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:52.066 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:52.066 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:52.066 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:52.066 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:52.066 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:52.066 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:52.066 list of memzone associated elements. size: 602.262573 MiB 00:05:52.066 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:52.067 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:52.067 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:52.067 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:52.067 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:52.067 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3174988_0 00:05:52.067 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:52.067 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3174988_0 00:05:52.067 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:52.067 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3174988_0 00:05:52.067 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:52.067 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:52.067 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:52.067 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:52.067 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:52.067 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3174988 00:05:52.067 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:52.067 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3174988 00:05:52.067 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:52.067 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3174988 00:05:52.067 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:52.067 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:52.067 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:52.067 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:52.067 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:52.067 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:52.067 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:52.067 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:52.067 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:52.067 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3174988 00:05:52.067 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:52.067 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3174988 00:05:52.067 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:52.067 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3174988 00:05:52.067 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:52.067 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3174988 00:05:52.067 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:52.067 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3174988 00:05:52.067 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:52.067 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:52.067 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:52.067 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:52.067 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:52.067 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:52.067 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:52.067 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3174988 00:05:52.067 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:52.067 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:52.067 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:52.067 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:52.067 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:52.067 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3174988 00:05:52.067 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:52.067 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:52.067 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:52.067 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3174988 00:05:52.067 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:52.067 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3174988 00:05:52.067 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:52.067 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:52.067 05:01:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:52.067 05:01:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3174988 00:05:52.067 05:01:53 -- common/autotest_common.sh@936 -- # '[' -z 3174988 ']' 00:05:52.067 05:01:53 -- common/autotest_common.sh@940 -- # kill -0 3174988 00:05:52.067 05:01:53 -- common/autotest_common.sh@941 -- # uname 00:05:52.067 05:01:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:52.067 05:01:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3174988 00:05:52.067 05:01:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:52.067 05:01:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:52.067 05:01:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3174988' 00:05:52.067 killing process with pid 3174988 00:05:52.067 05:01:53 -- common/autotest_common.sh@955 -- # kill 3174988 00:05:52.067 05:01:53 -- common/autotest_common.sh@960 -- # wait 3174988 00:05:52.636 00:05:52.636 real 0m1.689s 00:05:52.636 user 0m1.847s 00:05:52.636 sys 0m0.464s 00:05:52.636 05:01:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.636 05:01:54 -- common/autotest_common.sh@10 -- # set +x 00:05:52.636 ************************************ 00:05:52.636 END TEST dpdk_mem_utility 00:05:52.636 ************************************ 00:05:52.636 05:01:54 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:52.636 05:01:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:52.636 05:01:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.636 05:01:54 -- common/autotest_common.sh@10 -- # set +x 00:05:52.636 ************************************ 00:05:52.636 START TEST event 00:05:52.636 ************************************ 00:05:52.636 05:01:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:52.636 * Looking for test storage... 00:05:52.636 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:52.636 05:01:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:52.636 05:01:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:52.636 05:01:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:52.636 05:01:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:52.636 05:01:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:52.636 05:01:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:52.636 05:01:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:52.636 05:01:54 -- scripts/common.sh@335 -- # IFS=.-: 00:05:52.636 05:01:54 -- scripts/common.sh@335 -- # read -ra ver1 00:05:52.636 05:01:54 -- scripts/common.sh@336 -- # IFS=.-: 00:05:52.636 05:01:54 -- scripts/common.sh@336 -- # read -ra ver2 00:05:52.636 05:01:54 -- scripts/common.sh@337 -- # local 'op=<' 00:05:52.636 05:01:54 -- scripts/common.sh@339 -- # ver1_l=2 00:05:52.636 05:01:54 -- scripts/common.sh@340 -- # ver2_l=1 00:05:52.636 05:01:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:52.636 05:01:54 -- scripts/common.sh@343 -- # case "$op" in 00:05:52.636 05:01:54 -- scripts/common.sh@344 -- # : 1 00:05:52.636 05:01:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:52.636 05:01:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:52.636 05:01:54 -- scripts/common.sh@364 -- # decimal 1 00:05:52.636 05:01:54 -- scripts/common.sh@352 -- # local d=1 00:05:52.636 05:01:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:52.636 05:01:54 -- scripts/common.sh@354 -- # echo 1 00:05:52.636 05:01:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:52.636 05:01:54 -- scripts/common.sh@365 -- # decimal 2 00:05:52.636 05:01:54 -- scripts/common.sh@352 -- # local d=2 00:05:52.636 05:01:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:52.636 05:01:54 -- scripts/common.sh@354 -- # echo 2 00:05:52.636 05:01:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:52.636 05:01:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:52.636 05:01:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:52.636 05:01:54 -- scripts/common.sh@367 -- # return 0 00:05:52.636 05:01:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:52.636 05:01:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:52.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.636 --rc genhtml_branch_coverage=1 00:05:52.636 --rc genhtml_function_coverage=1 00:05:52.636 --rc genhtml_legend=1 00:05:52.636 --rc geninfo_all_blocks=1 00:05:52.636 --rc geninfo_unexecuted_blocks=1 00:05:52.636 00:05:52.636 ' 00:05:52.636 05:01:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:52.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.636 --rc genhtml_branch_coverage=1 00:05:52.636 --rc genhtml_function_coverage=1 00:05:52.636 --rc genhtml_legend=1 00:05:52.636 --rc geninfo_all_blocks=1 00:05:52.636 --rc geninfo_unexecuted_blocks=1 00:05:52.636 00:05:52.636 ' 00:05:52.636 05:01:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:52.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.636 --rc genhtml_branch_coverage=1 00:05:52.636 --rc genhtml_function_coverage=1 00:05:52.636 --rc genhtml_legend=1 00:05:52.636 --rc geninfo_all_blocks=1 00:05:52.636 --rc geninfo_unexecuted_blocks=1 00:05:52.636 00:05:52.636 ' 00:05:52.636 05:01:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:52.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.636 --rc genhtml_branch_coverage=1 00:05:52.636 --rc genhtml_function_coverage=1 00:05:52.636 --rc genhtml_legend=1 00:05:52.636 --rc geninfo_all_blocks=1 00:05:52.636 --rc geninfo_unexecuted_blocks=1 00:05:52.636 00:05:52.636 ' 00:05:52.636 05:01:54 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:52.636 05:01:54 -- bdev/nbd_common.sh@6 -- # set -e 00:05:52.636 05:01:54 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:52.636 05:01:54 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:52.636 05:01:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.636 05:01:54 -- common/autotest_common.sh@10 -- # set +x 00:05:52.897 ************************************ 00:05:52.897 START TEST event_perf 00:05:52.897 ************************************ 00:05:52.897 05:01:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:52.897 Running I/O for 1 seconds...[2024-11-26 05:01:54.414302] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.897 [2024-11-26 05:01:54.414384] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3175195 ] 00:05:52.897 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.897 [2024-11-26 05:01:54.480047] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:52.897 [2024-11-26 05:01:54.574923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:52.897 [2024-11-26 05:01:54.574963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:52.897 [2024-11-26 05:01:54.575094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:52.897 [2024-11-26 05:01:54.575096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.272 Running I/O for 1 seconds... 00:05:54.272 lcore 0: 226499 00:05:54.272 lcore 1: 226498 00:05:54.272 lcore 2: 226499 00:05:54.272 lcore 3: 226499 00:05:54.272 done. 00:05:54.272 00:05:54.272 real 0m1.254s 00:05:54.272 user 0m4.162s 00:05:54.272 sys 0m0.086s 00:05:54.272 05:01:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:54.272 05:01:55 -- common/autotest_common.sh@10 -- # set +x 00:05:54.272 ************************************ 00:05:54.272 END TEST event_perf 00:05:54.272 ************************************ 00:05:54.272 05:01:55 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:54.272 05:01:55 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:54.272 05:01:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.272 05:01:55 -- common/autotest_common.sh@10 -- # set +x 00:05:54.272 ************************************ 00:05:54.272 START TEST event_reactor 00:05:54.272 ************************************ 00:05:54.272 05:01:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:54.272 [2024-11-26 05:01:55.695865] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.272 [2024-11-26 05:01:55.695951] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3175457 ] 00:05:54.272 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.272 [2024-11-26 05:01:55.758265] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.272 [2024-11-26 05:01:55.848505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.210 test_start 00:05:55.210 oneshot 00:05:55.210 tick 100 00:05:55.210 tick 100 00:05:55.210 tick 250 00:05:55.210 tick 100 00:05:55.210 tick 100 00:05:55.210 tick 100 00:05:55.210 tick 250 00:05:55.210 tick 500 00:05:55.210 tick 100 00:05:55.210 tick 100 00:05:55.210 tick 250 00:05:55.210 tick 100 00:05:55.210 tick 100 00:05:55.210 test_end 00:05:55.210 00:05:55.210 real 0m1.250s 00:05:55.210 user 0m1.165s 00:05:55.210 sys 0m0.079s 00:05:55.210 05:01:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:55.210 05:01:56 -- common/autotest_common.sh@10 -- # set +x 00:05:55.210 ************************************ 00:05:55.210 END TEST event_reactor 00:05:55.210 ************************************ 00:05:55.211 05:01:56 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:55.211 05:01:56 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:55.211 05:01:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.211 05:01:56 -- common/autotest_common.sh@10 -- # set +x 00:05:55.211 ************************************ 00:05:55.211 START TEST event_reactor_perf 00:05:55.211 ************************************ 00:05:55.211 05:01:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:55.211 [2024-11-26 05:01:56.972460] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.211 [2024-11-26 05:01:56.972547] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3175633 ] 00:05:55.470 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.470 [2024-11-26 05:01:57.036462] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.470 [2024-11-26 05:01:57.127232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.848 test_start 00:05:56.848 test_end 00:05:56.848 Performance: 352224 events per second 00:05:56.848 00:05:56.848 real 0m1.252s 00:05:56.848 user 0m1.157s 00:05:56.848 sys 0m0.089s 00:05:56.848 05:01:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:56.848 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:56.848 ************************************ 00:05:56.848 END TEST event_reactor_perf 00:05:56.848 ************************************ 00:05:56.848 05:01:58 -- event/event.sh@49 -- # uname -s 00:05:56.848 05:01:58 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:05:56.848 05:01:58 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:56.848 05:01:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:56.848 05:01:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.848 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:56.848 ************************************ 00:05:56.848 START TEST event_scheduler 00:05:56.848 ************************************ 00:05:56.848 05:01:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:56.848 * Looking for test storage... 00:05:56.848 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:05:56.848 05:01:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:56.848 05:01:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:56.848 05:01:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:56.848 05:01:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:56.848 05:01:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:56.848 05:01:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:56.848 05:01:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:56.848 05:01:58 -- scripts/common.sh@335 -- # IFS=.-: 00:05:56.848 05:01:58 -- scripts/common.sh@335 -- # read -ra ver1 00:05:56.848 05:01:58 -- scripts/common.sh@336 -- # IFS=.-: 00:05:56.848 05:01:58 -- scripts/common.sh@336 -- # read -ra ver2 00:05:56.848 05:01:58 -- scripts/common.sh@337 -- # local 'op=<' 00:05:56.848 05:01:58 -- scripts/common.sh@339 -- # ver1_l=2 00:05:56.848 05:01:58 -- scripts/common.sh@340 -- # ver2_l=1 00:05:56.848 05:01:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:56.848 05:01:58 -- scripts/common.sh@343 -- # case "$op" in 00:05:56.848 05:01:58 -- scripts/common.sh@344 -- # : 1 00:05:56.848 05:01:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:56.848 05:01:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:56.848 05:01:58 -- scripts/common.sh@364 -- # decimal 1 00:05:56.848 05:01:58 -- scripts/common.sh@352 -- # local d=1 00:05:56.848 05:01:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:56.848 05:01:58 -- scripts/common.sh@354 -- # echo 1 00:05:56.848 05:01:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:56.848 05:01:58 -- scripts/common.sh@365 -- # decimal 2 00:05:56.848 05:01:58 -- scripts/common.sh@352 -- # local d=2 00:05:56.848 05:01:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:56.848 05:01:58 -- scripts/common.sh@354 -- # echo 2 00:05:56.848 05:01:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:56.848 05:01:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:56.848 05:01:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:56.848 05:01:58 -- scripts/common.sh@367 -- # return 0 00:05:56.848 05:01:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:56.848 05:01:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:56.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.848 --rc genhtml_branch_coverage=1 00:05:56.848 --rc genhtml_function_coverage=1 00:05:56.848 --rc genhtml_legend=1 00:05:56.848 --rc geninfo_all_blocks=1 00:05:56.848 --rc geninfo_unexecuted_blocks=1 00:05:56.848 00:05:56.848 ' 00:05:56.848 05:01:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:56.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.848 --rc genhtml_branch_coverage=1 00:05:56.848 --rc genhtml_function_coverage=1 00:05:56.848 --rc genhtml_legend=1 00:05:56.848 --rc geninfo_all_blocks=1 00:05:56.848 --rc geninfo_unexecuted_blocks=1 00:05:56.848 00:05:56.848 ' 00:05:56.848 05:01:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:56.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.848 --rc genhtml_branch_coverage=1 00:05:56.848 --rc genhtml_function_coverage=1 00:05:56.848 --rc genhtml_legend=1 00:05:56.848 --rc geninfo_all_blocks=1 00:05:56.848 --rc geninfo_unexecuted_blocks=1 00:05:56.848 00:05:56.848 ' 00:05:56.848 05:01:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:56.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.848 --rc genhtml_branch_coverage=1 00:05:56.849 --rc genhtml_function_coverage=1 00:05:56.849 --rc genhtml_legend=1 00:05:56.849 --rc geninfo_all_blocks=1 00:05:56.849 --rc geninfo_unexecuted_blocks=1 00:05:56.849 00:05:56.849 ' 00:05:56.849 05:01:58 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:05:56.849 05:01:58 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3175822 00:05:56.849 05:01:58 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:05:56.849 05:01:58 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:05:56.849 05:01:58 -- scheduler/scheduler.sh@37 -- # waitforlisten 3175822 00:05:56.849 05:01:58 -- common/autotest_common.sh@829 -- # '[' -z 3175822 ']' 00:05:56.849 05:01:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:56.849 05:01:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:56.849 05:01:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:56.849 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:56.849 05:01:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:56.849 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:56.849 [2024-11-26 05:01:58.415858] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.849 [2024-11-26 05:01:58.415947] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3175822 ] 00:05:56.849 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.849 [2024-11-26 05:01:58.476197] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:56.849 [2024-11-26 05:01:58.563745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.849 [2024-11-26 05:01:58.563809] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:56.849 [2024-11-26 05:01:58.563875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:56.849 [2024-11-26 05:01:58.563878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:57.109 05:01:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:57.109 05:01:58 -- common/autotest_common.sh@862 -- # return 0 00:05:57.109 05:01:58 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:05:57.109 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.109 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.109 POWER: Env isn't set yet! 00:05:57.109 POWER: Attempting to initialise ACPI cpufreq power management... 00:05:57.109 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:05:57.109 POWER: Cannot get available frequencies of lcore 0 00:05:57.109 POWER: Attempting to initialise PSTAT power management... 00:05:57.109 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:05:57.109 POWER: Initialized successfully for lcore 0 power management 00:05:57.109 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:05:57.109 POWER: Initialized successfully for lcore 1 power management 00:05:57.109 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:05:57.109 POWER: Initialized successfully for lcore 2 power management 00:05:57.109 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:05:57.109 POWER: Initialized successfully for lcore 3 power management 00:05:57.109 [2024-11-26 05:01:58.679887] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:05:57.109 [2024-11-26 05:01:58.679905] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:05:57.109 [2024-11-26 05:01:58.679915] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:05:57.109 05:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.109 05:01:58 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:05:57.109 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.109 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.109 [2024-11-26 05:01:58.778228] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:05:57.109 05:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.109 05:01:58 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:05:57.109 05:01:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:57.109 05:01:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.109 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.109 ************************************ 00:05:57.109 START TEST scheduler_create_thread 00:05:57.109 ************************************ 00:05:57.109 05:01:58 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:05:57.109 05:01:58 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:05:57.109 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.109 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.109 2 00:05:57.109 05:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.109 05:01:58 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:05:57.109 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.109 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.109 3 00:05:57.109 05:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.109 05:01:58 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:05:57.109 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.109 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.109 4 00:05:57.109 05:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.109 05:01:58 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:05:57.109 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.109 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.109 5 00:05:57.109 05:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.109 05:01:58 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:05:57.109 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.109 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.109 6 00:05:57.109 05:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.109 05:01:58 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:05:57.109 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.109 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.109 7 00:05:57.109 05:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.109 05:01:58 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:05:57.109 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.109 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.109 8 00:05:57.109 05:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.109 05:01:58 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:05:57.109 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.109 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.109 9 00:05:57.109 05:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.109 05:01:58 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:05:57.109 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.109 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.371 10 00:05:57.371 05:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.371 05:01:58 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:05:57.371 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.371 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.371 05:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.371 05:01:58 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:05:57.371 05:01:58 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:05:57.371 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.371 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:57.371 05:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.371 05:01:58 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:05:57.371 05:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.371 05:01:58 -- common/autotest_common.sh@10 -- # set +x 00:05:58.781 05:02:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.781 05:02:00 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:58.781 05:02:00 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:58.781 05:02:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.781 05:02:00 -- common/autotest_common.sh@10 -- # set +x 00:05:59.718 05:02:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:59.718 00:05:59.718 real 0m2.621s 00:05:59.718 user 0m0.012s 00:05:59.718 sys 0m0.002s 00:05:59.718 05:02:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:59.718 05:02:01 -- common/autotest_common.sh@10 -- # set +x 00:05:59.718 ************************************ 00:05:59.718 END TEST scheduler_create_thread 00:05:59.718 ************************************ 00:05:59.718 05:02:01 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:59.718 05:02:01 -- scheduler/scheduler.sh@46 -- # killprocess 3175822 00:05:59.718 05:02:01 -- common/autotest_common.sh@936 -- # '[' -z 3175822 ']' 00:05:59.718 05:02:01 -- common/autotest_common.sh@940 -- # kill -0 3175822 00:05:59.718 05:02:01 -- common/autotest_common.sh@941 -- # uname 00:05:59.718 05:02:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:59.718 05:02:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3175822 00:05:59.718 05:02:01 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:59.718 05:02:01 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:59.718 05:02:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3175822' 00:05:59.718 killing process with pid 3175822 00:05:59.718 05:02:01 -- common/autotest_common.sh@955 -- # kill 3175822 00:05:59.718 05:02:01 -- common/autotest_common.sh@960 -- # wait 3175822 00:06:00.289 [2024-11-26 05:02:01.885533] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:00.289 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:00.289 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:00.289 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:00.290 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:00.290 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:00.290 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:00.290 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:00.290 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:00.550 00:06:00.550 real 0m3.868s 00:06:00.550 user 0m5.897s 00:06:00.550 sys 0m0.328s 00:06:00.550 05:02:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.550 05:02:02 -- common/autotest_common.sh@10 -- # set +x 00:06:00.550 ************************************ 00:06:00.550 END TEST event_scheduler 00:06:00.550 ************************************ 00:06:00.550 05:02:02 -- event/event.sh@51 -- # modprobe -n nbd 00:06:00.550 05:02:02 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:00.550 05:02:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:00.550 05:02:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.550 05:02:02 -- common/autotest_common.sh@10 -- # set +x 00:06:00.550 ************************************ 00:06:00.550 START TEST app_repeat 00:06:00.550 ************************************ 00:06:00.550 05:02:02 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:06:00.550 05:02:02 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:00.550 05:02:02 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:00.550 05:02:02 -- event/event.sh@13 -- # local nbd_list 00:06:00.550 05:02:02 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:00.550 05:02:02 -- event/event.sh@14 -- # local bdev_list 00:06:00.550 05:02:02 -- event/event.sh@15 -- # local repeat_times=4 00:06:00.550 05:02:02 -- event/event.sh@17 -- # modprobe nbd 00:06:00.550 05:02:02 -- event/event.sh@19 -- # repeat_pid=3176294 00:06:00.550 05:02:02 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:00.550 05:02:02 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:00.550 05:02:02 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3176294' 00:06:00.550 Process app_repeat pid: 3176294 00:06:00.550 05:02:02 -- event/event.sh@23 -- # for i in {0..2} 00:06:00.550 05:02:02 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:00.550 spdk_app_start Round 0 00:06:00.550 05:02:02 -- event/event.sh@25 -- # waitforlisten 3176294 /var/tmp/spdk-nbd.sock 00:06:00.550 05:02:02 -- common/autotest_common.sh@829 -- # '[' -z 3176294 ']' 00:06:00.550 05:02:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:00.550 05:02:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:00.550 05:02:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:00.550 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:00.550 05:02:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:00.550 05:02:02 -- common/autotest_common.sh@10 -- # set +x 00:06:00.550 [2024-11-26 05:02:02.167822] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.550 [2024-11-26 05:02:02.167899] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3176294 ] 00:06:00.550 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.550 [2024-11-26 05:02:02.226186] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:00.550 [2024-11-26 05:02:02.311367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:00.550 [2024-11-26 05:02:02.311372] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.487 05:02:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:01.487 05:02:03 -- common/autotest_common.sh@862 -- # return 0 00:06:01.487 05:02:03 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:01.745 Malloc0 00:06:01.745 05:02:03 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:02.003 Malloc1 00:06:02.003 05:02:03 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@12 -- # local i 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:02.003 05:02:03 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:02.261 /dev/nbd0 00:06:02.262 05:02:03 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:02.262 05:02:03 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:02.262 05:02:03 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:02.262 05:02:03 -- common/autotest_common.sh@867 -- # local i 00:06:02.262 05:02:03 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:02.262 05:02:03 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:02.262 05:02:03 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:02.262 05:02:03 -- common/autotest_common.sh@871 -- # break 00:06:02.262 05:02:03 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:02.262 05:02:03 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:02.262 05:02:03 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:02.262 1+0 records in 00:06:02.262 1+0 records out 00:06:02.262 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000148541 s, 27.6 MB/s 00:06:02.262 05:02:03 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:02.262 05:02:03 -- common/autotest_common.sh@884 -- # size=4096 00:06:02.262 05:02:03 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:02.262 05:02:03 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:02.262 05:02:03 -- common/autotest_common.sh@887 -- # return 0 00:06:02.262 05:02:03 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:02.262 05:02:03 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:02.262 05:02:03 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:02.520 /dev/nbd1 00:06:02.520 05:02:04 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:02.520 05:02:04 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:02.520 05:02:04 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:02.520 05:02:04 -- common/autotest_common.sh@867 -- # local i 00:06:02.520 05:02:04 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:02.520 05:02:04 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:02.520 05:02:04 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:02.520 05:02:04 -- common/autotest_common.sh@871 -- # break 00:06:02.520 05:02:04 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:02.520 05:02:04 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:02.520 05:02:04 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:02.520 1+0 records in 00:06:02.520 1+0 records out 00:06:02.520 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000222441 s, 18.4 MB/s 00:06:02.520 05:02:04 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:02.520 05:02:04 -- common/autotest_common.sh@884 -- # size=4096 00:06:02.520 05:02:04 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:02.520 05:02:04 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:02.520 05:02:04 -- common/autotest_common.sh@887 -- # return 0 00:06:02.520 05:02:04 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:02.520 05:02:04 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:02.520 05:02:04 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:02.520 05:02:04 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:02.520 05:02:04 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:02.779 05:02:04 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:02.779 { 00:06:02.779 "nbd_device": "/dev/nbd0", 00:06:02.779 "bdev_name": "Malloc0" 00:06:02.779 }, 00:06:02.779 { 00:06:02.779 "nbd_device": "/dev/nbd1", 00:06:02.779 "bdev_name": "Malloc1" 00:06:02.779 } 00:06:02.779 ]' 00:06:02.779 05:02:04 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:02.779 { 00:06:02.779 "nbd_device": "/dev/nbd0", 00:06:02.779 "bdev_name": "Malloc0" 00:06:02.779 }, 00:06:02.779 { 00:06:02.779 "nbd_device": "/dev/nbd1", 00:06:02.779 "bdev_name": "Malloc1" 00:06:02.779 } 00:06:02.779 ]' 00:06:02.779 05:02:04 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:03.037 /dev/nbd1' 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:03.037 /dev/nbd1' 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@65 -- # count=2 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@95 -- # count=2 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:03.037 256+0 records in 00:06:03.037 256+0 records out 00:06:03.037 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00511085 s, 205 MB/s 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:03.037 256+0 records in 00:06:03.037 256+0 records out 00:06:03.037 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222001 s, 47.2 MB/s 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:03.037 256+0 records in 00:06:03.037 256+0 records out 00:06:03.037 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221429 s, 47.4 MB/s 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@51 -- # local i 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:03.037 05:02:04 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:03.295 05:02:04 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:03.295 05:02:04 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:03.295 05:02:04 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:03.295 05:02:04 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:03.295 05:02:04 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:03.295 05:02:04 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:03.295 05:02:04 -- bdev/nbd_common.sh@41 -- # break 00:06:03.295 05:02:04 -- bdev/nbd_common.sh@45 -- # return 0 00:06:03.295 05:02:04 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:03.295 05:02:04 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:03.553 05:02:05 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:03.553 05:02:05 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:03.553 05:02:05 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:03.553 05:02:05 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:03.553 05:02:05 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:03.553 05:02:05 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:03.553 05:02:05 -- bdev/nbd_common.sh@41 -- # break 00:06:03.553 05:02:05 -- bdev/nbd_common.sh@45 -- # return 0 00:06:03.553 05:02:05 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:03.553 05:02:05 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:03.553 05:02:05 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:03.810 05:02:05 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:03.810 05:02:05 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:03.810 05:02:05 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:03.811 05:02:05 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:03.811 05:02:05 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:03.811 05:02:05 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:03.811 05:02:05 -- bdev/nbd_common.sh@65 -- # true 00:06:03.811 05:02:05 -- bdev/nbd_common.sh@65 -- # count=0 00:06:03.811 05:02:05 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:03.811 05:02:05 -- bdev/nbd_common.sh@104 -- # count=0 00:06:03.811 05:02:05 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:03.811 05:02:05 -- bdev/nbd_common.sh@109 -- # return 0 00:06:03.811 05:02:05 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:04.069 05:02:05 -- event/event.sh@35 -- # sleep 3 00:06:04.328 [2024-11-26 05:02:06.006283] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:04.586 [2024-11-26 05:02:06.093793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:04.586 [2024-11-26 05:02:06.093793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.586 [2024-11-26 05:02:06.155038] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:04.586 [2024-11-26 05:02:06.155125] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:07.122 05:02:08 -- event/event.sh@23 -- # for i in {0..2} 00:06:07.123 05:02:08 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:07.123 spdk_app_start Round 1 00:06:07.123 05:02:08 -- event/event.sh@25 -- # waitforlisten 3176294 /var/tmp/spdk-nbd.sock 00:06:07.123 05:02:08 -- common/autotest_common.sh@829 -- # '[' -z 3176294 ']' 00:06:07.123 05:02:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:07.123 05:02:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:07.123 05:02:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:07.123 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:07.123 05:02:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:07.123 05:02:08 -- common/autotest_common.sh@10 -- # set +x 00:06:07.381 05:02:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:07.381 05:02:09 -- common/autotest_common.sh@862 -- # return 0 00:06:07.381 05:02:09 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:07.639 Malloc0 00:06:07.639 05:02:09 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:07.897 Malloc1 00:06:07.897 05:02:09 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:07.897 05:02:09 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:07.897 05:02:09 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:07.897 05:02:09 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:07.897 05:02:09 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.897 05:02:09 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:07.897 05:02:09 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:07.897 05:02:09 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:07.897 05:02:09 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:07.897 05:02:09 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:07.897 05:02:09 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.898 05:02:09 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:07.898 05:02:09 -- bdev/nbd_common.sh@12 -- # local i 00:06:07.898 05:02:09 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:07.898 05:02:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:07.898 05:02:09 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:08.156 /dev/nbd0 00:06:08.156 05:02:09 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:08.156 05:02:09 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:08.156 05:02:09 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:08.156 05:02:09 -- common/autotest_common.sh@867 -- # local i 00:06:08.156 05:02:09 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:08.156 05:02:09 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:08.156 05:02:09 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:08.156 05:02:09 -- common/autotest_common.sh@871 -- # break 00:06:08.156 05:02:09 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:08.156 05:02:09 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:08.156 05:02:09 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:08.156 1+0 records in 00:06:08.156 1+0 records out 00:06:08.156 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000159255 s, 25.7 MB/s 00:06:08.156 05:02:09 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.156 05:02:09 -- common/autotest_common.sh@884 -- # size=4096 00:06:08.156 05:02:09 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.156 05:02:09 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:08.156 05:02:09 -- common/autotest_common.sh@887 -- # return 0 00:06:08.156 05:02:09 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:08.156 05:02:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:08.156 05:02:09 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:08.414 /dev/nbd1 00:06:08.414 05:02:10 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:08.414 05:02:10 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:08.414 05:02:10 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:08.414 05:02:10 -- common/autotest_common.sh@867 -- # local i 00:06:08.414 05:02:10 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:08.414 05:02:10 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:08.414 05:02:10 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:08.414 05:02:10 -- common/autotest_common.sh@871 -- # break 00:06:08.414 05:02:10 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:08.414 05:02:10 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:08.414 05:02:10 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:08.414 1+0 records in 00:06:08.414 1+0 records out 00:06:08.414 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000178221 s, 23.0 MB/s 00:06:08.414 05:02:10 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.414 05:02:10 -- common/autotest_common.sh@884 -- # size=4096 00:06:08.414 05:02:10 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.414 05:02:10 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:08.414 05:02:10 -- common/autotest_common.sh@887 -- # return 0 00:06:08.414 05:02:10 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:08.414 05:02:10 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:08.414 05:02:10 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:08.414 05:02:10 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.414 05:02:10 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:08.983 { 00:06:08.983 "nbd_device": "/dev/nbd0", 00:06:08.983 "bdev_name": "Malloc0" 00:06:08.983 }, 00:06:08.983 { 00:06:08.983 "nbd_device": "/dev/nbd1", 00:06:08.983 "bdev_name": "Malloc1" 00:06:08.983 } 00:06:08.983 ]' 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:08.983 { 00:06:08.983 "nbd_device": "/dev/nbd0", 00:06:08.983 "bdev_name": "Malloc0" 00:06:08.983 }, 00:06:08.983 { 00:06:08.983 "nbd_device": "/dev/nbd1", 00:06:08.983 "bdev_name": "Malloc1" 00:06:08.983 } 00:06:08.983 ]' 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:08.983 /dev/nbd1' 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:08.983 /dev/nbd1' 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@65 -- # count=2 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@95 -- # count=2 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:08.983 256+0 records in 00:06:08.983 256+0 records out 00:06:08.983 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0050521 s, 208 MB/s 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:08.983 256+0 records in 00:06:08.983 256+0 records out 00:06:08.983 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202948 s, 51.7 MB/s 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:08.983 256+0 records in 00:06:08.983 256+0 records out 00:06:08.983 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237207 s, 44.2 MB/s 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@51 -- # local i 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:08.983 05:02:10 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:09.241 05:02:10 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:09.241 05:02:10 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:09.241 05:02:10 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:09.241 05:02:10 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:09.241 05:02:10 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:09.241 05:02:10 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:09.241 05:02:10 -- bdev/nbd_common.sh@41 -- # break 00:06:09.241 05:02:10 -- bdev/nbd_common.sh@45 -- # return 0 00:06:09.241 05:02:10 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:09.241 05:02:10 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:09.499 05:02:11 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:09.499 05:02:11 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:09.499 05:02:11 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:09.499 05:02:11 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:09.499 05:02:11 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:09.499 05:02:11 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:09.499 05:02:11 -- bdev/nbd_common.sh@41 -- # break 00:06:09.499 05:02:11 -- bdev/nbd_common.sh@45 -- # return 0 00:06:09.499 05:02:11 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:09.499 05:02:11 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:09.499 05:02:11 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:09.758 05:02:11 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:09.758 05:02:11 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:09.758 05:02:11 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:09.758 05:02:11 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:09.758 05:02:11 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:09.758 05:02:11 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:09.758 05:02:11 -- bdev/nbd_common.sh@65 -- # true 00:06:09.758 05:02:11 -- bdev/nbd_common.sh@65 -- # count=0 00:06:09.758 05:02:11 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:09.758 05:02:11 -- bdev/nbd_common.sh@104 -- # count=0 00:06:09.758 05:02:11 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:09.758 05:02:11 -- bdev/nbd_common.sh@109 -- # return 0 00:06:09.758 05:02:11 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:10.017 05:02:11 -- event/event.sh@35 -- # sleep 3 00:06:10.277 [2024-11-26 05:02:11.904351] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:10.277 [2024-11-26 05:02:11.989545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:10.277 [2024-11-26 05:02:11.989551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.535 [2024-11-26 05:02:12.050019] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:10.535 [2024-11-26 05:02:12.050103] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:13.068 05:02:14 -- event/event.sh@23 -- # for i in {0..2} 00:06:13.068 05:02:14 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:13.068 spdk_app_start Round 2 00:06:13.068 05:02:14 -- event/event.sh@25 -- # waitforlisten 3176294 /var/tmp/spdk-nbd.sock 00:06:13.068 05:02:14 -- common/autotest_common.sh@829 -- # '[' -z 3176294 ']' 00:06:13.068 05:02:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:13.069 05:02:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:13.069 05:02:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:13.069 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:13.069 05:02:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:13.069 05:02:14 -- common/autotest_common.sh@10 -- # set +x 00:06:13.326 05:02:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:13.326 05:02:14 -- common/autotest_common.sh@862 -- # return 0 00:06:13.326 05:02:14 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:13.584 Malloc0 00:06:13.584 05:02:15 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:13.842 Malloc1 00:06:13.842 05:02:15 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@12 -- # local i 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:13.842 05:02:15 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:14.100 /dev/nbd0 00:06:14.100 05:02:15 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:14.100 05:02:15 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:14.100 05:02:15 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:14.100 05:02:15 -- common/autotest_common.sh@867 -- # local i 00:06:14.100 05:02:15 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:14.100 05:02:15 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:14.100 05:02:15 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:14.100 05:02:15 -- common/autotest_common.sh@871 -- # break 00:06:14.100 05:02:15 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:14.100 05:02:15 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:14.100 05:02:15 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:14.100 1+0 records in 00:06:14.100 1+0 records out 00:06:14.100 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000258847 s, 15.8 MB/s 00:06:14.100 05:02:15 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.100 05:02:15 -- common/autotest_common.sh@884 -- # size=4096 00:06:14.100 05:02:15 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.100 05:02:15 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:14.100 05:02:15 -- common/autotest_common.sh@887 -- # return 0 00:06:14.100 05:02:15 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:14.100 05:02:15 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.100 05:02:15 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:14.358 /dev/nbd1 00:06:14.358 05:02:16 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:14.358 05:02:16 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:14.358 05:02:16 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:14.358 05:02:16 -- common/autotest_common.sh@867 -- # local i 00:06:14.358 05:02:16 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:14.358 05:02:16 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:14.358 05:02:16 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:14.358 05:02:16 -- common/autotest_common.sh@871 -- # break 00:06:14.358 05:02:16 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:14.358 05:02:16 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:14.358 05:02:16 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:14.358 1+0 records in 00:06:14.358 1+0 records out 00:06:14.358 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000186245 s, 22.0 MB/s 00:06:14.358 05:02:16 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.358 05:02:16 -- common/autotest_common.sh@884 -- # size=4096 00:06:14.358 05:02:16 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.358 05:02:16 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:14.358 05:02:16 -- common/autotest_common.sh@887 -- # return 0 00:06:14.358 05:02:16 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:14.358 05:02:16 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.358 05:02:16 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:14.358 05:02:16 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.358 05:02:16 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:14.615 05:02:16 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:14.616 { 00:06:14.616 "nbd_device": "/dev/nbd0", 00:06:14.616 "bdev_name": "Malloc0" 00:06:14.616 }, 00:06:14.616 { 00:06:14.616 "nbd_device": "/dev/nbd1", 00:06:14.616 "bdev_name": "Malloc1" 00:06:14.616 } 00:06:14.616 ]' 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:14.616 { 00:06:14.616 "nbd_device": "/dev/nbd0", 00:06:14.616 "bdev_name": "Malloc0" 00:06:14.616 }, 00:06:14.616 { 00:06:14.616 "nbd_device": "/dev/nbd1", 00:06:14.616 "bdev_name": "Malloc1" 00:06:14.616 } 00:06:14.616 ]' 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:14.616 /dev/nbd1' 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:14.616 /dev/nbd1' 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@65 -- # count=2 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@95 -- # count=2 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:14.616 256+0 records in 00:06:14.616 256+0 records out 00:06:14.616 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.004778 s, 219 MB/s 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:14.616 256+0 records in 00:06:14.616 256+0 records out 00:06:14.616 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221872 s, 47.3 MB/s 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:14.616 05:02:16 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:14.875 256+0 records in 00:06:14.875 256+0 records out 00:06:14.875 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218263 s, 48.0 MB/s 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@51 -- # local i 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:14.875 05:02:16 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:15.134 05:02:16 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:15.134 05:02:16 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:15.134 05:02:16 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:15.134 05:02:16 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:15.134 05:02:16 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:15.134 05:02:16 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:15.134 05:02:16 -- bdev/nbd_common.sh@41 -- # break 00:06:15.134 05:02:16 -- bdev/nbd_common.sh@45 -- # return 0 00:06:15.134 05:02:16 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:15.134 05:02:16 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:15.392 05:02:16 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:15.392 05:02:16 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:15.392 05:02:16 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:15.392 05:02:16 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:15.392 05:02:16 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:15.392 05:02:16 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:15.392 05:02:16 -- bdev/nbd_common.sh@41 -- # break 00:06:15.392 05:02:16 -- bdev/nbd_common.sh@45 -- # return 0 00:06:15.393 05:02:16 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:15.393 05:02:16 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.393 05:02:16 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:15.650 05:02:17 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:15.650 05:02:17 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:15.650 05:02:17 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:15.650 05:02:17 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:15.650 05:02:17 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:15.650 05:02:17 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:15.650 05:02:17 -- bdev/nbd_common.sh@65 -- # true 00:06:15.650 05:02:17 -- bdev/nbd_common.sh@65 -- # count=0 00:06:15.650 05:02:17 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:15.650 05:02:17 -- bdev/nbd_common.sh@104 -- # count=0 00:06:15.650 05:02:17 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:15.650 05:02:17 -- bdev/nbd_common.sh@109 -- # return 0 00:06:15.650 05:02:17 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:15.908 05:02:17 -- event/event.sh@35 -- # sleep 3 00:06:16.168 [2024-11-26 05:02:17.756550] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:16.168 [2024-11-26 05:02:17.845766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:16.168 [2024-11-26 05:02:17.845773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.168 [2024-11-26 05:02:17.907161] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:16.168 [2024-11-26 05:02:17.907247] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:19.458 05:02:20 -- event/event.sh@38 -- # waitforlisten 3176294 /var/tmp/spdk-nbd.sock 00:06:19.458 05:02:20 -- common/autotest_common.sh@829 -- # '[' -z 3176294 ']' 00:06:19.458 05:02:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:19.458 05:02:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:19.458 05:02:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:19.458 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:19.458 05:02:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:19.458 05:02:20 -- common/autotest_common.sh@10 -- # set +x 00:06:19.458 05:02:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:19.458 05:02:20 -- common/autotest_common.sh@862 -- # return 0 00:06:19.458 05:02:20 -- event/event.sh@39 -- # killprocess 3176294 00:06:19.458 05:02:20 -- common/autotest_common.sh@936 -- # '[' -z 3176294 ']' 00:06:19.458 05:02:20 -- common/autotest_common.sh@940 -- # kill -0 3176294 00:06:19.458 05:02:20 -- common/autotest_common.sh@941 -- # uname 00:06:19.458 05:02:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:19.458 05:02:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3176294 00:06:19.458 05:02:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:19.458 05:02:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:19.458 05:02:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3176294' 00:06:19.458 killing process with pid 3176294 00:06:19.458 05:02:20 -- common/autotest_common.sh@955 -- # kill 3176294 00:06:19.458 05:02:20 -- common/autotest_common.sh@960 -- # wait 3176294 00:06:19.458 spdk_app_start is called in Round 0. 00:06:19.458 Shutdown signal received, stop current app iteration 00:06:19.458 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:19.458 spdk_app_start is called in Round 1. 00:06:19.458 Shutdown signal received, stop current app iteration 00:06:19.458 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:19.458 spdk_app_start is called in Round 2. 00:06:19.458 Shutdown signal received, stop current app iteration 00:06:19.458 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:19.458 spdk_app_start is called in Round 3. 00:06:19.458 Shutdown signal received, stop current app iteration 00:06:19.458 05:02:21 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:19.458 05:02:21 -- event/event.sh@42 -- # return 0 00:06:19.458 00:06:19.458 real 0m18.895s 00:06:19.458 user 0m41.608s 00:06:19.458 sys 0m3.135s 00:06:19.458 05:02:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:19.458 05:02:21 -- common/autotest_common.sh@10 -- # set +x 00:06:19.458 ************************************ 00:06:19.458 END TEST app_repeat 00:06:19.458 ************************************ 00:06:19.458 05:02:21 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:19.459 05:02:21 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:19.459 05:02:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:19.459 05:02:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.459 05:02:21 -- common/autotest_common.sh@10 -- # set +x 00:06:19.459 ************************************ 00:06:19.459 START TEST cpu_locks 00:06:19.459 ************************************ 00:06:19.459 05:02:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:19.459 * Looking for test storage... 00:06:19.459 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:19.459 05:02:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:19.459 05:02:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:19.459 05:02:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:19.459 05:02:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:19.459 05:02:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:19.459 05:02:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:19.459 05:02:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:19.459 05:02:21 -- scripts/common.sh@335 -- # IFS=.-: 00:06:19.459 05:02:21 -- scripts/common.sh@335 -- # read -ra ver1 00:06:19.459 05:02:21 -- scripts/common.sh@336 -- # IFS=.-: 00:06:19.459 05:02:21 -- scripts/common.sh@336 -- # read -ra ver2 00:06:19.459 05:02:21 -- scripts/common.sh@337 -- # local 'op=<' 00:06:19.459 05:02:21 -- scripts/common.sh@339 -- # ver1_l=2 00:06:19.459 05:02:21 -- scripts/common.sh@340 -- # ver2_l=1 00:06:19.459 05:02:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:19.459 05:02:21 -- scripts/common.sh@343 -- # case "$op" in 00:06:19.459 05:02:21 -- scripts/common.sh@344 -- # : 1 00:06:19.459 05:02:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:19.459 05:02:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:19.459 05:02:21 -- scripts/common.sh@364 -- # decimal 1 00:06:19.459 05:02:21 -- scripts/common.sh@352 -- # local d=1 00:06:19.459 05:02:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:19.459 05:02:21 -- scripts/common.sh@354 -- # echo 1 00:06:19.459 05:02:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:19.459 05:02:21 -- scripts/common.sh@365 -- # decimal 2 00:06:19.459 05:02:21 -- scripts/common.sh@352 -- # local d=2 00:06:19.459 05:02:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:19.459 05:02:21 -- scripts/common.sh@354 -- # echo 2 00:06:19.459 05:02:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:19.459 05:02:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:19.459 05:02:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:19.459 05:02:21 -- scripts/common.sh@367 -- # return 0 00:06:19.459 05:02:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:19.459 05:02:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:19.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:19.459 --rc genhtml_branch_coverage=1 00:06:19.459 --rc genhtml_function_coverage=1 00:06:19.459 --rc genhtml_legend=1 00:06:19.459 --rc geninfo_all_blocks=1 00:06:19.459 --rc geninfo_unexecuted_blocks=1 00:06:19.459 00:06:19.459 ' 00:06:19.459 05:02:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:19.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:19.459 --rc genhtml_branch_coverage=1 00:06:19.459 --rc genhtml_function_coverage=1 00:06:19.459 --rc genhtml_legend=1 00:06:19.459 --rc geninfo_all_blocks=1 00:06:19.459 --rc geninfo_unexecuted_blocks=1 00:06:19.459 00:06:19.459 ' 00:06:19.459 05:02:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:19.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:19.459 --rc genhtml_branch_coverage=1 00:06:19.459 --rc genhtml_function_coverage=1 00:06:19.459 --rc genhtml_legend=1 00:06:19.459 --rc geninfo_all_blocks=1 00:06:19.459 --rc geninfo_unexecuted_blocks=1 00:06:19.459 00:06:19.459 ' 00:06:19.459 05:02:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:19.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:19.459 --rc genhtml_branch_coverage=1 00:06:19.459 --rc genhtml_function_coverage=1 00:06:19.459 --rc genhtml_legend=1 00:06:19.459 --rc geninfo_all_blocks=1 00:06:19.459 --rc geninfo_unexecuted_blocks=1 00:06:19.459 00:06:19.459 ' 00:06:19.459 05:02:21 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:19.459 05:02:21 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:19.459 05:02:21 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:19.459 05:02:21 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:19.459 05:02:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:19.459 05:02:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.459 05:02:21 -- common/autotest_common.sh@10 -- # set +x 00:06:19.459 ************************************ 00:06:19.459 START TEST default_locks 00:06:19.459 ************************************ 00:06:19.459 05:02:21 -- common/autotest_common.sh@1114 -- # default_locks 00:06:19.459 05:02:21 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3178850 00:06:19.459 05:02:21 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:19.459 05:02:21 -- event/cpu_locks.sh@47 -- # waitforlisten 3178850 00:06:19.459 05:02:21 -- common/autotest_common.sh@829 -- # '[' -z 3178850 ']' 00:06:19.459 05:02:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:19.459 05:02:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:19.459 05:02:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:19.459 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:19.459 05:02:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:19.459 05:02:21 -- common/autotest_common.sh@10 -- # set +x 00:06:19.718 [2024-11-26 05:02:21.260608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.718 [2024-11-26 05:02:21.260696] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3178850 ] 00:06:19.718 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.718 [2024-11-26 05:02:21.323246] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.718 [2024-11-26 05:02:21.411573] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:19.718 [2024-11-26 05:02:21.411791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.652 05:02:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:20.652 05:02:22 -- common/autotest_common.sh@862 -- # return 0 00:06:20.652 05:02:22 -- event/cpu_locks.sh@49 -- # locks_exist 3178850 00:06:20.653 05:02:22 -- event/cpu_locks.sh@22 -- # lslocks -p 3178850 00:06:20.653 05:02:22 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:20.911 lslocks: write error 00:06:20.911 05:02:22 -- event/cpu_locks.sh@50 -- # killprocess 3178850 00:06:20.911 05:02:22 -- common/autotest_common.sh@936 -- # '[' -z 3178850 ']' 00:06:20.911 05:02:22 -- common/autotest_common.sh@940 -- # kill -0 3178850 00:06:20.911 05:02:22 -- common/autotest_common.sh@941 -- # uname 00:06:20.911 05:02:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:20.911 05:02:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3178850 00:06:20.911 05:02:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:20.911 05:02:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:20.911 05:02:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3178850' 00:06:20.911 killing process with pid 3178850 00:06:20.911 05:02:22 -- common/autotest_common.sh@955 -- # kill 3178850 00:06:20.911 05:02:22 -- common/autotest_common.sh@960 -- # wait 3178850 00:06:21.478 05:02:23 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3178850 00:06:21.478 05:02:23 -- common/autotest_common.sh@650 -- # local es=0 00:06:21.478 05:02:23 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3178850 00:06:21.478 05:02:23 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:21.478 05:02:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:21.478 05:02:23 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:21.478 05:02:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:21.478 05:02:23 -- common/autotest_common.sh@653 -- # waitforlisten 3178850 00:06:21.478 05:02:23 -- common/autotest_common.sh@829 -- # '[' -z 3178850 ']' 00:06:21.478 05:02:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:21.478 05:02:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:21.478 05:02:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:21.478 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:21.478 05:02:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:21.478 05:02:23 -- common/autotest_common.sh@10 -- # set +x 00:06:21.478 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3178850) - No such process 00:06:21.478 ERROR: process (pid: 3178850) is no longer running 00:06:21.478 05:02:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:21.479 05:02:23 -- common/autotest_common.sh@862 -- # return 1 00:06:21.479 05:02:23 -- common/autotest_common.sh@653 -- # es=1 00:06:21.479 05:02:23 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:21.479 05:02:23 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:21.479 05:02:23 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:21.479 05:02:23 -- event/cpu_locks.sh@54 -- # no_locks 00:06:21.479 05:02:23 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:21.479 05:02:23 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:21.479 05:02:23 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:21.479 00:06:21.479 real 0m1.834s 00:06:21.479 user 0m1.986s 00:06:21.479 sys 0m0.568s 00:06:21.479 05:02:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:21.479 05:02:23 -- common/autotest_common.sh@10 -- # set +x 00:06:21.479 ************************************ 00:06:21.479 END TEST default_locks 00:06:21.479 ************************************ 00:06:21.479 05:02:23 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:21.479 05:02:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:21.479 05:02:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.479 05:02:23 -- common/autotest_common.sh@10 -- # set +x 00:06:21.479 ************************************ 00:06:21.479 START TEST default_locks_via_rpc 00:06:21.479 ************************************ 00:06:21.479 05:02:23 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:21.479 05:02:23 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3179147 00:06:21.479 05:02:23 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:21.479 05:02:23 -- event/cpu_locks.sh@63 -- # waitforlisten 3179147 00:06:21.479 05:02:23 -- common/autotest_common.sh@829 -- # '[' -z 3179147 ']' 00:06:21.479 05:02:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:21.479 05:02:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:21.479 05:02:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:21.479 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:21.479 05:02:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:21.479 05:02:23 -- common/autotest_common.sh@10 -- # set +x 00:06:21.479 [2024-11-26 05:02:23.120616] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.479 [2024-11-26 05:02:23.120746] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3179147 ] 00:06:21.479 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.479 [2024-11-26 05:02:23.180094] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.738 [2024-11-26 05:02:23.263380] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:21.738 [2024-11-26 05:02:23.263564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.679 05:02:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:22.679 05:02:24 -- common/autotest_common.sh@862 -- # return 0 00:06:22.679 05:02:24 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:22.679 05:02:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:22.679 05:02:24 -- common/autotest_common.sh@10 -- # set +x 00:06:22.679 05:02:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:22.679 05:02:24 -- event/cpu_locks.sh@67 -- # no_locks 00:06:22.679 05:02:24 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:22.679 05:02:24 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:22.679 05:02:24 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:22.679 05:02:24 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:22.679 05:02:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:22.679 05:02:24 -- common/autotest_common.sh@10 -- # set +x 00:06:22.679 05:02:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:22.679 05:02:24 -- event/cpu_locks.sh@71 -- # locks_exist 3179147 00:06:22.679 05:02:24 -- event/cpu_locks.sh@22 -- # lslocks -p 3179147 00:06:22.679 05:02:24 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:22.679 05:02:24 -- event/cpu_locks.sh@73 -- # killprocess 3179147 00:06:22.679 05:02:24 -- common/autotest_common.sh@936 -- # '[' -z 3179147 ']' 00:06:22.679 05:02:24 -- common/autotest_common.sh@940 -- # kill -0 3179147 00:06:22.679 05:02:24 -- common/autotest_common.sh@941 -- # uname 00:06:22.679 05:02:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:22.679 05:02:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3179147 00:06:22.679 05:02:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:22.679 05:02:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:22.679 05:02:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3179147' 00:06:22.679 killing process with pid 3179147 00:06:22.679 05:02:24 -- common/autotest_common.sh@955 -- # kill 3179147 00:06:22.679 05:02:24 -- common/autotest_common.sh@960 -- # wait 3179147 00:06:23.248 00:06:23.248 real 0m1.723s 00:06:23.248 user 0m1.894s 00:06:23.248 sys 0m0.525s 00:06:23.248 05:02:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:23.248 05:02:24 -- common/autotest_common.sh@10 -- # set +x 00:06:23.248 ************************************ 00:06:23.248 END TEST default_locks_via_rpc 00:06:23.248 ************************************ 00:06:23.248 05:02:24 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:23.248 05:02:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:23.248 05:02:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:23.248 05:02:24 -- common/autotest_common.sh@10 -- # set +x 00:06:23.248 ************************************ 00:06:23.249 START TEST non_locking_app_on_locked_coremask 00:06:23.249 ************************************ 00:06:23.249 05:02:24 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:23.249 05:02:24 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3179316 00:06:23.249 05:02:24 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:23.249 05:02:24 -- event/cpu_locks.sh@81 -- # waitforlisten 3179316 /var/tmp/spdk.sock 00:06:23.249 05:02:24 -- common/autotest_common.sh@829 -- # '[' -z 3179316 ']' 00:06:23.249 05:02:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:23.249 05:02:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:23.249 05:02:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:23.249 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:23.249 05:02:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:23.249 05:02:24 -- common/autotest_common.sh@10 -- # set +x 00:06:23.249 [2024-11-26 05:02:24.872593] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:23.249 [2024-11-26 05:02:24.872712] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3179316 ] 00:06:23.249 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.249 [2024-11-26 05:02:24.931561] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.508 [2024-11-26 05:02:25.017071] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:23.508 [2024-11-26 05:02:25.017251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.079 05:02:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:24.079 05:02:25 -- common/autotest_common.sh@862 -- # return 0 00:06:24.079 05:02:25 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3179458 00:06:24.079 05:02:25 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:24.079 05:02:25 -- event/cpu_locks.sh@85 -- # waitforlisten 3179458 /var/tmp/spdk2.sock 00:06:24.079 05:02:25 -- common/autotest_common.sh@829 -- # '[' -z 3179458 ']' 00:06:24.079 05:02:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:24.079 05:02:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:24.079 05:02:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:24.079 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:24.079 05:02:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:24.079 05:02:25 -- common/autotest_common.sh@10 -- # set +x 00:06:24.338 [2024-11-26 05:02:25.881796] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.338 [2024-11-26 05:02:25.881891] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3179458 ] 00:06:24.338 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.338 [2024-11-26 05:02:25.975694] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:24.338 [2024-11-26 05:02:25.975727] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.597 [2024-11-26 05:02:26.155995] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:24.597 [2024-11-26 05:02:26.156175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.164 05:02:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:25.164 05:02:26 -- common/autotest_common.sh@862 -- # return 0 00:06:25.164 05:02:26 -- event/cpu_locks.sh@87 -- # locks_exist 3179316 00:06:25.164 05:02:26 -- event/cpu_locks.sh@22 -- # lslocks -p 3179316 00:06:25.164 05:02:26 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:25.787 lslocks: write error 00:06:25.787 05:02:27 -- event/cpu_locks.sh@89 -- # killprocess 3179316 00:06:25.787 05:02:27 -- common/autotest_common.sh@936 -- # '[' -z 3179316 ']' 00:06:25.787 05:02:27 -- common/autotest_common.sh@940 -- # kill -0 3179316 00:06:25.787 05:02:27 -- common/autotest_common.sh@941 -- # uname 00:06:25.787 05:02:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:25.787 05:02:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3179316 00:06:25.787 05:02:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:25.787 05:02:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:25.787 05:02:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3179316' 00:06:25.787 killing process with pid 3179316 00:06:25.787 05:02:27 -- common/autotest_common.sh@955 -- # kill 3179316 00:06:25.787 05:02:27 -- common/autotest_common.sh@960 -- # wait 3179316 00:06:26.727 05:02:28 -- event/cpu_locks.sh@90 -- # killprocess 3179458 00:06:26.727 05:02:28 -- common/autotest_common.sh@936 -- # '[' -z 3179458 ']' 00:06:26.728 05:02:28 -- common/autotest_common.sh@940 -- # kill -0 3179458 00:06:26.728 05:02:28 -- common/autotest_common.sh@941 -- # uname 00:06:26.728 05:02:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:26.728 05:02:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3179458 00:06:26.728 05:02:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:26.728 05:02:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:26.728 05:02:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3179458' 00:06:26.728 killing process with pid 3179458 00:06:26.728 05:02:28 -- common/autotest_common.sh@955 -- # kill 3179458 00:06:26.728 05:02:28 -- common/autotest_common.sh@960 -- # wait 3179458 00:06:26.987 00:06:26.987 real 0m3.803s 00:06:26.987 user 0m4.171s 00:06:26.987 sys 0m1.089s 00:06:26.987 05:02:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:26.987 05:02:28 -- common/autotest_common.sh@10 -- # set +x 00:06:26.987 ************************************ 00:06:26.987 END TEST non_locking_app_on_locked_coremask 00:06:26.987 ************************************ 00:06:26.987 05:02:28 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:26.987 05:02:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:26.987 05:02:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.987 05:02:28 -- common/autotest_common.sh@10 -- # set +x 00:06:26.987 ************************************ 00:06:26.987 START TEST locking_app_on_unlocked_coremask 00:06:26.987 ************************************ 00:06:26.987 05:02:28 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:26.987 05:02:28 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3179895 00:06:26.987 05:02:28 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:26.987 05:02:28 -- event/cpu_locks.sh@99 -- # waitforlisten 3179895 /var/tmp/spdk.sock 00:06:26.987 05:02:28 -- common/autotest_common.sh@829 -- # '[' -z 3179895 ']' 00:06:26.987 05:02:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:26.987 05:02:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:26.987 05:02:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:26.987 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:26.987 05:02:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:26.987 05:02:28 -- common/autotest_common.sh@10 -- # set +x 00:06:26.987 [2024-11-26 05:02:28.701835] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:26.987 [2024-11-26 05:02:28.701942] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3179895 ] 00:06:26.987 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.246 [2024-11-26 05:02:28.762081] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:27.246 [2024-11-26 05:02:28.762122] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.246 [2024-11-26 05:02:28.844081] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:27.246 [2024-11-26 05:02:28.844268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.183 05:02:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:28.183 05:02:29 -- common/autotest_common.sh@862 -- # return 0 00:06:28.183 05:02:29 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3180031 00:06:28.183 05:02:29 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:28.183 05:02:29 -- event/cpu_locks.sh@103 -- # waitforlisten 3180031 /var/tmp/spdk2.sock 00:06:28.183 05:02:29 -- common/autotest_common.sh@829 -- # '[' -z 3180031 ']' 00:06:28.183 05:02:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:28.183 05:02:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:28.183 05:02:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:28.183 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:28.183 05:02:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:28.183 05:02:29 -- common/autotest_common.sh@10 -- # set +x 00:06:28.183 [2024-11-26 05:02:29.717387] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:28.183 [2024-11-26 05:02:29.717478] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3180031 ] 00:06:28.183 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.183 [2024-11-26 05:02:29.808095] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:28.442 [2024-11-26 05:02:29.990352] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:28.442 [2024-11-26 05:02:29.990540] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.009 05:02:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:29.009 05:02:30 -- common/autotest_common.sh@862 -- # return 0 00:06:29.009 05:02:30 -- event/cpu_locks.sh@105 -- # locks_exist 3180031 00:06:29.009 05:02:30 -- event/cpu_locks.sh@22 -- # lslocks -p 3180031 00:06:29.009 05:02:30 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:29.579 lslocks: write error 00:06:29.579 05:02:31 -- event/cpu_locks.sh@107 -- # killprocess 3179895 00:06:29.579 05:02:31 -- common/autotest_common.sh@936 -- # '[' -z 3179895 ']' 00:06:29.579 05:02:31 -- common/autotest_common.sh@940 -- # kill -0 3179895 00:06:29.579 05:02:31 -- common/autotest_common.sh@941 -- # uname 00:06:29.579 05:02:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:29.579 05:02:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3179895 00:06:29.579 05:02:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:29.579 05:02:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:29.579 05:02:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3179895' 00:06:29.579 killing process with pid 3179895 00:06:29.579 05:02:31 -- common/autotest_common.sh@955 -- # kill 3179895 00:06:29.579 05:02:31 -- common/autotest_common.sh@960 -- # wait 3179895 00:06:30.519 05:02:32 -- event/cpu_locks.sh@108 -- # killprocess 3180031 00:06:30.519 05:02:32 -- common/autotest_common.sh@936 -- # '[' -z 3180031 ']' 00:06:30.519 05:02:32 -- common/autotest_common.sh@940 -- # kill -0 3180031 00:06:30.519 05:02:32 -- common/autotest_common.sh@941 -- # uname 00:06:30.519 05:02:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:30.519 05:02:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3180031 00:06:30.519 05:02:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:30.519 05:02:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:30.519 05:02:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3180031' 00:06:30.519 killing process with pid 3180031 00:06:30.519 05:02:32 -- common/autotest_common.sh@955 -- # kill 3180031 00:06:30.519 05:02:32 -- common/autotest_common.sh@960 -- # wait 3180031 00:06:30.779 00:06:30.779 real 0m3.798s 00:06:30.779 user 0m4.206s 00:06:30.779 sys 0m1.066s 00:06:30.779 05:02:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.779 05:02:32 -- common/autotest_common.sh@10 -- # set +x 00:06:30.779 ************************************ 00:06:30.779 END TEST locking_app_on_unlocked_coremask 00:06:30.779 ************************************ 00:06:30.779 05:02:32 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:30.779 05:02:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:30.779 05:02:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.779 05:02:32 -- common/autotest_common.sh@10 -- # set +x 00:06:30.779 ************************************ 00:06:30.779 START TEST locking_app_on_locked_coremask 00:06:30.779 ************************************ 00:06:30.779 05:02:32 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:30.779 05:02:32 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3180353 00:06:30.779 05:02:32 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:30.779 05:02:32 -- event/cpu_locks.sh@116 -- # waitforlisten 3180353 /var/tmp/spdk.sock 00:06:30.779 05:02:32 -- common/autotest_common.sh@829 -- # '[' -z 3180353 ']' 00:06:30.779 05:02:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:30.779 05:02:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:30.779 05:02:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:30.779 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:30.779 05:02:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:30.779 05:02:32 -- common/autotest_common.sh@10 -- # set +x 00:06:30.779 [2024-11-26 05:02:32.531440] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:30.779 [2024-11-26 05:02:32.531522] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3180353 ] 00:06:31.039 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.039 [2024-11-26 05:02:32.594792] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.039 [2024-11-26 05:02:32.679536] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:31.039 [2024-11-26 05:02:32.679724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.975 05:02:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:31.976 05:02:33 -- common/autotest_common.sh@862 -- # return 0 00:06:31.976 05:02:33 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3180493 00:06:31.976 05:02:33 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:31.976 05:02:33 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3180493 /var/tmp/spdk2.sock 00:06:31.976 05:02:33 -- common/autotest_common.sh@650 -- # local es=0 00:06:31.976 05:02:33 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3180493 /var/tmp/spdk2.sock 00:06:31.976 05:02:33 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:31.976 05:02:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:31.976 05:02:33 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:31.976 05:02:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:31.976 05:02:33 -- common/autotest_common.sh@653 -- # waitforlisten 3180493 /var/tmp/spdk2.sock 00:06:31.976 05:02:33 -- common/autotest_common.sh@829 -- # '[' -z 3180493 ']' 00:06:31.976 05:02:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:31.976 05:02:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:31.976 05:02:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:31.976 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:31.976 05:02:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:31.976 05:02:33 -- common/autotest_common.sh@10 -- # set +x 00:06:31.976 [2024-11-26 05:02:33.516361] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:31.976 [2024-11-26 05:02:33.516436] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3180493 ] 00:06:31.976 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.976 [2024-11-26 05:02:33.613534] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3180353 has claimed it. 00:06:31.976 [2024-11-26 05:02:33.613595] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:32.541 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3180493) - No such process 00:06:32.541 ERROR: process (pid: 3180493) is no longer running 00:06:32.541 05:02:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:32.541 05:02:34 -- common/autotest_common.sh@862 -- # return 1 00:06:32.541 05:02:34 -- common/autotest_common.sh@653 -- # es=1 00:06:32.541 05:02:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:32.541 05:02:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:32.541 05:02:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:32.541 05:02:34 -- event/cpu_locks.sh@122 -- # locks_exist 3180353 00:06:32.541 05:02:34 -- event/cpu_locks.sh@22 -- # lslocks -p 3180353 00:06:32.541 05:02:34 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:32.802 lslocks: write error 00:06:32.802 05:02:34 -- event/cpu_locks.sh@124 -- # killprocess 3180353 00:06:32.802 05:02:34 -- common/autotest_common.sh@936 -- # '[' -z 3180353 ']' 00:06:32.802 05:02:34 -- common/autotest_common.sh@940 -- # kill -0 3180353 00:06:32.802 05:02:34 -- common/autotest_common.sh@941 -- # uname 00:06:32.802 05:02:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:32.802 05:02:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3180353 00:06:32.802 05:02:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:32.802 05:02:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:32.802 05:02:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3180353' 00:06:32.802 killing process with pid 3180353 00:06:32.802 05:02:34 -- common/autotest_common.sh@955 -- # kill 3180353 00:06:32.802 05:02:34 -- common/autotest_common.sh@960 -- # wait 3180353 00:06:33.370 00:06:33.370 real 0m2.457s 00:06:33.370 user 0m2.814s 00:06:33.370 sys 0m0.643s 00:06:33.370 05:02:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.370 05:02:34 -- common/autotest_common.sh@10 -- # set +x 00:06:33.370 ************************************ 00:06:33.370 END TEST locking_app_on_locked_coremask 00:06:33.370 ************************************ 00:06:33.370 05:02:34 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:33.370 05:02:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:33.370 05:02:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.370 05:02:34 -- common/autotest_common.sh@10 -- # set +x 00:06:33.370 ************************************ 00:06:33.370 START TEST locking_overlapped_coremask 00:06:33.370 ************************************ 00:06:33.370 05:02:34 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:33.370 05:02:34 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3180659 00:06:33.370 05:02:34 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:33.370 05:02:34 -- event/cpu_locks.sh@133 -- # waitforlisten 3180659 /var/tmp/spdk.sock 00:06:33.370 05:02:34 -- common/autotest_common.sh@829 -- # '[' -z 3180659 ']' 00:06:33.370 05:02:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:33.370 05:02:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:33.370 05:02:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:33.370 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:33.370 05:02:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:33.370 05:02:34 -- common/autotest_common.sh@10 -- # set +x 00:06:33.370 [2024-11-26 05:02:35.017300] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:33.370 [2024-11-26 05:02:35.017413] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3180659 ] 00:06:33.370 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.370 [2024-11-26 05:02:35.077726] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:33.630 [2024-11-26 05:02:35.165337] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:33.630 [2024-11-26 05:02:35.165574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:33.630 [2024-11-26 05:02:35.165639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:33.630 [2024-11-26 05:02:35.165642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.567 05:02:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:34.567 05:02:35 -- common/autotest_common.sh@862 -- # return 0 00:06:34.567 05:02:35 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3180801 00:06:34.567 05:02:35 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3180801 /var/tmp/spdk2.sock 00:06:34.567 05:02:35 -- common/autotest_common.sh@650 -- # local es=0 00:06:34.567 05:02:35 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3180801 /var/tmp/spdk2.sock 00:06:34.567 05:02:35 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:34.567 05:02:35 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:34.567 05:02:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:34.567 05:02:35 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:34.567 05:02:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:34.567 05:02:35 -- common/autotest_common.sh@653 -- # waitforlisten 3180801 /var/tmp/spdk2.sock 00:06:34.567 05:02:35 -- common/autotest_common.sh@829 -- # '[' -z 3180801 ']' 00:06:34.567 05:02:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:34.567 05:02:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:34.567 05:02:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:34.567 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:34.567 05:02:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:34.567 05:02:35 -- common/autotest_common.sh@10 -- # set +x 00:06:34.567 [2024-11-26 05:02:36.016117] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:34.567 [2024-11-26 05:02:36.016203] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3180801 ] 00:06:34.567 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.567 [2024-11-26 05:02:36.104917] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3180659 has claimed it. 00:06:34.567 [2024-11-26 05:02:36.104996] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:35.135 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3180801) - No such process 00:06:35.135 ERROR: process (pid: 3180801) is no longer running 00:06:35.135 05:02:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:35.135 05:02:36 -- common/autotest_common.sh@862 -- # return 1 00:06:35.135 05:02:36 -- common/autotest_common.sh@653 -- # es=1 00:06:35.135 05:02:36 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:35.135 05:02:36 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:35.135 05:02:36 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:35.135 05:02:36 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:35.135 05:02:36 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:35.135 05:02:36 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:35.135 05:02:36 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:35.135 05:02:36 -- event/cpu_locks.sh@141 -- # killprocess 3180659 00:06:35.135 05:02:36 -- common/autotest_common.sh@936 -- # '[' -z 3180659 ']' 00:06:35.135 05:02:36 -- common/autotest_common.sh@940 -- # kill -0 3180659 00:06:35.135 05:02:36 -- common/autotest_common.sh@941 -- # uname 00:06:35.135 05:02:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:35.135 05:02:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3180659 00:06:35.135 05:02:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:35.135 05:02:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:35.135 05:02:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3180659' 00:06:35.135 killing process with pid 3180659 00:06:35.135 05:02:36 -- common/autotest_common.sh@955 -- # kill 3180659 00:06:35.135 05:02:36 -- common/autotest_common.sh@960 -- # wait 3180659 00:06:35.395 00:06:35.395 real 0m2.191s 00:06:35.395 user 0m6.296s 00:06:35.395 sys 0m0.502s 00:06:35.395 05:02:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.395 05:02:37 -- common/autotest_common.sh@10 -- # set +x 00:06:35.395 ************************************ 00:06:35.395 END TEST locking_overlapped_coremask 00:06:35.395 ************************************ 00:06:35.653 05:02:37 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:35.653 05:02:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:35.653 05:02:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.653 05:02:37 -- common/autotest_common.sh@10 -- # set +x 00:06:35.653 ************************************ 00:06:35.653 START TEST locking_overlapped_coremask_via_rpc 00:06:35.653 ************************************ 00:06:35.653 05:02:37 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:35.653 05:02:37 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3180973 00:06:35.653 05:02:37 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:35.653 05:02:37 -- event/cpu_locks.sh@149 -- # waitforlisten 3180973 /var/tmp/spdk.sock 00:06:35.653 05:02:37 -- common/autotest_common.sh@829 -- # '[' -z 3180973 ']' 00:06:35.653 05:02:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:35.653 05:02:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:35.653 05:02:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:35.653 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:35.653 05:02:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:35.653 05:02:37 -- common/autotest_common.sh@10 -- # set +x 00:06:35.653 [2024-11-26 05:02:37.237078] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:35.653 [2024-11-26 05:02:37.237159] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3180973 ] 00:06:35.653 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.653 [2024-11-26 05:02:37.299276] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:35.653 [2024-11-26 05:02:37.299320] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:35.653 [2024-11-26 05:02:37.386419] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:35.653 [2024-11-26 05:02:37.386644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:35.653 [2024-11-26 05:02:37.386725] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:35.653 [2024-11-26 05:02:37.386730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.589 05:02:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:36.589 05:02:38 -- common/autotest_common.sh@862 -- # return 0 00:06:36.589 05:02:38 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3181115 00:06:36.589 05:02:38 -- event/cpu_locks.sh@153 -- # waitforlisten 3181115 /var/tmp/spdk2.sock 00:06:36.589 05:02:38 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:36.589 05:02:38 -- common/autotest_common.sh@829 -- # '[' -z 3181115 ']' 00:06:36.589 05:02:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:36.589 05:02:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.589 05:02:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:36.589 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:36.589 05:02:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.589 05:02:38 -- common/autotest_common.sh@10 -- # set +x 00:06:36.589 [2024-11-26 05:02:38.241843] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:36.589 [2024-11-26 05:02:38.241919] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3181115 ] 00:06:36.589 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.589 [2024-11-26 05:02:38.330648] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:36.589 [2024-11-26 05:02:38.330713] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:36.848 [2024-11-26 05:02:38.498514] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:36.848 [2024-11-26 05:02:38.498809] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:36.848 [2024-11-26 05:02:38.502782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:36.848 [2024-11-26 05:02:38.502784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:37.785 05:02:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:37.785 05:02:39 -- common/autotest_common.sh@862 -- # return 0 00:06:37.785 05:02:39 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:37.785 05:02:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.785 05:02:39 -- common/autotest_common.sh@10 -- # set +x 00:06:37.785 05:02:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:37.785 05:02:39 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:37.785 05:02:39 -- common/autotest_common.sh@650 -- # local es=0 00:06:37.785 05:02:39 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:37.785 05:02:39 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:37.785 05:02:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:37.785 05:02:39 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:37.785 05:02:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:37.785 05:02:39 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:37.785 05:02:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.785 05:02:39 -- common/autotest_common.sh@10 -- # set +x 00:06:37.785 [2024-11-26 05:02:39.213781] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3180973 has claimed it. 00:06:37.785 request: 00:06:37.785 { 00:06:37.785 "method": "framework_enable_cpumask_locks", 00:06:37.785 "req_id": 1 00:06:37.785 } 00:06:37.785 Got JSON-RPC error response 00:06:37.785 response: 00:06:37.785 { 00:06:37.785 "code": -32603, 00:06:37.785 "message": "Failed to claim CPU core: 2" 00:06:37.785 } 00:06:37.785 05:02:39 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:37.785 05:02:39 -- common/autotest_common.sh@653 -- # es=1 00:06:37.785 05:02:39 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:37.785 05:02:39 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:37.785 05:02:39 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:37.785 05:02:39 -- event/cpu_locks.sh@158 -- # waitforlisten 3180973 /var/tmp/spdk.sock 00:06:37.785 05:02:39 -- common/autotest_common.sh@829 -- # '[' -z 3180973 ']' 00:06:37.785 05:02:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:37.785 05:02:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:37.785 05:02:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:37.785 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:37.785 05:02:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:37.785 05:02:39 -- common/autotest_common.sh@10 -- # set +x 00:06:37.785 05:02:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:37.785 05:02:39 -- common/autotest_common.sh@862 -- # return 0 00:06:37.785 05:02:39 -- event/cpu_locks.sh@159 -- # waitforlisten 3181115 /var/tmp/spdk2.sock 00:06:37.785 05:02:39 -- common/autotest_common.sh@829 -- # '[' -z 3181115 ']' 00:06:37.785 05:02:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:37.785 05:02:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:37.785 05:02:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:37.785 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:37.785 05:02:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:37.785 05:02:39 -- common/autotest_common.sh@10 -- # set +x 00:06:38.044 05:02:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.044 05:02:39 -- common/autotest_common.sh@862 -- # return 0 00:06:38.044 05:02:39 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:38.044 05:02:39 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:38.044 05:02:39 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:38.044 05:02:39 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:38.044 00:06:38.044 real 0m2.550s 00:06:38.044 user 0m1.282s 00:06:38.044 sys 0m0.190s 00:06:38.044 05:02:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:38.044 05:02:39 -- common/autotest_common.sh@10 -- # set +x 00:06:38.044 ************************************ 00:06:38.044 END TEST locking_overlapped_coremask_via_rpc 00:06:38.044 ************************************ 00:06:38.044 05:02:39 -- event/cpu_locks.sh@174 -- # cleanup 00:06:38.044 05:02:39 -- event/cpu_locks.sh@15 -- # [[ -z 3180973 ]] 00:06:38.044 05:02:39 -- event/cpu_locks.sh@15 -- # killprocess 3180973 00:06:38.044 05:02:39 -- common/autotest_common.sh@936 -- # '[' -z 3180973 ']' 00:06:38.044 05:02:39 -- common/autotest_common.sh@940 -- # kill -0 3180973 00:06:38.044 05:02:39 -- common/autotest_common.sh@941 -- # uname 00:06:38.044 05:02:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:38.044 05:02:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3180973 00:06:38.044 05:02:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:38.044 05:02:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:38.044 05:02:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3180973' 00:06:38.044 killing process with pid 3180973 00:06:38.044 05:02:39 -- common/autotest_common.sh@955 -- # kill 3180973 00:06:38.044 05:02:39 -- common/autotest_common.sh@960 -- # wait 3180973 00:06:38.613 05:02:40 -- event/cpu_locks.sh@16 -- # [[ -z 3181115 ]] 00:06:38.613 05:02:40 -- event/cpu_locks.sh@16 -- # killprocess 3181115 00:06:38.613 05:02:40 -- common/autotest_common.sh@936 -- # '[' -z 3181115 ']' 00:06:38.613 05:02:40 -- common/autotest_common.sh@940 -- # kill -0 3181115 00:06:38.613 05:02:40 -- common/autotest_common.sh@941 -- # uname 00:06:38.613 05:02:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:38.613 05:02:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3181115 00:06:38.613 05:02:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:38.613 05:02:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:38.613 05:02:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3181115' 00:06:38.613 killing process with pid 3181115 00:06:38.613 05:02:40 -- common/autotest_common.sh@955 -- # kill 3181115 00:06:38.613 05:02:40 -- common/autotest_common.sh@960 -- # wait 3181115 00:06:39.184 05:02:40 -- event/cpu_locks.sh@18 -- # rm -f 00:06:39.184 05:02:40 -- event/cpu_locks.sh@1 -- # cleanup 00:06:39.184 05:02:40 -- event/cpu_locks.sh@15 -- # [[ -z 3180973 ]] 00:06:39.184 05:02:40 -- event/cpu_locks.sh@15 -- # killprocess 3180973 00:06:39.184 05:02:40 -- common/autotest_common.sh@936 -- # '[' -z 3180973 ']' 00:06:39.184 05:02:40 -- common/autotest_common.sh@940 -- # kill -0 3180973 00:06:39.184 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3180973) - No such process 00:06:39.184 05:02:40 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3180973 is not found' 00:06:39.184 Process with pid 3180973 is not found 00:06:39.184 05:02:40 -- event/cpu_locks.sh@16 -- # [[ -z 3181115 ]] 00:06:39.184 05:02:40 -- event/cpu_locks.sh@16 -- # killprocess 3181115 00:06:39.184 05:02:40 -- common/autotest_common.sh@936 -- # '[' -z 3181115 ']' 00:06:39.184 05:02:40 -- common/autotest_common.sh@940 -- # kill -0 3181115 00:06:39.184 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3181115) - No such process 00:06:39.184 05:02:40 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3181115 is not found' 00:06:39.184 Process with pid 3181115 is not found 00:06:39.184 05:02:40 -- event/cpu_locks.sh@18 -- # rm -f 00:06:39.184 00:06:39.184 real 0m19.590s 00:06:39.185 user 0m35.364s 00:06:39.185 sys 0m5.434s 00:06:39.185 05:02:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.185 05:02:40 -- common/autotest_common.sh@10 -- # set +x 00:06:39.185 ************************************ 00:06:39.185 END TEST cpu_locks 00:06:39.185 ************************************ 00:06:39.185 00:06:39.185 real 0m46.438s 00:06:39.185 user 1m29.538s 00:06:39.185 sys 0m9.330s 00:06:39.185 05:02:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.185 05:02:40 -- common/autotest_common.sh@10 -- # set +x 00:06:39.185 ************************************ 00:06:39.185 END TEST event 00:06:39.185 ************************************ 00:06:39.185 05:02:40 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:39.185 05:02:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:39.185 05:02:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.185 05:02:40 -- common/autotest_common.sh@10 -- # set +x 00:06:39.185 ************************************ 00:06:39.185 START TEST thread 00:06:39.185 ************************************ 00:06:39.185 05:02:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:39.185 * Looking for test storage... 00:06:39.185 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:39.185 05:02:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:39.185 05:02:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:39.185 05:02:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:39.185 05:02:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:39.185 05:02:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:39.185 05:02:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:39.185 05:02:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:39.185 05:02:40 -- scripts/common.sh@335 -- # IFS=.-: 00:06:39.185 05:02:40 -- scripts/common.sh@335 -- # read -ra ver1 00:06:39.185 05:02:40 -- scripts/common.sh@336 -- # IFS=.-: 00:06:39.185 05:02:40 -- scripts/common.sh@336 -- # read -ra ver2 00:06:39.185 05:02:40 -- scripts/common.sh@337 -- # local 'op=<' 00:06:39.185 05:02:40 -- scripts/common.sh@339 -- # ver1_l=2 00:06:39.185 05:02:40 -- scripts/common.sh@340 -- # ver2_l=1 00:06:39.185 05:02:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:39.185 05:02:40 -- scripts/common.sh@343 -- # case "$op" in 00:06:39.185 05:02:40 -- scripts/common.sh@344 -- # : 1 00:06:39.185 05:02:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:39.185 05:02:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:39.185 05:02:40 -- scripts/common.sh@364 -- # decimal 1 00:06:39.185 05:02:40 -- scripts/common.sh@352 -- # local d=1 00:06:39.185 05:02:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:39.185 05:02:40 -- scripts/common.sh@354 -- # echo 1 00:06:39.185 05:02:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:39.185 05:02:40 -- scripts/common.sh@365 -- # decimal 2 00:06:39.185 05:02:40 -- scripts/common.sh@352 -- # local d=2 00:06:39.185 05:02:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:39.185 05:02:40 -- scripts/common.sh@354 -- # echo 2 00:06:39.185 05:02:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:39.185 05:02:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:39.185 05:02:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:39.185 05:02:40 -- scripts/common.sh@367 -- # return 0 00:06:39.185 05:02:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:39.185 05:02:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:39.185 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.185 --rc genhtml_branch_coverage=1 00:06:39.185 --rc genhtml_function_coverage=1 00:06:39.185 --rc genhtml_legend=1 00:06:39.185 --rc geninfo_all_blocks=1 00:06:39.185 --rc geninfo_unexecuted_blocks=1 00:06:39.185 00:06:39.185 ' 00:06:39.185 05:02:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:39.185 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.185 --rc genhtml_branch_coverage=1 00:06:39.185 --rc genhtml_function_coverage=1 00:06:39.185 --rc genhtml_legend=1 00:06:39.185 --rc geninfo_all_blocks=1 00:06:39.185 --rc geninfo_unexecuted_blocks=1 00:06:39.185 00:06:39.185 ' 00:06:39.185 05:02:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:39.185 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.185 --rc genhtml_branch_coverage=1 00:06:39.185 --rc genhtml_function_coverage=1 00:06:39.185 --rc genhtml_legend=1 00:06:39.185 --rc geninfo_all_blocks=1 00:06:39.185 --rc geninfo_unexecuted_blocks=1 00:06:39.185 00:06:39.185 ' 00:06:39.185 05:02:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:39.185 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.185 --rc genhtml_branch_coverage=1 00:06:39.185 --rc genhtml_function_coverage=1 00:06:39.185 --rc genhtml_legend=1 00:06:39.185 --rc geninfo_all_blocks=1 00:06:39.185 --rc geninfo_unexecuted_blocks=1 00:06:39.185 00:06:39.185 ' 00:06:39.185 05:02:40 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:39.185 05:02:40 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:39.185 05:02:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.185 05:02:40 -- common/autotest_common.sh@10 -- # set +x 00:06:39.185 ************************************ 00:06:39.185 START TEST thread_poller_perf 00:06:39.185 ************************************ 00:06:39.185 05:02:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:39.185 [2024-11-26 05:02:40.861025] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:39.185 [2024-11-26 05:02:40.861137] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3181595 ] 00:06:39.185 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.185 [2024-11-26 05:02:40.921227] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.444 [2024-11-26 05:02:41.008441] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.444 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:40.381 [2024-11-26T04:02:42.149Z] ====================================== 00:06:40.381 [2024-11-26T04:02:42.149Z] busy:2717054526 (cyc) 00:06:40.381 [2024-11-26T04:02:42.149Z] total_run_count: 280000 00:06:40.381 [2024-11-26T04:02:42.149Z] tsc_hz: 2700000000 (cyc) 00:06:40.381 [2024-11-26T04:02:42.149Z] ====================================== 00:06:40.381 [2024-11-26T04:02:42.149Z] poller_cost: 9703 (cyc), 3593 (nsec) 00:06:40.381 00:06:40.381 real 0m1.251s 00:06:40.381 user 0m1.172s 00:06:40.381 sys 0m0.073s 00:06:40.381 05:02:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:40.381 05:02:42 -- common/autotest_common.sh@10 -- # set +x 00:06:40.381 ************************************ 00:06:40.381 END TEST thread_poller_perf 00:06:40.381 ************************************ 00:06:40.381 05:02:42 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:40.381 05:02:42 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:40.381 05:02:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.381 05:02:42 -- common/autotest_common.sh@10 -- # set +x 00:06:40.381 ************************************ 00:06:40.381 START TEST thread_poller_perf 00:06:40.381 ************************************ 00:06:40.381 05:02:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:40.381 [2024-11-26 05:02:42.135728] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:40.381 [2024-11-26 05:02:42.135815] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3181762 ] 00:06:40.642 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.642 [2024-11-26 05:02:42.198283] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:40.642 [2024-11-26 05:02:42.288560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.642 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:42.024 [2024-11-26T04:02:43.792Z] ====================================== 00:06:42.024 [2024-11-26T04:02:43.792Z] busy:2703881459 (cyc) 00:06:42.024 [2024-11-26T04:02:43.792Z] total_run_count: 3877000 00:06:42.024 [2024-11-26T04:02:43.792Z] tsc_hz: 2700000000 (cyc) 00:06:42.024 [2024-11-26T04:02:43.792Z] ====================================== 00:06:42.024 [2024-11-26T04:02:43.792Z] poller_cost: 697 (cyc), 258 (nsec) 00:06:42.024 00:06:42.024 real 0m1.249s 00:06:42.024 user 0m1.158s 00:06:42.024 sys 0m0.083s 00:06:42.024 05:02:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:42.024 05:02:43 -- common/autotest_common.sh@10 -- # set +x 00:06:42.024 ************************************ 00:06:42.024 END TEST thread_poller_perf 00:06:42.024 ************************************ 00:06:42.024 05:02:43 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:42.024 00:06:42.024 real 0m2.691s 00:06:42.024 user 0m2.443s 00:06:42.024 sys 0m0.252s 00:06:42.024 05:02:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:42.024 05:02:43 -- common/autotest_common.sh@10 -- # set +x 00:06:42.024 ************************************ 00:06:42.024 END TEST thread 00:06:42.024 ************************************ 00:06:42.024 05:02:43 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:42.024 05:02:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:42.024 05:02:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.024 05:02:43 -- common/autotest_common.sh@10 -- # set +x 00:06:42.024 ************************************ 00:06:42.024 START TEST accel 00:06:42.024 ************************************ 00:06:42.024 05:02:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:42.024 * Looking for test storage... 00:06:42.024 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:42.024 05:02:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:42.024 05:02:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:42.025 05:02:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:42.025 05:02:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:42.025 05:02:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:42.025 05:02:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:42.025 05:02:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:42.025 05:02:43 -- scripts/common.sh@335 -- # IFS=.-: 00:06:42.025 05:02:43 -- scripts/common.sh@335 -- # read -ra ver1 00:06:42.025 05:02:43 -- scripts/common.sh@336 -- # IFS=.-: 00:06:42.025 05:02:43 -- scripts/common.sh@336 -- # read -ra ver2 00:06:42.025 05:02:43 -- scripts/common.sh@337 -- # local 'op=<' 00:06:42.025 05:02:43 -- scripts/common.sh@339 -- # ver1_l=2 00:06:42.025 05:02:43 -- scripts/common.sh@340 -- # ver2_l=1 00:06:42.025 05:02:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:42.025 05:02:43 -- scripts/common.sh@343 -- # case "$op" in 00:06:42.025 05:02:43 -- scripts/common.sh@344 -- # : 1 00:06:42.025 05:02:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:42.025 05:02:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:42.025 05:02:43 -- scripts/common.sh@364 -- # decimal 1 00:06:42.025 05:02:43 -- scripts/common.sh@352 -- # local d=1 00:06:42.025 05:02:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:42.025 05:02:43 -- scripts/common.sh@354 -- # echo 1 00:06:42.025 05:02:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:42.025 05:02:43 -- scripts/common.sh@365 -- # decimal 2 00:06:42.025 05:02:43 -- scripts/common.sh@352 -- # local d=2 00:06:42.025 05:02:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:42.025 05:02:43 -- scripts/common.sh@354 -- # echo 2 00:06:42.025 05:02:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:42.025 05:02:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:42.025 05:02:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:42.025 05:02:43 -- scripts/common.sh@367 -- # return 0 00:06:42.025 05:02:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:42.025 05:02:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:42.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.025 --rc genhtml_branch_coverage=1 00:06:42.025 --rc genhtml_function_coverage=1 00:06:42.025 --rc genhtml_legend=1 00:06:42.025 --rc geninfo_all_blocks=1 00:06:42.025 --rc geninfo_unexecuted_blocks=1 00:06:42.025 00:06:42.025 ' 00:06:42.025 05:02:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:42.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.025 --rc genhtml_branch_coverage=1 00:06:42.025 --rc genhtml_function_coverage=1 00:06:42.025 --rc genhtml_legend=1 00:06:42.025 --rc geninfo_all_blocks=1 00:06:42.025 --rc geninfo_unexecuted_blocks=1 00:06:42.025 00:06:42.025 ' 00:06:42.025 05:02:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:42.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.025 --rc genhtml_branch_coverage=1 00:06:42.025 --rc genhtml_function_coverage=1 00:06:42.025 --rc genhtml_legend=1 00:06:42.025 --rc geninfo_all_blocks=1 00:06:42.025 --rc geninfo_unexecuted_blocks=1 00:06:42.025 00:06:42.025 ' 00:06:42.025 05:02:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:42.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.025 --rc genhtml_branch_coverage=1 00:06:42.025 --rc genhtml_function_coverage=1 00:06:42.025 --rc genhtml_legend=1 00:06:42.025 --rc geninfo_all_blocks=1 00:06:42.025 --rc geninfo_unexecuted_blocks=1 00:06:42.025 00:06:42.025 ' 00:06:42.025 05:02:43 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:42.025 05:02:43 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:42.025 05:02:43 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:42.025 05:02:43 -- accel/accel.sh@59 -- # spdk_tgt_pid=3181978 00:06:42.025 05:02:43 -- accel/accel.sh@60 -- # waitforlisten 3181978 00:06:42.025 05:02:43 -- common/autotest_common.sh@829 -- # '[' -z 3181978 ']' 00:06:42.025 05:02:43 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:42.025 05:02:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:42.025 05:02:43 -- accel/accel.sh@58 -- # build_accel_config 00:06:42.025 05:02:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:42.025 05:02:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:42.025 05:02:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:42.025 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:42.025 05:02:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:42.025 05:02:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:42.025 05:02:43 -- common/autotest_common.sh@10 -- # set +x 00:06:42.025 05:02:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:42.025 05:02:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:42.025 05:02:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:42.025 05:02:43 -- accel/accel.sh@41 -- # local IFS=, 00:06:42.025 05:02:43 -- accel/accel.sh@42 -- # jq -r . 00:06:42.025 [2024-11-26 05:02:43.610034] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:42.025 [2024-11-26 05:02:43.610107] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3181978 ] 00:06:42.025 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.025 [2024-11-26 05:02:43.685208] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.025 [2024-11-26 05:02:43.776540] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:42.025 [2024-11-26 05:02:43.776791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.963 05:02:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:42.963 05:02:44 -- common/autotest_common.sh@862 -- # return 0 00:06:42.963 05:02:44 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:42.963 05:02:44 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:42.963 05:02:44 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:42.963 05:02:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.963 05:02:44 -- common/autotest_common.sh@10 -- # set +x 00:06:42.963 05:02:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.963 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.963 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.963 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.963 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.963 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.963 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.963 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.963 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.963 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.963 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.963 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.963 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.963 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.963 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.963 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.963 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.963 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.963 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.963 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.963 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.964 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.964 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.964 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.964 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.964 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.964 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.964 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.964 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.964 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.964 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.964 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.964 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.964 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.964 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.964 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.964 05:02:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:42.964 05:02:44 -- accel/accel.sh@64 -- # IFS== 00:06:42.964 05:02:44 -- accel/accel.sh@64 -- # read -r opc module 00:06:42.964 05:02:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:42.964 05:02:44 -- accel/accel.sh@67 -- # killprocess 3181978 00:06:42.964 05:02:44 -- common/autotest_common.sh@936 -- # '[' -z 3181978 ']' 00:06:42.964 05:02:44 -- common/autotest_common.sh@940 -- # kill -0 3181978 00:06:42.964 05:02:44 -- common/autotest_common.sh@941 -- # uname 00:06:42.964 05:02:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:42.964 05:02:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3181978 00:06:42.964 05:02:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:42.964 05:02:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:42.964 05:02:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3181978' 00:06:42.964 killing process with pid 3181978 00:06:42.964 05:02:44 -- common/autotest_common.sh@955 -- # kill 3181978 00:06:42.964 05:02:44 -- common/autotest_common.sh@960 -- # wait 3181978 00:06:43.533 05:02:45 -- accel/accel.sh@68 -- # trap - ERR 00:06:43.533 05:02:45 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:43.533 05:02:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:43.533 05:02:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.533 05:02:45 -- common/autotest_common.sh@10 -- # set +x 00:06:43.533 05:02:45 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:06:43.533 05:02:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:43.533 05:02:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:43.533 05:02:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:43.533 05:02:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:43.533 05:02:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:43.533 05:02:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:43.533 05:02:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:43.533 05:02:45 -- accel/accel.sh@41 -- # local IFS=, 00:06:43.533 05:02:45 -- accel/accel.sh@42 -- # jq -r . 00:06:43.533 05:02:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:43.533 05:02:45 -- common/autotest_common.sh@10 -- # set +x 00:06:43.533 05:02:45 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:43.533 05:02:45 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:43.533 05:02:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.533 05:02:45 -- common/autotest_common.sh@10 -- # set +x 00:06:43.533 ************************************ 00:06:43.533 START TEST accel_missing_filename 00:06:43.533 ************************************ 00:06:43.533 05:02:45 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:06:43.533 05:02:45 -- common/autotest_common.sh@650 -- # local es=0 00:06:43.533 05:02:45 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:43.533 05:02:45 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:43.533 05:02:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:43.533 05:02:45 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:43.533 05:02:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:43.533 05:02:45 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:06:43.533 05:02:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:43.533 05:02:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:43.533 05:02:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:43.533 05:02:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:43.533 05:02:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:43.533 05:02:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:43.533 05:02:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:43.533 05:02:45 -- accel/accel.sh@41 -- # local IFS=, 00:06:43.533 05:02:45 -- accel/accel.sh@42 -- # jq -r . 00:06:43.533 [2024-11-26 05:02:45.120779] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:43.533 [2024-11-26 05:02:45.120857] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3182150 ] 00:06:43.533 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.533 [2024-11-26 05:02:45.184651] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:43.533 [2024-11-26 05:02:45.272537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.791 [2024-11-26 05:02:45.331396] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:43.791 [2024-11-26 05:02:45.411494] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:43.791 A filename is required. 00:06:43.791 05:02:45 -- common/autotest_common.sh@653 -- # es=234 00:06:43.791 05:02:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:43.791 05:02:45 -- common/autotest_common.sh@662 -- # es=106 00:06:43.791 05:02:45 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:43.791 05:02:45 -- common/autotest_common.sh@670 -- # es=1 00:06:43.791 05:02:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:43.791 00:06:43.791 real 0m0.393s 00:06:43.791 user 0m0.288s 00:06:43.791 sys 0m0.138s 00:06:43.791 05:02:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:43.791 05:02:45 -- common/autotest_common.sh@10 -- # set +x 00:06:43.791 ************************************ 00:06:43.791 END TEST accel_missing_filename 00:06:43.791 ************************************ 00:06:43.791 05:02:45 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:43.791 05:02:45 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:43.791 05:02:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.791 05:02:45 -- common/autotest_common.sh@10 -- # set +x 00:06:43.791 ************************************ 00:06:43.791 START TEST accel_compress_verify 00:06:43.791 ************************************ 00:06:43.791 05:02:45 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:43.791 05:02:45 -- common/autotest_common.sh@650 -- # local es=0 00:06:43.791 05:02:45 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:43.791 05:02:45 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:43.791 05:02:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:43.791 05:02:45 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:43.791 05:02:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:43.791 05:02:45 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:43.791 05:02:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:43.791 05:02:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:43.791 05:02:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:43.791 05:02:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:43.791 05:02:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:43.791 05:02:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:43.792 05:02:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:43.792 05:02:45 -- accel/accel.sh@41 -- # local IFS=, 00:06:43.792 05:02:45 -- accel/accel.sh@42 -- # jq -r . 00:06:43.792 [2024-11-26 05:02:45.542828] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:43.792 [2024-11-26 05:02:45.542906] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3182294 ] 00:06:44.050 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.050 [2024-11-26 05:02:45.608193] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:44.050 [2024-11-26 05:02:45.695327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:44.050 [2024-11-26 05:02:45.755506] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:44.308 [2024-11-26 05:02:45.833810] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:44.308 00:06:44.308 Compression does not support the verify option, aborting. 00:06:44.308 05:02:45 -- common/autotest_common.sh@653 -- # es=161 00:06:44.308 05:02:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:44.308 05:02:45 -- common/autotest_common.sh@662 -- # es=33 00:06:44.308 05:02:45 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:44.308 05:02:45 -- common/autotest_common.sh@670 -- # es=1 00:06:44.309 05:02:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:44.309 00:06:44.309 real 0m0.393s 00:06:44.309 user 0m0.278s 00:06:44.309 sys 0m0.150s 00:06:44.309 05:02:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.309 05:02:45 -- common/autotest_common.sh@10 -- # set +x 00:06:44.309 ************************************ 00:06:44.309 END TEST accel_compress_verify 00:06:44.309 ************************************ 00:06:44.309 05:02:45 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:44.309 05:02:45 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:44.309 05:02:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:44.309 05:02:45 -- common/autotest_common.sh@10 -- # set +x 00:06:44.309 ************************************ 00:06:44.309 START TEST accel_wrong_workload 00:06:44.309 ************************************ 00:06:44.309 05:02:45 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:06:44.309 05:02:45 -- common/autotest_common.sh@650 -- # local es=0 00:06:44.309 05:02:45 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:44.309 05:02:45 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:44.309 05:02:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:44.309 05:02:45 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:44.309 05:02:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:44.309 05:02:45 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:06:44.309 05:02:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:44.309 05:02:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:44.309 05:02:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:44.309 05:02:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:44.309 05:02:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:44.309 05:02:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:44.309 05:02:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:44.309 05:02:45 -- accel/accel.sh@41 -- # local IFS=, 00:06:44.309 05:02:45 -- accel/accel.sh@42 -- # jq -r . 00:06:44.309 Unsupported workload type: foobar 00:06:44.309 [2024-11-26 05:02:45.961128] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:44.309 accel_perf options: 00:06:44.309 [-h help message] 00:06:44.309 [-q queue depth per core] 00:06:44.309 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:44.309 [-T number of threads per core 00:06:44.309 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:44.309 [-t time in seconds] 00:06:44.309 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:44.309 [ dif_verify, , dif_generate, dif_generate_copy 00:06:44.309 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:44.309 [-l for compress/decompress workloads, name of uncompressed input file 00:06:44.309 [-S for crc32c workload, use this seed value (default 0) 00:06:44.309 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:44.309 [-f for fill workload, use this BYTE value (default 255) 00:06:44.309 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:44.309 [-y verify result if this switch is on] 00:06:44.309 [-a tasks to allocate per core (default: same value as -q)] 00:06:44.309 Can be used to spread operations across a wider range of memory. 00:06:44.309 05:02:45 -- common/autotest_common.sh@653 -- # es=1 00:06:44.309 05:02:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:44.309 05:02:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:44.309 05:02:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:44.309 00:06:44.309 real 0m0.024s 00:06:44.309 user 0m0.015s 00:06:44.309 sys 0m0.009s 00:06:44.309 05:02:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.309 05:02:45 -- common/autotest_common.sh@10 -- # set +x 00:06:44.309 ************************************ 00:06:44.309 END TEST accel_wrong_workload 00:06:44.309 ************************************ 00:06:44.309 Error: writing output failed: Broken pipe 00:06:44.309 05:02:45 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:44.309 05:02:45 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:44.309 05:02:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:44.309 05:02:45 -- common/autotest_common.sh@10 -- # set +x 00:06:44.309 ************************************ 00:06:44.309 START TEST accel_negative_buffers 00:06:44.309 ************************************ 00:06:44.309 05:02:45 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:44.309 05:02:45 -- common/autotest_common.sh@650 -- # local es=0 00:06:44.309 05:02:45 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:44.309 05:02:45 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:44.309 05:02:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:44.309 05:02:45 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:44.309 05:02:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:44.309 05:02:45 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:06:44.309 05:02:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:44.309 05:02:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:44.309 05:02:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:44.309 05:02:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:44.309 05:02:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:44.309 05:02:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:44.309 05:02:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:44.309 05:02:45 -- accel/accel.sh@41 -- # local IFS=, 00:06:44.309 05:02:45 -- accel/accel.sh@42 -- # jq -r . 00:06:44.309 -x option must be non-negative. 00:06:44.309 [2024-11-26 05:02:46.009556] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:44.309 accel_perf options: 00:06:44.309 [-h help message] 00:06:44.309 [-q queue depth per core] 00:06:44.309 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:44.309 [-T number of threads per core 00:06:44.309 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:44.309 [-t time in seconds] 00:06:44.309 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:44.309 [ dif_verify, , dif_generate, dif_generate_copy 00:06:44.309 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:44.309 [-l for compress/decompress workloads, name of uncompressed input file 00:06:44.309 [-S for crc32c workload, use this seed value (default 0) 00:06:44.309 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:44.309 [-f for fill workload, use this BYTE value (default 255) 00:06:44.309 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:44.309 [-y verify result if this switch is on] 00:06:44.309 [-a tasks to allocate per core (default: same value as -q)] 00:06:44.309 Can be used to spread operations across a wider range of memory. 00:06:44.309 05:02:46 -- common/autotest_common.sh@653 -- # es=1 00:06:44.309 05:02:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:44.309 05:02:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:44.309 05:02:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:44.309 00:06:44.309 real 0m0.023s 00:06:44.309 user 0m0.013s 00:06:44.309 sys 0m0.010s 00:06:44.309 05:02:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.309 05:02:46 -- common/autotest_common.sh@10 -- # set +x 00:06:44.309 ************************************ 00:06:44.309 END TEST accel_negative_buffers 00:06:44.309 ************************************ 00:06:44.309 Error: writing output failed: Broken pipe 00:06:44.309 05:02:46 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:44.309 05:02:46 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:44.309 05:02:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:44.309 05:02:46 -- common/autotest_common.sh@10 -- # set +x 00:06:44.309 ************************************ 00:06:44.309 START TEST accel_crc32c 00:06:44.309 ************************************ 00:06:44.309 05:02:46 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:44.309 05:02:46 -- accel/accel.sh@16 -- # local accel_opc 00:06:44.309 05:02:46 -- accel/accel.sh@17 -- # local accel_module 00:06:44.309 05:02:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:44.309 05:02:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:44.309 05:02:46 -- accel/accel.sh@12 -- # build_accel_config 00:06:44.309 05:02:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:44.309 05:02:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:44.309 05:02:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:44.309 05:02:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:44.309 05:02:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:44.309 05:02:46 -- accel/accel.sh@41 -- # local IFS=, 00:06:44.309 05:02:46 -- accel/accel.sh@42 -- # jq -r . 00:06:44.309 [2024-11-26 05:02:46.058202] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:44.309 [2024-11-26 05:02:46.058268] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3182357 ] 00:06:44.569 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.569 [2024-11-26 05:02:46.122652] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:44.569 [2024-11-26 05:02:46.213018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.946 05:02:47 -- accel/accel.sh@18 -- # out=' 00:06:45.946 SPDK Configuration: 00:06:45.946 Core mask: 0x1 00:06:45.946 00:06:45.946 Accel Perf Configuration: 00:06:45.946 Workload Type: crc32c 00:06:45.946 CRC-32C seed: 32 00:06:45.946 Transfer size: 4096 bytes 00:06:45.946 Vector count 1 00:06:45.946 Module: software 00:06:45.946 Queue depth: 32 00:06:45.946 Allocate depth: 32 00:06:45.946 # threads/core: 1 00:06:45.946 Run time: 1 seconds 00:06:45.946 Verify: Yes 00:06:45.946 00:06:45.946 Running for 1 seconds... 00:06:45.946 00:06:45.946 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:45.946 ------------------------------------------------------------------------------------ 00:06:45.946 0,0 407200/s 1590 MiB/s 0 0 00:06:45.946 ==================================================================================== 00:06:45.946 Total 407200/s 1590 MiB/s 0 0' 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:45.946 05:02:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:45.946 05:02:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:45.946 05:02:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:45.946 05:02:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:45.946 05:02:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:45.946 05:02:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:45.946 05:02:47 -- accel/accel.sh@41 -- # local IFS=, 00:06:45.946 05:02:47 -- accel/accel.sh@42 -- # jq -r . 00:06:45.946 [2024-11-26 05:02:47.461330] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:45.946 [2024-11-26 05:02:47.461427] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3182503 ] 00:06:45.946 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.946 [2024-11-26 05:02:47.524769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.946 [2024-11-26 05:02:47.614097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val= 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val= 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val=0x1 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val= 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val= 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val=crc32c 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val=32 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val= 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val=software 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@23 -- # accel_module=software 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val=32 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val=32 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val=1 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.946 05:02:47 -- accel/accel.sh@21 -- # val=Yes 00:06:45.946 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.946 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.947 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.947 05:02:47 -- accel/accel.sh@21 -- # val= 00:06:45.947 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.947 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.947 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.947 05:02:47 -- accel/accel.sh@21 -- # val= 00:06:45.947 05:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.947 05:02:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.947 05:02:47 -- accel/accel.sh@20 -- # read -r var val 00:06:47.327 05:02:48 -- accel/accel.sh@21 -- # val= 00:06:47.327 05:02:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.327 05:02:48 -- accel/accel.sh@20 -- # IFS=: 00:06:47.327 05:02:48 -- accel/accel.sh@20 -- # read -r var val 00:06:47.328 05:02:48 -- accel/accel.sh@21 -- # val= 00:06:47.328 05:02:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.328 05:02:48 -- accel/accel.sh@20 -- # IFS=: 00:06:47.328 05:02:48 -- accel/accel.sh@20 -- # read -r var val 00:06:47.328 05:02:48 -- accel/accel.sh@21 -- # val= 00:06:47.328 05:02:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.328 05:02:48 -- accel/accel.sh@20 -- # IFS=: 00:06:47.328 05:02:48 -- accel/accel.sh@20 -- # read -r var val 00:06:47.328 05:02:48 -- accel/accel.sh@21 -- # val= 00:06:47.328 05:02:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.328 05:02:48 -- accel/accel.sh@20 -- # IFS=: 00:06:47.328 05:02:48 -- accel/accel.sh@20 -- # read -r var val 00:06:47.328 05:02:48 -- accel/accel.sh@21 -- # val= 00:06:47.328 05:02:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.328 05:02:48 -- accel/accel.sh@20 -- # IFS=: 00:06:47.328 05:02:48 -- accel/accel.sh@20 -- # read -r var val 00:06:47.328 05:02:48 -- accel/accel.sh@21 -- # val= 00:06:47.328 05:02:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.328 05:02:48 -- accel/accel.sh@20 -- # IFS=: 00:06:47.328 05:02:48 -- accel/accel.sh@20 -- # read -r var val 00:06:47.328 05:02:48 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:47.328 05:02:48 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:47.328 05:02:48 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:47.328 00:06:47.328 real 0m2.793s 00:06:47.328 user 0m2.504s 00:06:47.328 sys 0m0.282s 00:06:47.328 05:02:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:47.328 05:02:48 -- common/autotest_common.sh@10 -- # set +x 00:06:47.328 ************************************ 00:06:47.328 END TEST accel_crc32c 00:06:47.328 ************************************ 00:06:47.328 05:02:48 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:47.328 05:02:48 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:47.328 05:02:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:47.328 05:02:48 -- common/autotest_common.sh@10 -- # set +x 00:06:47.328 ************************************ 00:06:47.328 START TEST accel_crc32c_C2 00:06:47.328 ************************************ 00:06:47.328 05:02:48 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:47.328 05:02:48 -- accel/accel.sh@16 -- # local accel_opc 00:06:47.328 05:02:48 -- accel/accel.sh@17 -- # local accel_module 00:06:47.328 05:02:48 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:47.328 05:02:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:47.328 05:02:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:47.328 05:02:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:47.328 05:02:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:47.328 05:02:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:47.328 05:02:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:47.328 05:02:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:47.328 05:02:48 -- accel/accel.sh@41 -- # local IFS=, 00:06:47.328 05:02:48 -- accel/accel.sh@42 -- # jq -r . 00:06:47.328 [2024-11-26 05:02:48.881923] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:47.328 [2024-11-26 05:02:48.881999] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3182775 ] 00:06:47.328 EAL: No free 2048 kB hugepages reported on node 1 00:06:47.328 [2024-11-26 05:02:48.945295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:47.328 [2024-11-26 05:02:49.032762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.710 05:02:50 -- accel/accel.sh@18 -- # out=' 00:06:48.710 SPDK Configuration: 00:06:48.710 Core mask: 0x1 00:06:48.710 00:06:48.710 Accel Perf Configuration: 00:06:48.710 Workload Type: crc32c 00:06:48.710 CRC-32C seed: 0 00:06:48.710 Transfer size: 4096 bytes 00:06:48.710 Vector count 2 00:06:48.710 Module: software 00:06:48.710 Queue depth: 32 00:06:48.710 Allocate depth: 32 00:06:48.710 # threads/core: 1 00:06:48.710 Run time: 1 seconds 00:06:48.710 Verify: Yes 00:06:48.710 00:06:48.710 Running for 1 seconds... 00:06:48.710 00:06:48.710 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:48.710 ------------------------------------------------------------------------------------ 00:06:48.710 0,0 322336/s 2518 MiB/s 0 0 00:06:48.710 ==================================================================================== 00:06:48.710 Total 322336/s 1259 MiB/s 0 0' 00:06:48.710 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.710 05:02:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:48.710 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.710 05:02:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:48.710 05:02:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:48.710 05:02:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.710 05:02:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.710 05:02:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.710 05:02:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.710 05:02:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.710 05:02:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.710 05:02:50 -- accel/accel.sh@42 -- # jq -r . 00:06:48.710 [2024-11-26 05:02:50.288809] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:48.710 [2024-11-26 05:02:50.288896] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3182922 ] 00:06:48.710 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.710 [2024-11-26 05:02:50.352929] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:48.710 [2024-11-26 05:02:50.442281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.970 05:02:50 -- accel/accel.sh@21 -- # val= 00:06:48.970 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.970 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.970 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.970 05:02:50 -- accel/accel.sh@21 -- # val= 00:06:48.970 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.970 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.970 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.970 05:02:50 -- accel/accel.sh@21 -- # val=0x1 00:06:48.970 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.970 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.970 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.970 05:02:50 -- accel/accel.sh@21 -- # val= 00:06:48.970 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.970 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.970 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.970 05:02:50 -- accel/accel.sh@21 -- # val= 00:06:48.970 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.971 05:02:50 -- accel/accel.sh@21 -- # val=crc32c 00:06:48.971 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.971 05:02:50 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.971 05:02:50 -- accel/accel.sh@21 -- # val=0 00:06:48.971 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.971 05:02:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:48.971 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.971 05:02:50 -- accel/accel.sh@21 -- # val= 00:06:48.971 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.971 05:02:50 -- accel/accel.sh@21 -- # val=software 00:06:48.971 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.971 05:02:50 -- accel/accel.sh@23 -- # accel_module=software 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.971 05:02:50 -- accel/accel.sh@21 -- # val=32 00:06:48.971 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.971 05:02:50 -- accel/accel.sh@21 -- # val=32 00:06:48.971 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.971 05:02:50 -- accel/accel.sh@21 -- # val=1 00:06:48.971 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.971 05:02:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:48.971 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.971 05:02:50 -- accel/accel.sh@21 -- # val=Yes 00:06:48.971 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.971 05:02:50 -- accel/accel.sh@21 -- # val= 00:06:48.971 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.971 05:02:50 -- accel/accel.sh@21 -- # val= 00:06:48.971 05:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.971 05:02:50 -- accel/accel.sh@20 -- # read -r var val 00:06:49.909 05:02:51 -- accel/accel.sh@21 -- # val= 00:06:49.909 05:02:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.909 05:02:51 -- accel/accel.sh@20 -- # IFS=: 00:06:49.909 05:02:51 -- accel/accel.sh@20 -- # read -r var val 00:06:49.909 05:02:51 -- accel/accel.sh@21 -- # val= 00:06:49.909 05:02:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.909 05:02:51 -- accel/accel.sh@20 -- # IFS=: 00:06:49.909 05:02:51 -- accel/accel.sh@20 -- # read -r var val 00:06:49.909 05:02:51 -- accel/accel.sh@21 -- # val= 00:06:49.909 05:02:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.909 05:02:51 -- accel/accel.sh@20 -- # IFS=: 00:06:49.909 05:02:51 -- accel/accel.sh@20 -- # read -r var val 00:06:49.909 05:02:51 -- accel/accel.sh@21 -- # val= 00:06:49.909 05:02:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.909 05:02:51 -- accel/accel.sh@20 -- # IFS=: 00:06:49.909 05:02:51 -- accel/accel.sh@20 -- # read -r var val 00:06:49.909 05:02:51 -- accel/accel.sh@21 -- # val= 00:06:49.909 05:02:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.909 05:02:51 -- accel/accel.sh@20 -- # IFS=: 00:06:50.169 05:02:51 -- accel/accel.sh@20 -- # read -r var val 00:06:50.169 05:02:51 -- accel/accel.sh@21 -- # val= 00:06:50.169 05:02:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.169 05:02:51 -- accel/accel.sh@20 -- # IFS=: 00:06:50.169 05:02:51 -- accel/accel.sh@20 -- # read -r var val 00:06:50.169 05:02:51 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:50.169 05:02:51 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:50.169 05:02:51 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:50.169 00:06:50.169 real 0m2.812s 00:06:50.169 user 0m2.510s 00:06:50.169 sys 0m0.292s 00:06:50.169 05:02:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.169 05:02:51 -- common/autotest_common.sh@10 -- # set +x 00:06:50.169 ************************************ 00:06:50.169 END TEST accel_crc32c_C2 00:06:50.169 ************************************ 00:06:50.169 05:02:51 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:50.169 05:02:51 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:50.169 05:02:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.169 05:02:51 -- common/autotest_common.sh@10 -- # set +x 00:06:50.169 ************************************ 00:06:50.169 START TEST accel_copy 00:06:50.169 ************************************ 00:06:50.169 05:02:51 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:06:50.169 05:02:51 -- accel/accel.sh@16 -- # local accel_opc 00:06:50.169 05:02:51 -- accel/accel.sh@17 -- # local accel_module 00:06:50.169 05:02:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:06:50.169 05:02:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:50.169 05:02:51 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.169 05:02:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.169 05:02:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.169 05:02:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.169 05:02:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.169 05:02:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.169 05:02:51 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.169 05:02:51 -- accel/accel.sh@42 -- # jq -r . 00:06:50.169 [2024-11-26 05:02:51.718839] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:50.169 [2024-11-26 05:02:51.718937] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3183084 ] 00:06:50.169 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.169 [2024-11-26 05:02:51.782040] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.169 [2024-11-26 05:02:51.873204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.548 05:02:53 -- accel/accel.sh@18 -- # out=' 00:06:51.548 SPDK Configuration: 00:06:51.548 Core mask: 0x1 00:06:51.548 00:06:51.548 Accel Perf Configuration: 00:06:51.548 Workload Type: copy 00:06:51.548 Transfer size: 4096 bytes 00:06:51.548 Vector count 1 00:06:51.548 Module: software 00:06:51.548 Queue depth: 32 00:06:51.548 Allocate depth: 32 00:06:51.548 # threads/core: 1 00:06:51.548 Run time: 1 seconds 00:06:51.548 Verify: Yes 00:06:51.548 00:06:51.548 Running for 1 seconds... 00:06:51.548 00:06:51.548 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:51.548 ------------------------------------------------------------------------------------ 00:06:51.548 0,0 275968/s 1078 MiB/s 0 0 00:06:51.548 ==================================================================================== 00:06:51.548 Total 275968/s 1078 MiB/s 0 0' 00:06:51.548 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.548 05:02:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:51.548 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.548 05:02:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:51.548 05:02:53 -- accel/accel.sh@12 -- # build_accel_config 00:06:51.548 05:02:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:51.548 05:02:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:51.548 05:02:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:51.548 05:02:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:51.548 05:02:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:51.548 05:02:53 -- accel/accel.sh@41 -- # local IFS=, 00:06:51.548 05:02:53 -- accel/accel.sh@42 -- # jq -r . 00:06:51.548 [2024-11-26 05:02:53.128132] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:51.549 [2024-11-26 05:02:53.128224] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3183224 ] 00:06:51.549 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.549 [2024-11-26 05:02:53.190707] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:51.549 [2024-11-26 05:02:53.281164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val= 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val= 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val=0x1 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val= 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val= 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val=copy 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@24 -- # accel_opc=copy 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val= 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val=software 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@23 -- # accel_module=software 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val=32 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val=32 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val=1 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val=Yes 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val= 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:51.831 05:02:53 -- accel/accel.sh@21 -- # val= 00:06:51.831 05:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # IFS=: 00:06:51.831 05:02:53 -- accel/accel.sh@20 -- # read -r var val 00:06:52.775 05:02:54 -- accel/accel.sh@21 -- # val= 00:06:52.776 05:02:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.776 05:02:54 -- accel/accel.sh@20 -- # IFS=: 00:06:52.776 05:02:54 -- accel/accel.sh@20 -- # read -r var val 00:06:52.776 05:02:54 -- accel/accel.sh@21 -- # val= 00:06:52.776 05:02:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.776 05:02:54 -- accel/accel.sh@20 -- # IFS=: 00:06:52.776 05:02:54 -- accel/accel.sh@20 -- # read -r var val 00:06:52.776 05:02:54 -- accel/accel.sh@21 -- # val= 00:06:52.776 05:02:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.776 05:02:54 -- accel/accel.sh@20 -- # IFS=: 00:06:52.776 05:02:54 -- accel/accel.sh@20 -- # read -r var val 00:06:52.776 05:02:54 -- accel/accel.sh@21 -- # val= 00:06:52.776 05:02:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.776 05:02:54 -- accel/accel.sh@20 -- # IFS=: 00:06:52.776 05:02:54 -- accel/accel.sh@20 -- # read -r var val 00:06:52.776 05:02:54 -- accel/accel.sh@21 -- # val= 00:06:52.776 05:02:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.776 05:02:54 -- accel/accel.sh@20 -- # IFS=: 00:06:52.776 05:02:54 -- accel/accel.sh@20 -- # read -r var val 00:06:52.776 05:02:54 -- accel/accel.sh@21 -- # val= 00:06:52.776 05:02:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.776 05:02:54 -- accel/accel.sh@20 -- # IFS=: 00:06:52.776 05:02:54 -- accel/accel.sh@20 -- # read -r var val 00:06:52.776 05:02:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:52.776 05:02:54 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:06:52.776 05:02:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:52.776 00:06:52.776 real 0m2.808s 00:06:52.776 user 0m2.510s 00:06:52.776 sys 0m0.290s 00:06:52.776 05:02:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:52.776 05:02:54 -- common/autotest_common.sh@10 -- # set +x 00:06:52.776 ************************************ 00:06:52.776 END TEST accel_copy 00:06:52.776 ************************************ 00:06:52.776 05:02:54 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:52.776 05:02:54 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:52.776 05:02:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:52.776 05:02:54 -- common/autotest_common.sh@10 -- # set +x 00:06:52.776 ************************************ 00:06:52.776 START TEST accel_fill 00:06:52.776 ************************************ 00:06:52.776 05:02:54 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:52.776 05:02:54 -- accel/accel.sh@16 -- # local accel_opc 00:06:52.776 05:02:54 -- accel/accel.sh@17 -- # local accel_module 00:06:52.776 05:02:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:52.776 05:02:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:52.776 05:02:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:52.776 05:02:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:52.776 05:02:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:52.776 05:02:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:52.776 05:02:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:52.776 05:02:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:52.776 05:02:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.036 05:02:54 -- accel/accel.sh@42 -- # jq -r . 00:06:53.036 [2024-11-26 05:02:54.555746] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:53.036 [2024-11-26 05:02:54.555836] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3183505 ] 00:06:53.036 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.036 [2024-11-26 05:02:54.618609] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.036 [2024-11-26 05:02:54.709125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.416 05:02:55 -- accel/accel.sh@18 -- # out=' 00:06:54.416 SPDK Configuration: 00:06:54.416 Core mask: 0x1 00:06:54.416 00:06:54.416 Accel Perf Configuration: 00:06:54.416 Workload Type: fill 00:06:54.416 Fill pattern: 0x80 00:06:54.416 Transfer size: 4096 bytes 00:06:54.416 Vector count 1 00:06:54.416 Module: software 00:06:54.416 Queue depth: 64 00:06:54.416 Allocate depth: 64 00:06:54.416 # threads/core: 1 00:06:54.416 Run time: 1 seconds 00:06:54.416 Verify: Yes 00:06:54.416 00:06:54.416 Running for 1 seconds... 00:06:54.416 00:06:54.416 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:54.416 ------------------------------------------------------------------------------------ 00:06:54.416 0,0 406016/s 1586 MiB/s 0 0 00:06:54.416 ==================================================================================== 00:06:54.416 Total 406016/s 1586 MiB/s 0 0' 00:06:54.416 05:02:55 -- accel/accel.sh@20 -- # IFS=: 00:06:54.416 05:02:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:54.416 05:02:55 -- accel/accel.sh@20 -- # read -r var val 00:06:54.416 05:02:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:54.416 05:02:55 -- accel/accel.sh@12 -- # build_accel_config 00:06:54.416 05:02:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:54.416 05:02:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:54.416 05:02:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:54.416 05:02:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:54.416 05:02:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:54.416 05:02:55 -- accel/accel.sh@41 -- # local IFS=, 00:06:54.416 05:02:55 -- accel/accel.sh@42 -- # jq -r . 00:06:54.416 [2024-11-26 05:02:55.963696] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:54.416 [2024-11-26 05:02:55.963784] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3183645 ] 00:06:54.416 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.416 [2024-11-26 05:02:56.028318] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:54.416 [2024-11-26 05:02:56.116247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.416 05:02:56 -- accel/accel.sh@21 -- # val= 00:06:54.416 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.416 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.416 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.416 05:02:56 -- accel/accel.sh@21 -- # val= 00:06:54.416 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.416 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.416 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.416 05:02:56 -- accel/accel.sh@21 -- # val=0x1 00:06:54.416 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.416 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.416 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.416 05:02:56 -- accel/accel.sh@21 -- # val= 00:06:54.416 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.416 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.416 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.416 05:02:56 -- accel/accel.sh@21 -- # val= 00:06:54.676 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.676 05:02:56 -- accel/accel.sh@21 -- # val=fill 00:06:54.676 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.676 05:02:56 -- accel/accel.sh@24 -- # accel_opc=fill 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.676 05:02:56 -- accel/accel.sh@21 -- # val=0x80 00:06:54.676 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.676 05:02:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:54.676 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.676 05:02:56 -- accel/accel.sh@21 -- # val= 00:06:54.676 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.676 05:02:56 -- accel/accel.sh@21 -- # val=software 00:06:54.676 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.676 05:02:56 -- accel/accel.sh@23 -- # accel_module=software 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.676 05:02:56 -- accel/accel.sh@21 -- # val=64 00:06:54.676 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.676 05:02:56 -- accel/accel.sh@21 -- # val=64 00:06:54.676 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.676 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.676 05:02:56 -- accel/accel.sh@21 -- # val=1 00:06:54.677 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.677 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.677 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.677 05:02:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:54.677 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.677 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.677 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.677 05:02:56 -- accel/accel.sh@21 -- # val=Yes 00:06:54.677 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.677 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.677 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.677 05:02:56 -- accel/accel.sh@21 -- # val= 00:06:54.677 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.677 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.677 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.677 05:02:56 -- accel/accel.sh@21 -- # val= 00:06:54.677 05:02:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.677 05:02:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.677 05:02:56 -- accel/accel.sh@20 -- # read -r var val 00:06:55.613 05:02:57 -- accel/accel.sh@21 -- # val= 00:06:55.613 05:02:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.613 05:02:57 -- accel/accel.sh@20 -- # IFS=: 00:06:55.613 05:02:57 -- accel/accel.sh@20 -- # read -r var val 00:06:55.613 05:02:57 -- accel/accel.sh@21 -- # val= 00:06:55.613 05:02:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.613 05:02:57 -- accel/accel.sh@20 -- # IFS=: 00:06:55.613 05:02:57 -- accel/accel.sh@20 -- # read -r var val 00:06:55.613 05:02:57 -- accel/accel.sh@21 -- # val= 00:06:55.613 05:02:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.613 05:02:57 -- accel/accel.sh@20 -- # IFS=: 00:06:55.613 05:02:57 -- accel/accel.sh@20 -- # read -r var val 00:06:55.613 05:02:57 -- accel/accel.sh@21 -- # val= 00:06:55.613 05:02:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.613 05:02:57 -- accel/accel.sh@20 -- # IFS=: 00:06:55.613 05:02:57 -- accel/accel.sh@20 -- # read -r var val 00:06:55.613 05:02:57 -- accel/accel.sh@21 -- # val= 00:06:55.613 05:02:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.613 05:02:57 -- accel/accel.sh@20 -- # IFS=: 00:06:55.613 05:02:57 -- accel/accel.sh@20 -- # read -r var val 00:06:55.613 05:02:57 -- accel/accel.sh@21 -- # val= 00:06:55.613 05:02:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.613 05:02:57 -- accel/accel.sh@20 -- # IFS=: 00:06:55.613 05:02:57 -- accel/accel.sh@20 -- # read -r var val 00:06:55.613 05:02:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:55.613 05:02:57 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:06:55.613 05:02:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:55.613 00:06:55.613 real 0m2.807s 00:06:55.613 user 0m2.506s 00:06:55.613 sys 0m0.294s 00:06:55.613 05:02:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:55.613 05:02:57 -- common/autotest_common.sh@10 -- # set +x 00:06:55.613 ************************************ 00:06:55.613 END TEST accel_fill 00:06:55.613 ************************************ 00:06:55.613 05:02:57 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:06:55.613 05:02:57 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:55.613 05:02:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.613 05:02:57 -- common/autotest_common.sh@10 -- # set +x 00:06:55.613 ************************************ 00:06:55.613 START TEST accel_copy_crc32c 00:06:55.613 ************************************ 00:06:55.613 05:02:57 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:06:55.613 05:02:57 -- accel/accel.sh@16 -- # local accel_opc 00:06:55.613 05:02:57 -- accel/accel.sh@17 -- # local accel_module 00:06:55.613 05:02:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:55.613 05:02:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:55.613 05:02:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.613 05:02:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.613 05:02:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.613 05:02:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.613 05:02:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.613 05:02:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.613 05:02:57 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.613 05:02:57 -- accel/accel.sh@42 -- # jq -r . 00:06:55.874 [2024-11-26 05:02:57.386858] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:55.874 [2024-11-26 05:02:57.386937] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3183814 ] 00:06:55.874 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.874 [2024-11-26 05:02:57.449943] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.874 [2024-11-26 05:02:57.540820] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.254 05:02:58 -- accel/accel.sh@18 -- # out=' 00:06:57.254 SPDK Configuration: 00:06:57.254 Core mask: 0x1 00:06:57.254 00:06:57.254 Accel Perf Configuration: 00:06:57.254 Workload Type: copy_crc32c 00:06:57.254 CRC-32C seed: 0 00:06:57.254 Vector size: 4096 bytes 00:06:57.254 Transfer size: 4096 bytes 00:06:57.254 Vector count 1 00:06:57.254 Module: software 00:06:57.254 Queue depth: 32 00:06:57.254 Allocate depth: 32 00:06:57.254 # threads/core: 1 00:06:57.254 Run time: 1 seconds 00:06:57.254 Verify: Yes 00:06:57.254 00:06:57.254 Running for 1 seconds... 00:06:57.254 00:06:57.254 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:57.254 ------------------------------------------------------------------------------------ 00:06:57.254 0,0 217184/s 848 MiB/s 0 0 00:06:57.254 ==================================================================================== 00:06:57.254 Total 217184/s 848 MiB/s 0 0' 00:06:57.254 05:02:58 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:57.254 05:02:58 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:57.254 05:02:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:57.254 05:02:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:57.254 05:02:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:57.254 05:02:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:57.254 05:02:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:57.254 05:02:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:57.254 05:02:58 -- accel/accel.sh@41 -- # local IFS=, 00:06:57.254 05:02:58 -- accel/accel.sh@42 -- # jq -r . 00:06:57.254 [2024-11-26 05:02:58.790941] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:57.254 [2024-11-26 05:02:58.791034] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3183954 ] 00:06:57.254 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.254 [2024-11-26 05:02:58.853072] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.254 [2024-11-26 05:02:58.943065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val= 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val= 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val=0x1 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val= 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val= 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val=0 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val= 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val=software 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@23 -- # accel_module=software 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val=32 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val=32 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val=1 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val=Yes 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val= 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.254 05:02:59 -- accel/accel.sh@21 -- # val= 00:06:57.254 05:02:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # IFS=: 00:06:57.254 05:02:59 -- accel/accel.sh@20 -- # read -r var val 00:06:58.634 05:03:00 -- accel/accel.sh@21 -- # val= 00:06:58.634 05:03:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.634 05:03:00 -- accel/accel.sh@20 -- # IFS=: 00:06:58.634 05:03:00 -- accel/accel.sh@20 -- # read -r var val 00:06:58.634 05:03:00 -- accel/accel.sh@21 -- # val= 00:06:58.634 05:03:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.634 05:03:00 -- accel/accel.sh@20 -- # IFS=: 00:06:58.634 05:03:00 -- accel/accel.sh@20 -- # read -r var val 00:06:58.634 05:03:00 -- accel/accel.sh@21 -- # val= 00:06:58.634 05:03:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.634 05:03:00 -- accel/accel.sh@20 -- # IFS=: 00:06:58.634 05:03:00 -- accel/accel.sh@20 -- # read -r var val 00:06:58.634 05:03:00 -- accel/accel.sh@21 -- # val= 00:06:58.634 05:03:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.635 05:03:00 -- accel/accel.sh@20 -- # IFS=: 00:06:58.635 05:03:00 -- accel/accel.sh@20 -- # read -r var val 00:06:58.635 05:03:00 -- accel/accel.sh@21 -- # val= 00:06:58.635 05:03:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.635 05:03:00 -- accel/accel.sh@20 -- # IFS=: 00:06:58.635 05:03:00 -- accel/accel.sh@20 -- # read -r var val 00:06:58.635 05:03:00 -- accel/accel.sh@21 -- # val= 00:06:58.635 05:03:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.635 05:03:00 -- accel/accel.sh@20 -- # IFS=: 00:06:58.635 05:03:00 -- accel/accel.sh@20 -- # read -r var val 00:06:58.635 05:03:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:58.635 05:03:00 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:58.635 05:03:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:58.635 00:06:58.635 real 0m2.798s 00:06:58.635 user 0m2.506s 00:06:58.635 sys 0m0.283s 00:06:58.635 05:03:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:58.635 05:03:00 -- common/autotest_common.sh@10 -- # set +x 00:06:58.635 ************************************ 00:06:58.635 END TEST accel_copy_crc32c 00:06:58.635 ************************************ 00:06:58.635 05:03:00 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:06:58.635 05:03:00 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:58.635 05:03:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.635 05:03:00 -- common/autotest_common.sh@10 -- # set +x 00:06:58.635 ************************************ 00:06:58.635 START TEST accel_copy_crc32c_C2 00:06:58.635 ************************************ 00:06:58.635 05:03:00 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:06:58.635 05:03:00 -- accel/accel.sh@16 -- # local accel_opc 00:06:58.635 05:03:00 -- accel/accel.sh@17 -- # local accel_module 00:06:58.635 05:03:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:58.635 05:03:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:58.635 05:03:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:58.635 05:03:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:58.635 05:03:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:58.635 05:03:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:58.635 05:03:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:58.635 05:03:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:58.635 05:03:00 -- accel/accel.sh@41 -- # local IFS=, 00:06:58.635 05:03:00 -- accel/accel.sh@42 -- # jq -r . 00:06:58.635 [2024-11-26 05:03:00.207565] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:58.635 [2024-11-26 05:03:00.207654] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3184252 ] 00:06:58.635 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.635 [2024-11-26 05:03:00.271787] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.635 [2024-11-26 05:03:00.360599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.014 05:03:01 -- accel/accel.sh@18 -- # out=' 00:07:00.014 SPDK Configuration: 00:07:00.014 Core mask: 0x1 00:07:00.014 00:07:00.014 Accel Perf Configuration: 00:07:00.014 Workload Type: copy_crc32c 00:07:00.014 CRC-32C seed: 0 00:07:00.014 Vector size: 4096 bytes 00:07:00.014 Transfer size: 8192 bytes 00:07:00.014 Vector count 2 00:07:00.014 Module: software 00:07:00.014 Queue depth: 32 00:07:00.014 Allocate depth: 32 00:07:00.014 # threads/core: 1 00:07:00.014 Run time: 1 seconds 00:07:00.014 Verify: Yes 00:07:00.014 00:07:00.014 Running for 1 seconds... 00:07:00.014 00:07:00.014 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:00.014 ------------------------------------------------------------------------------------ 00:07:00.014 0,0 158176/s 1235 MiB/s 0 0 00:07:00.014 ==================================================================================== 00:07:00.014 Total 158176/s 617 MiB/s 0 0' 00:07:00.014 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.014 05:03:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:00.014 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.014 05:03:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:00.014 05:03:01 -- accel/accel.sh@12 -- # build_accel_config 00:07:00.014 05:03:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:00.014 05:03:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:00.014 05:03:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:00.014 05:03:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:00.014 05:03:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:00.014 05:03:01 -- accel/accel.sh@41 -- # local IFS=, 00:07:00.014 05:03:01 -- accel/accel.sh@42 -- # jq -r . 00:07:00.014 [2024-11-26 05:03:01.613211] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:00.014 [2024-11-26 05:03:01.613300] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3184467 ] 00:07:00.014 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.014 [2024-11-26 05:03:01.676535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.014 [2024-11-26 05:03:01.766370] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val= 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val= 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val=0x1 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val= 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val= 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val=0 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val='8192 bytes' 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val= 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val=software 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@23 -- # accel_module=software 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val=32 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val=32 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val=1 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val=Yes 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val= 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:00.275 05:03:01 -- accel/accel.sh@21 -- # val= 00:07:00.275 05:03:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # IFS=: 00:07:00.275 05:03:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.655 05:03:02 -- accel/accel.sh@21 -- # val= 00:07:01.655 05:03:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.655 05:03:02 -- accel/accel.sh@20 -- # IFS=: 00:07:01.655 05:03:02 -- accel/accel.sh@20 -- # read -r var val 00:07:01.655 05:03:02 -- accel/accel.sh@21 -- # val= 00:07:01.655 05:03:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.655 05:03:02 -- accel/accel.sh@20 -- # IFS=: 00:07:01.655 05:03:02 -- accel/accel.sh@20 -- # read -r var val 00:07:01.655 05:03:02 -- accel/accel.sh@21 -- # val= 00:07:01.655 05:03:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.655 05:03:02 -- accel/accel.sh@20 -- # IFS=: 00:07:01.655 05:03:02 -- accel/accel.sh@20 -- # read -r var val 00:07:01.655 05:03:02 -- accel/accel.sh@21 -- # val= 00:07:01.655 05:03:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.655 05:03:02 -- accel/accel.sh@20 -- # IFS=: 00:07:01.655 05:03:02 -- accel/accel.sh@20 -- # read -r var val 00:07:01.655 05:03:02 -- accel/accel.sh@21 -- # val= 00:07:01.655 05:03:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.655 05:03:02 -- accel/accel.sh@20 -- # IFS=: 00:07:01.655 05:03:02 -- accel/accel.sh@20 -- # read -r var val 00:07:01.655 05:03:02 -- accel/accel.sh@21 -- # val= 00:07:01.655 05:03:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.655 05:03:02 -- accel/accel.sh@20 -- # IFS=: 00:07:01.655 05:03:02 -- accel/accel.sh@20 -- # read -r var val 00:07:01.655 05:03:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:01.656 05:03:02 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:01.656 05:03:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:01.656 00:07:01.656 real 0m2.801s 00:07:01.656 user 0m2.506s 00:07:01.656 sys 0m0.285s 00:07:01.656 05:03:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:01.656 05:03:02 -- common/autotest_common.sh@10 -- # set +x 00:07:01.656 ************************************ 00:07:01.656 END TEST accel_copy_crc32c_C2 00:07:01.656 ************************************ 00:07:01.656 05:03:03 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:01.656 05:03:03 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:01.656 05:03:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.656 05:03:03 -- common/autotest_common.sh@10 -- # set +x 00:07:01.656 ************************************ 00:07:01.656 START TEST accel_dualcast 00:07:01.656 ************************************ 00:07:01.656 05:03:03 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:07:01.656 05:03:03 -- accel/accel.sh@16 -- # local accel_opc 00:07:01.656 05:03:03 -- accel/accel.sh@17 -- # local accel_module 00:07:01.656 05:03:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:07:01.656 05:03:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:01.656 05:03:03 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.656 05:03:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:01.656 05:03:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.656 05:03:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.656 05:03:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:01.656 05:03:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:01.656 05:03:03 -- accel/accel.sh@41 -- # local IFS=, 00:07:01.656 05:03:03 -- accel/accel.sh@42 -- # jq -r . 00:07:01.656 [2024-11-26 05:03:03.037513] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:01.656 [2024-11-26 05:03:03.037603] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3184645 ] 00:07:01.656 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.656 [2024-11-26 05:03:03.100101] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.656 [2024-11-26 05:03:03.190227] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.037 05:03:04 -- accel/accel.sh@18 -- # out=' 00:07:03.037 SPDK Configuration: 00:07:03.037 Core mask: 0x1 00:07:03.037 00:07:03.037 Accel Perf Configuration: 00:07:03.037 Workload Type: dualcast 00:07:03.037 Transfer size: 4096 bytes 00:07:03.037 Vector count 1 00:07:03.037 Module: software 00:07:03.037 Queue depth: 32 00:07:03.037 Allocate depth: 32 00:07:03.037 # threads/core: 1 00:07:03.037 Run time: 1 seconds 00:07:03.037 Verify: Yes 00:07:03.037 00:07:03.037 Running for 1 seconds... 00:07:03.037 00:07:03.037 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:03.037 ------------------------------------------------------------------------------------ 00:07:03.037 0,0 305760/s 1194 MiB/s 0 0 00:07:03.037 ==================================================================================== 00:07:03.037 Total 305760/s 1194 MiB/s 0 0' 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.037 05:03:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.037 05:03:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:03.037 05:03:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.037 05:03:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:03.037 05:03:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.037 05:03:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.037 05:03:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:03.037 05:03:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:03.037 05:03:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:03.037 05:03:04 -- accel/accel.sh@42 -- # jq -r . 00:07:03.037 [2024-11-26 05:03:04.440324] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:03.037 [2024-11-26 05:03:04.440416] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3184788 ] 00:07:03.037 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.037 [2024-11-26 05:03:04.504834] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.037 [2024-11-26 05:03:04.595390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.037 05:03:04 -- accel/accel.sh@21 -- # val= 00:07:03.037 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.037 05:03:04 -- accel/accel.sh@21 -- # val= 00:07:03.037 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.037 05:03:04 -- accel/accel.sh@21 -- # val=0x1 00:07:03.037 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.037 05:03:04 -- accel/accel.sh@21 -- # val= 00:07:03.037 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.037 05:03:04 -- accel/accel.sh@21 -- # val= 00:07:03.037 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.037 05:03:04 -- accel/accel.sh@21 -- # val=dualcast 00:07:03.037 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.037 05:03:04 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.037 05:03:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:03.037 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.037 05:03:04 -- accel/accel.sh@21 -- # val= 00:07:03.037 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.037 05:03:04 -- accel/accel.sh@21 -- # val=software 00:07:03.037 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.037 05:03:04 -- accel/accel.sh@23 -- # accel_module=software 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.037 05:03:04 -- accel/accel.sh@21 -- # val=32 00:07:03.037 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.037 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.038 05:03:04 -- accel/accel.sh@21 -- # val=32 00:07:03.038 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.038 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.038 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.038 05:03:04 -- accel/accel.sh@21 -- # val=1 00:07:03.038 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.038 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.038 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.038 05:03:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:03.038 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.038 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.038 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.038 05:03:04 -- accel/accel.sh@21 -- # val=Yes 00:07:03.038 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.038 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.038 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.038 05:03:04 -- accel/accel.sh@21 -- # val= 00:07:03.038 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.038 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.038 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.038 05:03:04 -- accel/accel.sh@21 -- # val= 00:07:03.038 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.038 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:07:03.038 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.415 05:03:05 -- accel/accel.sh@21 -- # val= 00:07:04.415 05:03:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.415 05:03:05 -- accel/accel.sh@20 -- # IFS=: 00:07:04.415 05:03:05 -- accel/accel.sh@20 -- # read -r var val 00:07:04.415 05:03:05 -- accel/accel.sh@21 -- # val= 00:07:04.415 05:03:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.415 05:03:05 -- accel/accel.sh@20 -- # IFS=: 00:07:04.415 05:03:05 -- accel/accel.sh@20 -- # read -r var val 00:07:04.415 05:03:05 -- accel/accel.sh@21 -- # val= 00:07:04.415 05:03:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.415 05:03:05 -- accel/accel.sh@20 -- # IFS=: 00:07:04.415 05:03:05 -- accel/accel.sh@20 -- # read -r var val 00:07:04.415 05:03:05 -- accel/accel.sh@21 -- # val= 00:07:04.415 05:03:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.415 05:03:05 -- accel/accel.sh@20 -- # IFS=: 00:07:04.415 05:03:05 -- accel/accel.sh@20 -- # read -r var val 00:07:04.415 05:03:05 -- accel/accel.sh@21 -- # val= 00:07:04.415 05:03:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.415 05:03:05 -- accel/accel.sh@20 -- # IFS=: 00:07:04.415 05:03:05 -- accel/accel.sh@20 -- # read -r var val 00:07:04.415 05:03:05 -- accel/accel.sh@21 -- # val= 00:07:04.415 05:03:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.415 05:03:05 -- accel/accel.sh@20 -- # IFS=: 00:07:04.415 05:03:05 -- accel/accel.sh@20 -- # read -r var val 00:07:04.415 05:03:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:04.415 05:03:05 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:07:04.415 05:03:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:04.415 00:07:04.415 real 0m2.800s 00:07:04.415 user 0m2.502s 00:07:04.415 sys 0m0.287s 00:07:04.415 05:03:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:04.415 05:03:05 -- common/autotest_common.sh@10 -- # set +x 00:07:04.415 ************************************ 00:07:04.415 END TEST accel_dualcast 00:07:04.415 ************************************ 00:07:04.415 05:03:05 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:04.415 05:03:05 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:04.415 05:03:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.415 05:03:05 -- common/autotest_common.sh@10 -- # set +x 00:07:04.415 ************************************ 00:07:04.415 START TEST accel_compare 00:07:04.415 ************************************ 00:07:04.415 05:03:05 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:07:04.415 05:03:05 -- accel/accel.sh@16 -- # local accel_opc 00:07:04.415 05:03:05 -- accel/accel.sh@17 -- # local accel_module 00:07:04.415 05:03:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:07:04.415 05:03:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:04.415 05:03:05 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.415 05:03:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:04.415 05:03:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.415 05:03:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.415 05:03:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:04.415 05:03:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:04.415 05:03:05 -- accel/accel.sh@41 -- # local IFS=, 00:07:04.415 05:03:05 -- accel/accel.sh@42 -- # jq -r . 00:07:04.415 [2024-11-26 05:03:05.861777] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:04.415 [2024-11-26 05:03:05.861858] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3185066 ] 00:07:04.415 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.415 [2024-11-26 05:03:05.924436] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.415 [2024-11-26 05:03:06.014832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.797 05:03:07 -- accel/accel.sh@18 -- # out=' 00:07:05.797 SPDK Configuration: 00:07:05.797 Core mask: 0x1 00:07:05.797 00:07:05.797 Accel Perf Configuration: 00:07:05.797 Workload Type: compare 00:07:05.797 Transfer size: 4096 bytes 00:07:05.797 Vector count 1 00:07:05.797 Module: software 00:07:05.797 Queue depth: 32 00:07:05.797 Allocate depth: 32 00:07:05.797 # threads/core: 1 00:07:05.797 Run time: 1 seconds 00:07:05.797 Verify: Yes 00:07:05.797 00:07:05.797 Running for 1 seconds... 00:07:05.797 00:07:05.797 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:05.797 ------------------------------------------------------------------------------------ 00:07:05.797 0,0 396288/s 1548 MiB/s 0 0 00:07:05.797 ==================================================================================== 00:07:05.797 Total 396288/s 1548 MiB/s 0 0' 00:07:05.797 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.797 05:03:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:05.797 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.797 05:03:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:05.797 05:03:07 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.797 05:03:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:05.797 05:03:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.797 05:03:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.797 05:03:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:05.797 05:03:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:05.797 05:03:07 -- accel/accel.sh@41 -- # local IFS=, 00:07:05.797 05:03:07 -- accel/accel.sh@42 -- # jq -r . 00:07:05.797 [2024-11-26 05:03:07.266871] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:05.797 [2024-11-26 05:03:07.266954] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3185281 ] 00:07:05.797 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.797 [2024-11-26 05:03:07.328820] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.797 [2024-11-26 05:03:07.415472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.797 05:03:07 -- accel/accel.sh@21 -- # val= 00:07:05.797 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.797 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.797 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.797 05:03:07 -- accel/accel.sh@21 -- # val= 00:07:05.797 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.797 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.797 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.797 05:03:07 -- accel/accel.sh@21 -- # val=0x1 00:07:05.797 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.797 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.797 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.797 05:03:07 -- accel/accel.sh@21 -- # val= 00:07:05.797 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.797 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.798 05:03:07 -- accel/accel.sh@21 -- # val= 00:07:05.798 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.798 05:03:07 -- accel/accel.sh@21 -- # val=compare 00:07:05.798 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.798 05:03:07 -- accel/accel.sh@24 -- # accel_opc=compare 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.798 05:03:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:05.798 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.798 05:03:07 -- accel/accel.sh@21 -- # val= 00:07:05.798 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.798 05:03:07 -- accel/accel.sh@21 -- # val=software 00:07:05.798 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.798 05:03:07 -- accel/accel.sh@23 -- # accel_module=software 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.798 05:03:07 -- accel/accel.sh@21 -- # val=32 00:07:05.798 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.798 05:03:07 -- accel/accel.sh@21 -- # val=32 00:07:05.798 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.798 05:03:07 -- accel/accel.sh@21 -- # val=1 00:07:05.798 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.798 05:03:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:05.798 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.798 05:03:07 -- accel/accel.sh@21 -- # val=Yes 00:07:05.798 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.798 05:03:07 -- accel/accel.sh@21 -- # val= 00:07:05.798 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.798 05:03:07 -- accel/accel.sh@21 -- # val= 00:07:05.798 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.798 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.175 05:03:08 -- accel/accel.sh@21 -- # val= 00:07:07.175 05:03:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.175 05:03:08 -- accel/accel.sh@20 -- # IFS=: 00:07:07.175 05:03:08 -- accel/accel.sh@20 -- # read -r var val 00:07:07.175 05:03:08 -- accel/accel.sh@21 -- # val= 00:07:07.175 05:03:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.175 05:03:08 -- accel/accel.sh@20 -- # IFS=: 00:07:07.175 05:03:08 -- accel/accel.sh@20 -- # read -r var val 00:07:07.175 05:03:08 -- accel/accel.sh@21 -- # val= 00:07:07.175 05:03:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.175 05:03:08 -- accel/accel.sh@20 -- # IFS=: 00:07:07.175 05:03:08 -- accel/accel.sh@20 -- # read -r var val 00:07:07.175 05:03:08 -- accel/accel.sh@21 -- # val= 00:07:07.176 05:03:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.176 05:03:08 -- accel/accel.sh@20 -- # IFS=: 00:07:07.176 05:03:08 -- accel/accel.sh@20 -- # read -r var val 00:07:07.176 05:03:08 -- accel/accel.sh@21 -- # val= 00:07:07.176 05:03:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.176 05:03:08 -- accel/accel.sh@20 -- # IFS=: 00:07:07.176 05:03:08 -- accel/accel.sh@20 -- # read -r var val 00:07:07.176 05:03:08 -- accel/accel.sh@21 -- # val= 00:07:07.176 05:03:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.176 05:03:08 -- accel/accel.sh@20 -- # IFS=: 00:07:07.176 05:03:08 -- accel/accel.sh@20 -- # read -r var val 00:07:07.176 05:03:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:07.176 05:03:08 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:07:07.176 05:03:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:07.176 00:07:07.176 real 0m2.789s 00:07:07.176 user 0m2.494s 00:07:07.176 sys 0m0.284s 00:07:07.176 05:03:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.176 05:03:08 -- common/autotest_common.sh@10 -- # set +x 00:07:07.176 ************************************ 00:07:07.176 END TEST accel_compare 00:07:07.176 ************************************ 00:07:07.176 05:03:08 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:07.176 05:03:08 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:07.176 05:03:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.176 05:03:08 -- common/autotest_common.sh@10 -- # set +x 00:07:07.176 ************************************ 00:07:07.176 START TEST accel_xor 00:07:07.176 ************************************ 00:07:07.176 05:03:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:07:07.176 05:03:08 -- accel/accel.sh@16 -- # local accel_opc 00:07:07.176 05:03:08 -- accel/accel.sh@17 -- # local accel_module 00:07:07.176 05:03:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:07:07.176 05:03:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:07.176 05:03:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.176 05:03:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.176 05:03:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.176 05:03:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.176 05:03:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.176 05:03:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.176 05:03:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.176 05:03:08 -- accel/accel.sh@42 -- # jq -r . 00:07:07.176 [2024-11-26 05:03:08.678006] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:07.176 [2024-11-26 05:03:08.678095] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3185790 ] 00:07:07.176 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.176 [2024-11-26 05:03:08.740251] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.176 [2024-11-26 05:03:08.830723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.550 05:03:10 -- accel/accel.sh@18 -- # out=' 00:07:08.550 SPDK Configuration: 00:07:08.550 Core mask: 0x1 00:07:08.550 00:07:08.550 Accel Perf Configuration: 00:07:08.550 Workload Type: xor 00:07:08.550 Source buffers: 2 00:07:08.550 Transfer size: 4096 bytes 00:07:08.550 Vector count 1 00:07:08.550 Module: software 00:07:08.550 Queue depth: 32 00:07:08.550 Allocate depth: 32 00:07:08.550 # threads/core: 1 00:07:08.550 Run time: 1 seconds 00:07:08.550 Verify: Yes 00:07:08.550 00:07:08.550 Running for 1 seconds... 00:07:08.550 00:07:08.550 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:08.550 ------------------------------------------------------------------------------------ 00:07:08.550 0,0 191680/s 748 MiB/s 0 0 00:07:08.550 ==================================================================================== 00:07:08.550 Total 191680/s 748 MiB/s 0 0' 00:07:08.550 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.550 05:03:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:08.550 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.550 05:03:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:08.550 05:03:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:08.550 05:03:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:08.550 05:03:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:08.550 05:03:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:08.550 05:03:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:08.550 05:03:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:08.550 05:03:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:08.550 05:03:10 -- accel/accel.sh@42 -- # jq -r . 00:07:08.550 [2024-11-26 05:03:10.082638] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:08.550 [2024-11-26 05:03:10.082738] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3186028 ] 00:07:08.550 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.550 [2024-11-26 05:03:10.146815] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:08.550 [2024-11-26 05:03:10.237084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.550 05:03:10 -- accel/accel.sh@21 -- # val= 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val= 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val=0x1 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val= 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val= 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val=xor 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val=2 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val= 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val=software 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@23 -- # accel_module=software 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val=32 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val=32 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val=1 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val=Yes 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val= 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:08.551 05:03:10 -- accel/accel.sh@21 -- # val= 00:07:08.551 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:07:08.551 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:07:09.929 05:03:11 -- accel/accel.sh@21 -- # val= 00:07:09.929 05:03:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.929 05:03:11 -- accel/accel.sh@20 -- # IFS=: 00:07:09.929 05:03:11 -- accel/accel.sh@20 -- # read -r var val 00:07:09.929 05:03:11 -- accel/accel.sh@21 -- # val= 00:07:09.929 05:03:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.929 05:03:11 -- accel/accel.sh@20 -- # IFS=: 00:07:09.929 05:03:11 -- accel/accel.sh@20 -- # read -r var val 00:07:09.929 05:03:11 -- accel/accel.sh@21 -- # val= 00:07:09.929 05:03:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.929 05:03:11 -- accel/accel.sh@20 -- # IFS=: 00:07:09.929 05:03:11 -- accel/accel.sh@20 -- # read -r var val 00:07:09.929 05:03:11 -- accel/accel.sh@21 -- # val= 00:07:09.929 05:03:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.929 05:03:11 -- accel/accel.sh@20 -- # IFS=: 00:07:09.929 05:03:11 -- accel/accel.sh@20 -- # read -r var val 00:07:09.929 05:03:11 -- accel/accel.sh@21 -- # val= 00:07:09.929 05:03:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.929 05:03:11 -- accel/accel.sh@20 -- # IFS=: 00:07:09.929 05:03:11 -- accel/accel.sh@20 -- # read -r var val 00:07:09.929 05:03:11 -- accel/accel.sh@21 -- # val= 00:07:09.929 05:03:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.929 05:03:11 -- accel/accel.sh@20 -- # IFS=: 00:07:09.929 05:03:11 -- accel/accel.sh@20 -- # read -r var val 00:07:09.929 05:03:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:09.929 05:03:11 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:09.929 05:03:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:09.929 00:07:09.929 real 0m2.803s 00:07:09.929 user 0m2.500s 00:07:09.929 sys 0m0.293s 00:07:09.929 05:03:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:09.929 05:03:11 -- common/autotest_common.sh@10 -- # set +x 00:07:09.929 ************************************ 00:07:09.929 END TEST accel_xor 00:07:09.929 ************************************ 00:07:09.929 05:03:11 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:09.929 05:03:11 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:09.929 05:03:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:09.929 05:03:11 -- common/autotest_common.sh@10 -- # set +x 00:07:09.929 ************************************ 00:07:09.929 START TEST accel_xor 00:07:09.929 ************************************ 00:07:09.929 05:03:11 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:07:09.929 05:03:11 -- accel/accel.sh@16 -- # local accel_opc 00:07:09.929 05:03:11 -- accel/accel.sh@17 -- # local accel_module 00:07:09.929 05:03:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:09.929 05:03:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:09.929 05:03:11 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.929 05:03:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:09.929 05:03:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.929 05:03:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.929 05:03:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:09.929 05:03:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:09.929 05:03:11 -- accel/accel.sh@41 -- # local IFS=, 00:07:09.929 05:03:11 -- accel/accel.sh@42 -- # jq -r . 00:07:09.929 [2024-11-26 05:03:11.505782] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:09.929 [2024-11-26 05:03:11.505866] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3186307 ] 00:07:09.929 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.929 [2024-11-26 05:03:11.568822] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.929 [2024-11-26 05:03:11.659752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.307 05:03:12 -- accel/accel.sh@18 -- # out=' 00:07:11.307 SPDK Configuration: 00:07:11.307 Core mask: 0x1 00:07:11.307 00:07:11.307 Accel Perf Configuration: 00:07:11.307 Workload Type: xor 00:07:11.307 Source buffers: 3 00:07:11.307 Transfer size: 4096 bytes 00:07:11.307 Vector count 1 00:07:11.307 Module: software 00:07:11.307 Queue depth: 32 00:07:11.307 Allocate depth: 32 00:07:11.307 # threads/core: 1 00:07:11.307 Run time: 1 seconds 00:07:11.307 Verify: Yes 00:07:11.307 00:07:11.307 Running for 1 seconds... 00:07:11.307 00:07:11.307 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:11.307 ------------------------------------------------------------------------------------ 00:07:11.307 0,0 184576/s 721 MiB/s 0 0 00:07:11.307 ==================================================================================== 00:07:11.307 Total 184576/s 721 MiB/s 0 0' 00:07:11.307 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:07:11.307 05:03:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:11.307 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:07:11.307 05:03:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:11.307 05:03:12 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.307 05:03:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:11.307 05:03:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.307 05:03:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.307 05:03:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:11.307 05:03:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:11.307 05:03:12 -- accel/accel.sh@41 -- # local IFS=, 00:07:11.307 05:03:12 -- accel/accel.sh@42 -- # jq -r . 00:07:11.307 [2024-11-26 05:03:12.917312] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:11.307 [2024-11-26 05:03:12.917406] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3186451 ] 00:07:11.307 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.307 [2024-11-26 05:03:12.978856] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.307 [2024-11-26 05:03:13.068985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.566 05:03:13 -- accel/accel.sh@21 -- # val= 00:07:11.566 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.566 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.566 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.566 05:03:13 -- accel/accel.sh@21 -- # val= 00:07:11.566 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.566 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.566 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.566 05:03:13 -- accel/accel.sh@21 -- # val=0x1 00:07:11.566 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.566 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.566 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.566 05:03:13 -- accel/accel.sh@21 -- # val= 00:07:11.566 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.566 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.567 05:03:13 -- accel/accel.sh@21 -- # val= 00:07:11.567 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.567 05:03:13 -- accel/accel.sh@21 -- # val=xor 00:07:11.567 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.567 05:03:13 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.567 05:03:13 -- accel/accel.sh@21 -- # val=3 00:07:11.567 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.567 05:03:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:11.567 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.567 05:03:13 -- accel/accel.sh@21 -- # val= 00:07:11.567 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.567 05:03:13 -- accel/accel.sh@21 -- # val=software 00:07:11.567 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.567 05:03:13 -- accel/accel.sh@23 -- # accel_module=software 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.567 05:03:13 -- accel/accel.sh@21 -- # val=32 00:07:11.567 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.567 05:03:13 -- accel/accel.sh@21 -- # val=32 00:07:11.567 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.567 05:03:13 -- accel/accel.sh@21 -- # val=1 00:07:11.567 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.567 05:03:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:11.567 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.567 05:03:13 -- accel/accel.sh@21 -- # val=Yes 00:07:11.567 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.567 05:03:13 -- accel/accel.sh@21 -- # val= 00:07:11.567 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.567 05:03:13 -- accel/accel.sh@21 -- # val= 00:07:11.567 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:07:11.567 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:07:12.943 05:03:14 -- accel/accel.sh@21 -- # val= 00:07:12.943 05:03:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.943 05:03:14 -- accel/accel.sh@20 -- # IFS=: 00:07:12.943 05:03:14 -- accel/accel.sh@20 -- # read -r var val 00:07:12.943 05:03:14 -- accel/accel.sh@21 -- # val= 00:07:12.943 05:03:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.943 05:03:14 -- accel/accel.sh@20 -- # IFS=: 00:07:12.943 05:03:14 -- accel/accel.sh@20 -- # read -r var val 00:07:12.943 05:03:14 -- accel/accel.sh@21 -- # val= 00:07:12.943 05:03:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.943 05:03:14 -- accel/accel.sh@20 -- # IFS=: 00:07:12.943 05:03:14 -- accel/accel.sh@20 -- # read -r var val 00:07:12.943 05:03:14 -- accel/accel.sh@21 -- # val= 00:07:12.943 05:03:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.943 05:03:14 -- accel/accel.sh@20 -- # IFS=: 00:07:12.943 05:03:14 -- accel/accel.sh@20 -- # read -r var val 00:07:12.943 05:03:14 -- accel/accel.sh@21 -- # val= 00:07:12.943 05:03:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.943 05:03:14 -- accel/accel.sh@20 -- # IFS=: 00:07:12.943 05:03:14 -- accel/accel.sh@20 -- # read -r var val 00:07:12.943 05:03:14 -- accel/accel.sh@21 -- # val= 00:07:12.943 05:03:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.943 05:03:14 -- accel/accel.sh@20 -- # IFS=: 00:07:12.943 05:03:14 -- accel/accel.sh@20 -- # read -r var val 00:07:12.943 05:03:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:12.943 05:03:14 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:12.943 05:03:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:12.943 00:07:12.943 real 0m2.807s 00:07:12.943 user 0m2.515s 00:07:12.943 sys 0m0.284s 00:07:12.943 05:03:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:12.943 05:03:14 -- common/autotest_common.sh@10 -- # set +x 00:07:12.943 ************************************ 00:07:12.943 END TEST accel_xor 00:07:12.943 ************************************ 00:07:12.943 05:03:14 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:12.943 05:03:14 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:12.943 05:03:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:12.944 05:03:14 -- common/autotest_common.sh@10 -- # set +x 00:07:12.944 ************************************ 00:07:12.944 START TEST accel_dif_verify 00:07:12.944 ************************************ 00:07:12.944 05:03:14 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:07:12.944 05:03:14 -- accel/accel.sh@16 -- # local accel_opc 00:07:12.944 05:03:14 -- accel/accel.sh@17 -- # local accel_module 00:07:12.944 05:03:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:12.944 05:03:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:12.944 05:03:14 -- accel/accel.sh@12 -- # build_accel_config 00:07:12.944 05:03:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:12.944 05:03:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:12.944 05:03:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:12.944 05:03:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:12.944 05:03:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:12.944 05:03:14 -- accel/accel.sh@41 -- # local IFS=, 00:07:12.944 05:03:14 -- accel/accel.sh@42 -- # jq -r . 00:07:12.944 [2024-11-26 05:03:14.340274] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:12.944 [2024-11-26 05:03:14.340365] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3186611 ] 00:07:12.944 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.944 [2024-11-26 05:03:14.402845] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.944 [2024-11-26 05:03:14.493040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.326 05:03:15 -- accel/accel.sh@18 -- # out=' 00:07:14.326 SPDK Configuration: 00:07:14.326 Core mask: 0x1 00:07:14.326 00:07:14.326 Accel Perf Configuration: 00:07:14.326 Workload Type: dif_verify 00:07:14.326 Vector size: 4096 bytes 00:07:14.326 Transfer size: 4096 bytes 00:07:14.326 Block size: 512 bytes 00:07:14.326 Metadata size: 8 bytes 00:07:14.326 Vector count 1 00:07:14.326 Module: software 00:07:14.326 Queue depth: 32 00:07:14.326 Allocate depth: 32 00:07:14.326 # threads/core: 1 00:07:14.326 Run time: 1 seconds 00:07:14.326 Verify: No 00:07:14.326 00:07:14.326 Running for 1 seconds... 00:07:14.326 00:07:14.326 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:14.326 ------------------------------------------------------------------------------------ 00:07:14.326 0,0 82016/s 325 MiB/s 0 0 00:07:14.326 ==================================================================================== 00:07:14.326 Total 82016/s 320 MiB/s 0 0' 00:07:14.326 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.326 05:03:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:14.326 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.326 05:03:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:14.326 05:03:15 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.326 05:03:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.326 05:03:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.326 05:03:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.326 05:03:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.326 05:03:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.326 05:03:15 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.326 05:03:15 -- accel/accel.sh@42 -- # jq -r . 00:07:14.326 [2024-11-26 05:03:15.748162] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:14.326 [2024-11-26 05:03:15.748254] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3186755 ] 00:07:14.326 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.326 [2024-11-26 05:03:15.810015] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.326 [2024-11-26 05:03:15.900826] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.326 05:03:15 -- accel/accel.sh@21 -- # val= 00:07:14.326 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.326 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.326 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.326 05:03:15 -- accel/accel.sh@21 -- # val= 00:07:14.326 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.326 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.326 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.326 05:03:15 -- accel/accel.sh@21 -- # val=0x1 00:07:14.326 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.326 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.326 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.326 05:03:15 -- accel/accel.sh@21 -- # val= 00:07:14.326 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val= 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val=dif_verify 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val= 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val=software 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@23 -- # accel_module=software 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val=32 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val=32 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val=1 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val=No 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val= 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:14.327 05:03:15 -- accel/accel.sh@21 -- # val= 00:07:14.327 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:07:14.327 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.705 05:03:17 -- accel/accel.sh@21 -- # val= 00:07:15.705 05:03:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.705 05:03:17 -- accel/accel.sh@20 -- # IFS=: 00:07:15.705 05:03:17 -- accel/accel.sh@20 -- # read -r var val 00:07:15.705 05:03:17 -- accel/accel.sh@21 -- # val= 00:07:15.705 05:03:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.705 05:03:17 -- accel/accel.sh@20 -- # IFS=: 00:07:15.705 05:03:17 -- accel/accel.sh@20 -- # read -r var val 00:07:15.705 05:03:17 -- accel/accel.sh@21 -- # val= 00:07:15.705 05:03:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.705 05:03:17 -- accel/accel.sh@20 -- # IFS=: 00:07:15.705 05:03:17 -- accel/accel.sh@20 -- # read -r var val 00:07:15.705 05:03:17 -- accel/accel.sh@21 -- # val= 00:07:15.705 05:03:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.705 05:03:17 -- accel/accel.sh@20 -- # IFS=: 00:07:15.705 05:03:17 -- accel/accel.sh@20 -- # read -r var val 00:07:15.705 05:03:17 -- accel/accel.sh@21 -- # val= 00:07:15.705 05:03:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.705 05:03:17 -- accel/accel.sh@20 -- # IFS=: 00:07:15.705 05:03:17 -- accel/accel.sh@20 -- # read -r var val 00:07:15.705 05:03:17 -- accel/accel.sh@21 -- # val= 00:07:15.705 05:03:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.705 05:03:17 -- accel/accel.sh@20 -- # IFS=: 00:07:15.705 05:03:17 -- accel/accel.sh@20 -- # read -r var val 00:07:15.705 05:03:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:15.705 05:03:17 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:15.705 05:03:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:15.705 00:07:15.705 real 0m2.799s 00:07:15.705 user 0m2.517s 00:07:15.705 sys 0m0.276s 00:07:15.705 05:03:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:15.705 05:03:17 -- common/autotest_common.sh@10 -- # set +x 00:07:15.705 ************************************ 00:07:15.705 END TEST accel_dif_verify 00:07:15.705 ************************************ 00:07:15.705 05:03:17 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:15.705 05:03:17 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:15.705 05:03:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:15.705 05:03:17 -- common/autotest_common.sh@10 -- # set +x 00:07:15.705 ************************************ 00:07:15.705 START TEST accel_dif_generate 00:07:15.705 ************************************ 00:07:15.705 05:03:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:15.705 05:03:17 -- accel/accel.sh@16 -- # local accel_opc 00:07:15.705 05:03:17 -- accel/accel.sh@17 -- # local accel_module 00:07:15.705 05:03:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:15.705 05:03:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:15.705 05:03:17 -- accel/accel.sh@12 -- # build_accel_config 00:07:15.705 05:03:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:15.705 05:03:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:15.705 05:03:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:15.705 05:03:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:15.705 05:03:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:15.705 05:03:17 -- accel/accel.sh@41 -- # local IFS=, 00:07:15.705 05:03:17 -- accel/accel.sh@42 -- # jq -r . 00:07:15.705 [2024-11-26 05:03:17.167362] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:15.705 [2024-11-26 05:03:17.167434] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3187035 ] 00:07:15.705 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.705 [2024-11-26 05:03:17.229414] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:15.705 [2024-11-26 05:03:17.318226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.088 05:03:18 -- accel/accel.sh@18 -- # out=' 00:07:17.088 SPDK Configuration: 00:07:17.088 Core mask: 0x1 00:07:17.088 00:07:17.088 Accel Perf Configuration: 00:07:17.088 Workload Type: dif_generate 00:07:17.088 Vector size: 4096 bytes 00:07:17.088 Transfer size: 4096 bytes 00:07:17.088 Block size: 512 bytes 00:07:17.088 Metadata size: 8 bytes 00:07:17.088 Vector count 1 00:07:17.088 Module: software 00:07:17.088 Queue depth: 32 00:07:17.088 Allocate depth: 32 00:07:17.088 # threads/core: 1 00:07:17.088 Run time: 1 seconds 00:07:17.088 Verify: No 00:07:17.088 00:07:17.088 Running for 1 seconds... 00:07:17.088 00:07:17.088 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:17.088 ------------------------------------------------------------------------------------ 00:07:17.088 0,0 96736/s 383 MiB/s 0 0 00:07:17.088 ==================================================================================== 00:07:17.088 Total 96736/s 377 MiB/s 0 0' 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.088 05:03:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.088 05:03:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:17.088 05:03:18 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.088 05:03:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.088 05:03:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.088 05:03:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.088 05:03:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.088 05:03:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.088 05:03:18 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.088 05:03:18 -- accel/accel.sh@42 -- # jq -r . 00:07:17.088 [2024-11-26 05:03:18.576510] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:17.088 [2024-11-26 05:03:18.576601] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3187173 ] 00:07:17.088 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.088 [2024-11-26 05:03:18.638661] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.088 [2024-11-26 05:03:18.729279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.088 05:03:18 -- accel/accel.sh@21 -- # val= 00:07:17.088 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.088 05:03:18 -- accel/accel.sh@21 -- # val= 00:07:17.088 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.088 05:03:18 -- accel/accel.sh@21 -- # val=0x1 00:07:17.088 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.088 05:03:18 -- accel/accel.sh@21 -- # val= 00:07:17.088 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.088 05:03:18 -- accel/accel.sh@21 -- # val= 00:07:17.088 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.088 05:03:18 -- accel/accel.sh@21 -- # val=dif_generate 00:07:17.088 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.088 05:03:18 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.088 05:03:18 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:17.088 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.088 05:03:18 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:17.088 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.088 05:03:18 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:17.088 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.088 05:03:18 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:17.088 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.088 05:03:18 -- accel/accel.sh@21 -- # val= 00:07:17.088 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.088 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.089 05:03:18 -- accel/accel.sh@21 -- # val=software 00:07:17.089 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.089 05:03:18 -- accel/accel.sh@23 -- # accel_module=software 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.089 05:03:18 -- accel/accel.sh@21 -- # val=32 00:07:17.089 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.089 05:03:18 -- accel/accel.sh@21 -- # val=32 00:07:17.089 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.089 05:03:18 -- accel/accel.sh@21 -- # val=1 00:07:17.089 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.089 05:03:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:17.089 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.089 05:03:18 -- accel/accel.sh@21 -- # val=No 00:07:17.089 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.089 05:03:18 -- accel/accel.sh@21 -- # val= 00:07:17.089 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:17.089 05:03:18 -- accel/accel.sh@21 -- # val= 00:07:17.089 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:07:17.089 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.467 05:03:19 -- accel/accel.sh@21 -- # val= 00:07:18.467 05:03:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.467 05:03:19 -- accel/accel.sh@20 -- # IFS=: 00:07:18.467 05:03:19 -- accel/accel.sh@20 -- # read -r var val 00:07:18.467 05:03:19 -- accel/accel.sh@21 -- # val= 00:07:18.467 05:03:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.467 05:03:19 -- accel/accel.sh@20 -- # IFS=: 00:07:18.467 05:03:19 -- accel/accel.sh@20 -- # read -r var val 00:07:18.467 05:03:19 -- accel/accel.sh@21 -- # val= 00:07:18.467 05:03:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.467 05:03:19 -- accel/accel.sh@20 -- # IFS=: 00:07:18.467 05:03:19 -- accel/accel.sh@20 -- # read -r var val 00:07:18.467 05:03:19 -- accel/accel.sh@21 -- # val= 00:07:18.467 05:03:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.467 05:03:19 -- accel/accel.sh@20 -- # IFS=: 00:07:18.467 05:03:19 -- accel/accel.sh@20 -- # read -r var val 00:07:18.467 05:03:19 -- accel/accel.sh@21 -- # val= 00:07:18.467 05:03:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.467 05:03:19 -- accel/accel.sh@20 -- # IFS=: 00:07:18.467 05:03:19 -- accel/accel.sh@20 -- # read -r var val 00:07:18.467 05:03:19 -- accel/accel.sh@21 -- # val= 00:07:18.467 05:03:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.467 05:03:19 -- accel/accel.sh@20 -- # IFS=: 00:07:18.467 05:03:19 -- accel/accel.sh@20 -- # read -r var val 00:07:18.467 05:03:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:18.467 05:03:19 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:18.467 05:03:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:18.467 00:07:18.467 real 0m2.816s 00:07:18.467 user 0m2.525s 00:07:18.467 sys 0m0.284s 00:07:18.467 05:03:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:18.467 05:03:19 -- common/autotest_common.sh@10 -- # set +x 00:07:18.467 ************************************ 00:07:18.467 END TEST accel_dif_generate 00:07:18.467 ************************************ 00:07:18.467 05:03:19 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:18.467 05:03:19 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:18.467 05:03:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:18.467 05:03:19 -- common/autotest_common.sh@10 -- # set +x 00:07:18.467 ************************************ 00:07:18.467 START TEST accel_dif_generate_copy 00:07:18.467 ************************************ 00:07:18.467 05:03:19 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:18.467 05:03:19 -- accel/accel.sh@16 -- # local accel_opc 00:07:18.467 05:03:19 -- accel/accel.sh@17 -- # local accel_module 00:07:18.467 05:03:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:18.467 05:03:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:18.467 05:03:19 -- accel/accel.sh@12 -- # build_accel_config 00:07:18.467 05:03:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:18.467 05:03:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:18.467 05:03:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:18.467 05:03:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:18.467 05:03:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:18.467 05:03:19 -- accel/accel.sh@41 -- # local IFS=, 00:07:18.467 05:03:19 -- accel/accel.sh@42 -- # jq -r . 00:07:18.467 [2024-11-26 05:03:20.008817] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:18.467 [2024-11-26 05:03:20.008902] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3187338 ] 00:07:18.467 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.467 [2024-11-26 05:03:20.075556] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:18.467 [2024-11-26 05:03:20.166680] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.845 05:03:21 -- accel/accel.sh@18 -- # out=' 00:07:19.845 SPDK Configuration: 00:07:19.845 Core mask: 0x1 00:07:19.845 00:07:19.845 Accel Perf Configuration: 00:07:19.845 Workload Type: dif_generate_copy 00:07:19.845 Vector size: 4096 bytes 00:07:19.845 Transfer size: 4096 bytes 00:07:19.845 Vector count 1 00:07:19.845 Module: software 00:07:19.845 Queue depth: 32 00:07:19.845 Allocate depth: 32 00:07:19.845 # threads/core: 1 00:07:19.845 Run time: 1 seconds 00:07:19.845 Verify: No 00:07:19.845 00:07:19.845 Running for 1 seconds... 00:07:19.845 00:07:19.845 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:19.845 ------------------------------------------------------------------------------------ 00:07:19.845 0,0 75968/s 301 MiB/s 0 0 00:07:19.845 ==================================================================================== 00:07:19.845 Total 75968/s 296 MiB/s 0 0' 00:07:19.845 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.845 05:03:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:19.845 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.845 05:03:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:19.845 05:03:21 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.845 05:03:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.845 05:03:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.845 05:03:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.845 05:03:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.845 05:03:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.845 05:03:21 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.845 05:03:21 -- accel/accel.sh@42 -- # jq -r . 00:07:19.845 [2024-11-26 05:03:21.424829] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:19.845 [2024-11-26 05:03:21.424919] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3187478 ] 00:07:19.845 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.845 [2024-11-26 05:03:21.485897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.845 [2024-11-26 05:03:21.575169] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.105 05:03:21 -- accel/accel.sh@21 -- # val= 00:07:20.105 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.105 05:03:21 -- accel/accel.sh@21 -- # val= 00:07:20.105 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.105 05:03:21 -- accel/accel.sh@21 -- # val=0x1 00:07:20.105 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.105 05:03:21 -- accel/accel.sh@21 -- # val= 00:07:20.105 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.105 05:03:21 -- accel/accel.sh@21 -- # val= 00:07:20.105 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.105 05:03:21 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:20.105 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.105 05:03:21 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.105 05:03:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.105 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.105 05:03:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.105 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.105 05:03:21 -- accel/accel.sh@21 -- # val= 00:07:20.105 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.105 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.105 05:03:21 -- accel/accel.sh@21 -- # val=software 00:07:20.106 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.106 05:03:21 -- accel/accel.sh@23 -- # accel_module=software 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.106 05:03:21 -- accel/accel.sh@21 -- # val=32 00:07:20.106 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.106 05:03:21 -- accel/accel.sh@21 -- # val=32 00:07:20.106 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.106 05:03:21 -- accel/accel.sh@21 -- # val=1 00:07:20.106 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.106 05:03:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:20.106 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.106 05:03:21 -- accel/accel.sh@21 -- # val=No 00:07:20.106 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.106 05:03:21 -- accel/accel.sh@21 -- # val= 00:07:20.106 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.106 05:03:21 -- accel/accel.sh@21 -- # val= 00:07:20.106 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:07:20.106 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.046 05:03:22 -- accel/accel.sh@21 -- # val= 00:07:21.046 05:03:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.046 05:03:22 -- accel/accel.sh@20 -- # IFS=: 00:07:21.046 05:03:22 -- accel/accel.sh@20 -- # read -r var val 00:07:21.046 05:03:22 -- accel/accel.sh@21 -- # val= 00:07:21.046 05:03:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.046 05:03:22 -- accel/accel.sh@20 -- # IFS=: 00:07:21.046 05:03:22 -- accel/accel.sh@20 -- # read -r var val 00:07:21.046 05:03:22 -- accel/accel.sh@21 -- # val= 00:07:21.046 05:03:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.046 05:03:22 -- accel/accel.sh@20 -- # IFS=: 00:07:21.046 05:03:22 -- accel/accel.sh@20 -- # read -r var val 00:07:21.046 05:03:22 -- accel/accel.sh@21 -- # val= 00:07:21.046 05:03:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.046 05:03:22 -- accel/accel.sh@20 -- # IFS=: 00:07:21.046 05:03:22 -- accel/accel.sh@20 -- # read -r var val 00:07:21.046 05:03:22 -- accel/accel.sh@21 -- # val= 00:07:21.046 05:03:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.046 05:03:22 -- accel/accel.sh@20 -- # IFS=: 00:07:21.046 05:03:22 -- accel/accel.sh@20 -- # read -r var val 00:07:21.046 05:03:22 -- accel/accel.sh@21 -- # val= 00:07:21.046 05:03:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.046 05:03:22 -- accel/accel.sh@20 -- # IFS=: 00:07:21.046 05:03:22 -- accel/accel.sh@20 -- # read -r var val 00:07:21.046 05:03:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:21.046 05:03:22 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:21.046 05:03:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:21.046 00:07:21.046 real 0m2.808s 00:07:21.046 user 0m2.526s 00:07:21.046 sys 0m0.274s 00:07:21.046 05:03:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:21.046 05:03:22 -- common/autotest_common.sh@10 -- # set +x 00:07:21.046 ************************************ 00:07:21.046 END TEST accel_dif_generate_copy 00:07:21.046 ************************************ 00:07:21.332 05:03:22 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:21.332 05:03:22 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:21.332 05:03:22 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:21.332 05:03:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.332 05:03:22 -- common/autotest_common.sh@10 -- # set +x 00:07:21.332 ************************************ 00:07:21.332 START TEST accel_comp 00:07:21.332 ************************************ 00:07:21.332 05:03:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:21.332 05:03:22 -- accel/accel.sh@16 -- # local accel_opc 00:07:21.332 05:03:22 -- accel/accel.sh@17 -- # local accel_module 00:07:21.332 05:03:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:21.332 05:03:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:21.332 05:03:22 -- accel/accel.sh@12 -- # build_accel_config 00:07:21.332 05:03:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:21.332 05:03:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:21.332 05:03:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:21.332 05:03:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:21.332 05:03:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:21.332 05:03:22 -- accel/accel.sh@41 -- # local IFS=, 00:07:21.332 05:03:22 -- accel/accel.sh@42 -- # jq -r . 00:07:21.332 [2024-11-26 05:03:22.837941] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:21.332 [2024-11-26 05:03:22.838053] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3187762 ] 00:07:21.332 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.332 [2024-11-26 05:03:22.901823] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:21.332 [2024-11-26 05:03:22.991319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:22.717 05:03:24 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:22.717 00:07:22.717 SPDK Configuration: 00:07:22.717 Core mask: 0x1 00:07:22.717 00:07:22.717 Accel Perf Configuration: 00:07:22.717 Workload Type: compress 00:07:22.717 Transfer size: 4096 bytes 00:07:22.717 Vector count 1 00:07:22.717 Module: software 00:07:22.717 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:22.717 Queue depth: 32 00:07:22.717 Allocate depth: 32 00:07:22.717 # threads/core: 1 00:07:22.717 Run time: 1 seconds 00:07:22.717 Verify: No 00:07:22.717 00:07:22.717 Running for 1 seconds... 00:07:22.717 00:07:22.717 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:22.717 ------------------------------------------------------------------------------------ 00:07:22.717 0,0 32384/s 134 MiB/s 0 0 00:07:22.717 ==================================================================================== 00:07:22.717 Total 32384/s 126 MiB/s 0 0' 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.717 05:03:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.717 05:03:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:22.717 05:03:24 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.717 05:03:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:22.717 05:03:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.717 05:03:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.717 05:03:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:22.717 05:03:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:22.717 05:03:24 -- accel/accel.sh@41 -- # local IFS=, 00:07:22.717 05:03:24 -- accel/accel.sh@42 -- # jq -r . 00:07:22.717 [2024-11-26 05:03:24.249918] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:22.717 [2024-11-26 05:03:24.250008] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3187904 ] 00:07:22.717 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.717 [2024-11-26 05:03:24.311749] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.717 [2024-11-26 05:03:24.401675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:22.717 05:03:24 -- accel/accel.sh@21 -- # val= 00:07:22.717 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.717 05:03:24 -- accel/accel.sh@21 -- # val= 00:07:22.717 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.717 05:03:24 -- accel/accel.sh@21 -- # val= 00:07:22.717 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.717 05:03:24 -- accel/accel.sh@21 -- # val=0x1 00:07:22.717 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.717 05:03:24 -- accel/accel.sh@21 -- # val= 00:07:22.717 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.717 05:03:24 -- accel/accel.sh@21 -- # val= 00:07:22.717 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.717 05:03:24 -- accel/accel.sh@21 -- # val=compress 00:07:22.717 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.717 05:03:24 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.717 05:03:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:22.717 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.717 05:03:24 -- accel/accel.sh@21 -- # val= 00:07:22.717 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.717 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.717 05:03:24 -- accel/accel.sh@21 -- # val=software 00:07:22.717 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.718 05:03:24 -- accel/accel.sh@23 -- # accel_module=software 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.718 05:03:24 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:22.718 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.718 05:03:24 -- accel/accel.sh@21 -- # val=32 00:07:22.718 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.718 05:03:24 -- accel/accel.sh@21 -- # val=32 00:07:22.718 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.718 05:03:24 -- accel/accel.sh@21 -- # val=1 00:07:22.718 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.718 05:03:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:22.718 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.718 05:03:24 -- accel/accel.sh@21 -- # val=No 00:07:22.718 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.718 05:03:24 -- accel/accel.sh@21 -- # val= 00:07:22.718 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.718 05:03:24 -- accel/accel.sh@21 -- # val= 00:07:22.718 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.718 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.096 05:03:25 -- accel/accel.sh@21 -- # val= 00:07:24.096 05:03:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.096 05:03:25 -- accel/accel.sh@20 -- # IFS=: 00:07:24.096 05:03:25 -- accel/accel.sh@20 -- # read -r var val 00:07:24.096 05:03:25 -- accel/accel.sh@21 -- # val= 00:07:24.096 05:03:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.096 05:03:25 -- accel/accel.sh@20 -- # IFS=: 00:07:24.096 05:03:25 -- accel/accel.sh@20 -- # read -r var val 00:07:24.096 05:03:25 -- accel/accel.sh@21 -- # val= 00:07:24.096 05:03:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.096 05:03:25 -- accel/accel.sh@20 -- # IFS=: 00:07:24.096 05:03:25 -- accel/accel.sh@20 -- # read -r var val 00:07:24.096 05:03:25 -- accel/accel.sh@21 -- # val= 00:07:24.096 05:03:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.096 05:03:25 -- accel/accel.sh@20 -- # IFS=: 00:07:24.096 05:03:25 -- accel/accel.sh@20 -- # read -r var val 00:07:24.096 05:03:25 -- accel/accel.sh@21 -- # val= 00:07:24.096 05:03:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.096 05:03:25 -- accel/accel.sh@20 -- # IFS=: 00:07:24.096 05:03:25 -- accel/accel.sh@20 -- # read -r var val 00:07:24.096 05:03:25 -- accel/accel.sh@21 -- # val= 00:07:24.096 05:03:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.096 05:03:25 -- accel/accel.sh@20 -- # IFS=: 00:07:24.096 05:03:25 -- accel/accel.sh@20 -- # read -r var val 00:07:24.096 05:03:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:24.096 05:03:25 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:24.096 05:03:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:24.096 00:07:24.096 real 0m2.815s 00:07:24.096 user 0m2.503s 00:07:24.096 sys 0m0.306s 00:07:24.096 05:03:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:24.096 05:03:25 -- common/autotest_common.sh@10 -- # set +x 00:07:24.096 ************************************ 00:07:24.096 END TEST accel_comp 00:07:24.096 ************************************ 00:07:24.096 05:03:25 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:24.096 05:03:25 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:24.096 05:03:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.096 05:03:25 -- common/autotest_common.sh@10 -- # set +x 00:07:24.096 ************************************ 00:07:24.096 START TEST accel_decomp 00:07:24.096 ************************************ 00:07:24.096 05:03:25 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:24.096 05:03:25 -- accel/accel.sh@16 -- # local accel_opc 00:07:24.096 05:03:25 -- accel/accel.sh@17 -- # local accel_module 00:07:24.096 05:03:25 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:24.096 05:03:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:24.096 05:03:25 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.096 05:03:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.096 05:03:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.096 05:03:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.096 05:03:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.096 05:03:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.096 05:03:25 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.096 05:03:25 -- accel/accel.sh@42 -- # jq -r . 00:07:24.096 [2024-11-26 05:03:25.679304] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:24.096 [2024-11-26 05:03:25.679391] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3188059 ] 00:07:24.096 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.096 [2024-11-26 05:03:25.739735] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.096 [2024-11-26 05:03:25.827620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.480 05:03:27 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:25.480 00:07:25.480 SPDK Configuration: 00:07:25.480 Core mask: 0x1 00:07:25.480 00:07:25.480 Accel Perf Configuration: 00:07:25.480 Workload Type: decompress 00:07:25.480 Transfer size: 4096 bytes 00:07:25.480 Vector count 1 00:07:25.480 Module: software 00:07:25.480 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.480 Queue depth: 32 00:07:25.480 Allocate depth: 32 00:07:25.480 # threads/core: 1 00:07:25.480 Run time: 1 seconds 00:07:25.480 Verify: Yes 00:07:25.480 00:07:25.480 Running for 1 seconds... 00:07:25.480 00:07:25.480 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:25.480 ------------------------------------------------------------------------------------ 00:07:25.480 0,0 55456/s 102 MiB/s 0 0 00:07:25.480 ==================================================================================== 00:07:25.480 Total 55456/s 216 MiB/s 0 0' 00:07:25.480 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.480 05:03:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:25.480 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.480 05:03:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:25.480 05:03:27 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.480 05:03:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:25.480 05:03:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.480 05:03:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.480 05:03:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:25.480 05:03:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:25.480 05:03:27 -- accel/accel.sh@41 -- # local IFS=, 00:07:25.480 05:03:27 -- accel/accel.sh@42 -- # jq -r . 00:07:25.480 [2024-11-26 05:03:27.079581] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:25.480 [2024-11-26 05:03:27.079674] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3188208 ] 00:07:25.480 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.480 [2024-11-26 05:03:27.141383] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:25.480 [2024-11-26 05:03:27.236460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val= 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val= 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val= 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val=0x1 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val= 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val= 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val=decompress 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val= 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val=software 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@23 -- # accel_module=software 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val=32 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val=32 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val=1 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val=Yes 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val= 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.740 05:03:27 -- accel/accel.sh@21 -- # val= 00:07:25.740 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.740 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 05:03:28 -- accel/accel.sh@21 -- # val= 00:07:27.118 05:03:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.118 05:03:28 -- accel/accel.sh@20 -- # IFS=: 00:07:27.118 05:03:28 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 05:03:28 -- accel/accel.sh@21 -- # val= 00:07:27.118 05:03:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.118 05:03:28 -- accel/accel.sh@20 -- # IFS=: 00:07:27.118 05:03:28 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 05:03:28 -- accel/accel.sh@21 -- # val= 00:07:27.118 05:03:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.118 05:03:28 -- accel/accel.sh@20 -- # IFS=: 00:07:27.118 05:03:28 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 05:03:28 -- accel/accel.sh@21 -- # val= 00:07:27.118 05:03:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.118 05:03:28 -- accel/accel.sh@20 -- # IFS=: 00:07:27.118 05:03:28 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 05:03:28 -- accel/accel.sh@21 -- # val= 00:07:27.118 05:03:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.118 05:03:28 -- accel/accel.sh@20 -- # IFS=: 00:07:27.118 05:03:28 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 05:03:28 -- accel/accel.sh@21 -- # val= 00:07:27.119 05:03:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.119 05:03:28 -- accel/accel.sh@20 -- # IFS=: 00:07:27.119 05:03:28 -- accel/accel.sh@20 -- # read -r var val 00:07:27.119 05:03:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:27.119 05:03:28 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:27.119 05:03:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:27.119 00:07:27.119 real 0m2.812s 00:07:27.119 user 0m2.500s 00:07:27.119 sys 0m0.305s 00:07:27.119 05:03:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.119 05:03:28 -- common/autotest_common.sh@10 -- # set +x 00:07:27.119 ************************************ 00:07:27.119 END TEST accel_decomp 00:07:27.119 ************************************ 00:07:27.119 05:03:28 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:27.119 05:03:28 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:27.119 05:03:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.119 05:03:28 -- common/autotest_common.sh@10 -- # set +x 00:07:27.119 ************************************ 00:07:27.119 START TEST accel_decmop_full 00:07:27.119 ************************************ 00:07:27.119 05:03:28 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:27.119 05:03:28 -- accel/accel.sh@16 -- # local accel_opc 00:07:27.119 05:03:28 -- accel/accel.sh@17 -- # local accel_module 00:07:27.119 05:03:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:27.119 05:03:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:27.119 05:03:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:27.119 05:03:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:27.119 05:03:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:27.119 05:03:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:27.119 05:03:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:27.119 05:03:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:27.119 05:03:28 -- accel/accel.sh@41 -- # local IFS=, 00:07:27.119 05:03:28 -- accel/accel.sh@42 -- # jq -r . 00:07:27.119 [2024-11-26 05:03:28.520031] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:27.119 [2024-11-26 05:03:28.520111] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3188484 ] 00:07:27.119 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.119 [2024-11-26 05:03:28.582420] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.119 [2024-11-26 05:03:28.671508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.494 05:03:29 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:28.494 00:07:28.494 SPDK Configuration: 00:07:28.494 Core mask: 0x1 00:07:28.494 00:07:28.494 Accel Perf Configuration: 00:07:28.494 Workload Type: decompress 00:07:28.494 Transfer size: 111250 bytes 00:07:28.494 Vector count 1 00:07:28.494 Module: software 00:07:28.494 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.494 Queue depth: 32 00:07:28.494 Allocate depth: 32 00:07:28.494 # threads/core: 1 00:07:28.494 Run time: 1 seconds 00:07:28.494 Verify: Yes 00:07:28.494 00:07:28.494 Running for 1 seconds... 00:07:28.494 00:07:28.494 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:28.494 ------------------------------------------------------------------------------------ 00:07:28.494 0,0 3776/s 155 MiB/s 0 0 00:07:28.494 ==================================================================================== 00:07:28.494 Total 3776/s 400 MiB/s 0 0' 00:07:28.494 05:03:29 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 05:03:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:28.494 05:03:29 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 05:03:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:28.494 05:03:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.494 05:03:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:28.494 05:03:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.494 05:03:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.494 05:03:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:28.494 05:03:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:28.494 05:03:29 -- accel/accel.sh@41 -- # local IFS=, 00:07:28.494 05:03:29 -- accel/accel.sh@42 -- # jq -r . 00:07:28.494 [2024-11-26 05:03:29.935579] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:28.494 [2024-11-26 05:03:29.935669] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3188631 ] 00:07:28.494 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.494 [2024-11-26 05:03:29.997346] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.494 [2024-11-26 05:03:30.098077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.494 05:03:30 -- accel/accel.sh@21 -- # val= 00:07:28.494 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 05:03:30 -- accel/accel.sh@21 -- # val= 00:07:28.494 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 05:03:30 -- accel/accel.sh@21 -- # val= 00:07:28.494 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 05:03:30 -- accel/accel.sh@21 -- # val=0x1 00:07:28.494 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 05:03:30 -- accel/accel.sh@21 -- # val= 00:07:28.494 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.495 05:03:30 -- accel/accel.sh@21 -- # val= 00:07:28.495 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.495 05:03:30 -- accel/accel.sh@21 -- # val=decompress 00:07:28.495 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.495 05:03:30 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:28.495 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.495 05:03:30 -- accel/accel.sh@21 -- # val= 00:07:28.495 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.495 05:03:30 -- accel/accel.sh@21 -- # val=software 00:07:28.495 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@23 -- # accel_module=software 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.495 05:03:30 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.495 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.495 05:03:30 -- accel/accel.sh@21 -- # val=32 00:07:28.495 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.495 05:03:30 -- accel/accel.sh@21 -- # val=32 00:07:28.495 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.495 05:03:30 -- accel/accel.sh@21 -- # val=1 00:07:28.495 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.495 05:03:30 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:28.495 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.495 05:03:30 -- accel/accel.sh@21 -- # val=Yes 00:07:28.495 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.495 05:03:30 -- accel/accel.sh@21 -- # val= 00:07:28.495 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:28.495 05:03:30 -- accel/accel.sh@21 -- # val= 00:07:28.495 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:07:28.495 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:07:29.874 05:03:31 -- accel/accel.sh@21 -- # val= 00:07:29.874 05:03:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.874 05:03:31 -- accel/accel.sh@20 -- # IFS=: 00:07:29.874 05:03:31 -- accel/accel.sh@20 -- # read -r var val 00:07:29.874 05:03:31 -- accel/accel.sh@21 -- # val= 00:07:29.874 05:03:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.874 05:03:31 -- accel/accel.sh@20 -- # IFS=: 00:07:29.874 05:03:31 -- accel/accel.sh@20 -- # read -r var val 00:07:29.874 05:03:31 -- accel/accel.sh@21 -- # val= 00:07:29.874 05:03:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.874 05:03:31 -- accel/accel.sh@20 -- # IFS=: 00:07:29.874 05:03:31 -- accel/accel.sh@20 -- # read -r var val 00:07:29.874 05:03:31 -- accel/accel.sh@21 -- # val= 00:07:29.874 05:03:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.874 05:03:31 -- accel/accel.sh@20 -- # IFS=: 00:07:29.874 05:03:31 -- accel/accel.sh@20 -- # read -r var val 00:07:29.874 05:03:31 -- accel/accel.sh@21 -- # val= 00:07:29.874 05:03:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.874 05:03:31 -- accel/accel.sh@20 -- # IFS=: 00:07:29.874 05:03:31 -- accel/accel.sh@20 -- # read -r var val 00:07:29.874 05:03:31 -- accel/accel.sh@21 -- # val= 00:07:29.874 05:03:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.874 05:03:31 -- accel/accel.sh@20 -- # IFS=: 00:07:29.874 05:03:31 -- accel/accel.sh@20 -- # read -r var val 00:07:29.874 05:03:31 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:29.874 05:03:31 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:29.874 05:03:31 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:29.874 00:07:29.874 real 0m2.854s 00:07:29.874 user 0m2.555s 00:07:29.874 sys 0m0.291s 00:07:29.874 05:03:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:29.874 05:03:31 -- common/autotest_common.sh@10 -- # set +x 00:07:29.874 ************************************ 00:07:29.874 END TEST accel_decmop_full 00:07:29.874 ************************************ 00:07:29.874 05:03:31 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:29.874 05:03:31 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:29.874 05:03:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:29.874 05:03:31 -- common/autotest_common.sh@10 -- # set +x 00:07:29.874 ************************************ 00:07:29.874 START TEST accel_decomp_mcore 00:07:29.874 ************************************ 00:07:29.874 05:03:31 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:29.874 05:03:31 -- accel/accel.sh@16 -- # local accel_opc 00:07:29.874 05:03:31 -- accel/accel.sh@17 -- # local accel_module 00:07:29.874 05:03:31 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:29.874 05:03:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:29.874 05:03:31 -- accel/accel.sh@12 -- # build_accel_config 00:07:29.874 05:03:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:29.874 05:03:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:29.874 05:03:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:29.874 05:03:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:29.874 05:03:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:29.874 05:03:31 -- accel/accel.sh@41 -- # local IFS=, 00:07:29.874 05:03:31 -- accel/accel.sh@42 -- # jq -r . 00:07:29.874 [2024-11-26 05:03:31.399333] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:29.874 [2024-11-26 05:03:31.399414] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3188786 ] 00:07:29.874 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.874 [2024-11-26 05:03:31.460870] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:29.874 [2024-11-26 05:03:31.551518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:29.874 [2024-11-26 05:03:31.551589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:29.874 [2024-11-26 05:03:31.551678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:29.874 [2024-11-26 05:03:31.551681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.254 05:03:32 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:31.254 00:07:31.254 SPDK Configuration: 00:07:31.254 Core mask: 0xf 00:07:31.254 00:07:31.254 Accel Perf Configuration: 00:07:31.254 Workload Type: decompress 00:07:31.254 Transfer size: 4096 bytes 00:07:31.254 Vector count 1 00:07:31.254 Module: software 00:07:31.254 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:31.254 Queue depth: 32 00:07:31.254 Allocate depth: 32 00:07:31.254 # threads/core: 1 00:07:31.254 Run time: 1 seconds 00:07:31.254 Verify: Yes 00:07:31.254 00:07:31.254 Running for 1 seconds... 00:07:31.254 00:07:31.254 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:31.254 ------------------------------------------------------------------------------------ 00:07:31.254 0,0 56384/s 103 MiB/s 0 0 00:07:31.254 3,0 56800/s 104 MiB/s 0 0 00:07:31.254 2,0 56800/s 104 MiB/s 0 0 00:07:31.254 1,0 56576/s 104 MiB/s 0 0 00:07:31.255 ==================================================================================== 00:07:31.255 Total 226560/s 885 MiB/s 0 0' 00:07:31.255 05:03:32 -- accel/accel.sh@20 -- # IFS=: 00:07:31.255 05:03:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:31.255 05:03:32 -- accel/accel.sh@20 -- # read -r var val 00:07:31.255 05:03:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:31.255 05:03:32 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.255 05:03:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:31.255 05:03:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.255 05:03:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.255 05:03:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:31.255 05:03:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:31.255 05:03:32 -- accel/accel.sh@41 -- # local IFS=, 00:07:31.255 05:03:32 -- accel/accel.sh@42 -- # jq -r . 00:07:31.255 [2024-11-26 05:03:32.803147] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:31.255 [2024-11-26 05:03:32.803232] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3188942 ] 00:07:31.255 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.255 [2024-11-26 05:03:32.865659] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:31.255 [2024-11-26 05:03:32.958560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:31.255 [2024-11-26 05:03:32.958631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:31.255 [2024-11-26 05:03:32.958724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:31.255 [2024-11-26 05:03:32.958728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val= 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val= 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val= 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val=0xf 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val= 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val= 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val=decompress 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val= 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val=software 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@23 -- # accel_module=software 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val=32 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val=32 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val=1 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val=Yes 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val= 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:31.515 05:03:33 -- accel/accel.sh@21 -- # val= 00:07:31.515 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:07:31.515 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:07:32.456 05:03:34 -- accel/accel.sh@21 -- # val= 00:07:32.456 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:07:32.456 05:03:34 -- accel/accel.sh@21 -- # val= 00:07:32.456 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:07:32.456 05:03:34 -- accel/accel.sh@21 -- # val= 00:07:32.456 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:07:32.456 05:03:34 -- accel/accel.sh@21 -- # val= 00:07:32.456 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:07:32.456 05:03:34 -- accel/accel.sh@21 -- # val= 00:07:32.456 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:07:32.456 05:03:34 -- accel/accel.sh@21 -- # val= 00:07:32.456 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:07:32.456 05:03:34 -- accel/accel.sh@21 -- # val= 00:07:32.456 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:07:32.456 05:03:34 -- accel/accel.sh@21 -- # val= 00:07:32.456 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:07:32.456 05:03:34 -- accel/accel.sh@21 -- # val= 00:07:32.456 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:07:32.456 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:07:32.456 05:03:34 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:32.456 05:03:34 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:32.456 05:03:34 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:32.456 00:07:32.456 real 0m2.819s 00:07:32.456 user 0m9.379s 00:07:32.456 sys 0m0.313s 00:07:32.456 05:03:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:32.456 05:03:34 -- common/autotest_common.sh@10 -- # set +x 00:07:32.456 ************************************ 00:07:32.456 END TEST accel_decomp_mcore 00:07:32.456 ************************************ 00:07:32.716 05:03:34 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:32.716 05:03:34 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:32.716 05:03:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:32.716 05:03:34 -- common/autotest_common.sh@10 -- # set +x 00:07:32.716 ************************************ 00:07:32.716 START TEST accel_decomp_full_mcore 00:07:32.716 ************************************ 00:07:32.716 05:03:34 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:32.716 05:03:34 -- accel/accel.sh@16 -- # local accel_opc 00:07:32.716 05:03:34 -- accel/accel.sh@17 -- # local accel_module 00:07:32.716 05:03:34 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:32.716 05:03:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:32.716 05:03:34 -- accel/accel.sh@12 -- # build_accel_config 00:07:32.716 05:03:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:32.716 05:03:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:32.716 05:03:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:32.716 05:03:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:32.716 05:03:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:32.717 05:03:34 -- accel/accel.sh@41 -- # local IFS=, 00:07:32.717 05:03:34 -- accel/accel.sh@42 -- # jq -r . 00:07:32.717 [2024-11-26 05:03:34.241542] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:32.717 [2024-11-26 05:03:34.241629] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3189215 ] 00:07:32.717 EAL: No free 2048 kB hugepages reported on node 1 00:07:32.717 [2024-11-26 05:03:34.307683] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:32.717 [2024-11-26 05:03:34.400022] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:32.717 [2024-11-26 05:03:34.400090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:32.717 [2024-11-26 05:03:34.400190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:32.717 [2024-11-26 05:03:34.400193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.097 05:03:35 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:34.097 00:07:34.097 SPDK Configuration: 00:07:34.097 Core mask: 0xf 00:07:34.097 00:07:34.097 Accel Perf Configuration: 00:07:34.097 Workload Type: decompress 00:07:34.097 Transfer size: 111250 bytes 00:07:34.097 Vector count 1 00:07:34.097 Module: software 00:07:34.097 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.097 Queue depth: 32 00:07:34.097 Allocate depth: 32 00:07:34.097 # threads/core: 1 00:07:34.097 Run time: 1 seconds 00:07:34.097 Verify: Yes 00:07:34.097 00:07:34.097 Running for 1 seconds... 00:07:34.097 00:07:34.097 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:34.097 ------------------------------------------------------------------------------------ 00:07:34.097 0,0 4256/s 175 MiB/s 0 0 00:07:34.097 3,0 4256/s 175 MiB/s 0 0 00:07:34.097 2,0 4256/s 175 MiB/s 0 0 00:07:34.097 1,0 4256/s 175 MiB/s 0 0 00:07:34.097 ==================================================================================== 00:07:34.097 Total 17024/s 1806 MiB/s 0 0' 00:07:34.097 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.097 05:03:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:34.097 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.097 05:03:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:34.097 05:03:35 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.097 05:03:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:34.097 05:03:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.097 05:03:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.097 05:03:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:34.097 05:03:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:34.097 05:03:35 -- accel/accel.sh@41 -- # local IFS=, 00:07:34.097 05:03:35 -- accel/accel.sh@42 -- # jq -r . 00:07:34.097 [2024-11-26 05:03:35.664364] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:34.097 [2024-11-26 05:03:35.664452] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3189361 ] 00:07:34.097 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.097 [2024-11-26 05:03:35.726586] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:34.097 [2024-11-26 05:03:35.819697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:34.097 [2024-11-26 05:03:35.819755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:34.097 [2024-11-26 05:03:35.819853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:34.097 [2024-11-26 05:03:35.819856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.357 05:03:35 -- accel/accel.sh@21 -- # val= 00:07:34.357 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.357 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.357 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.357 05:03:35 -- accel/accel.sh@21 -- # val= 00:07:34.357 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.357 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.357 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val= 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val=0xf 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val= 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val= 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val=decompress 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val= 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val=software 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@23 -- # accel_module=software 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val=32 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val=32 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val=1 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val=Yes 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val= 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:34.358 05:03:35 -- accel/accel.sh@21 -- # val= 00:07:34.358 05:03:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:07:34.358 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.739 05:03:37 -- accel/accel.sh@21 -- # val= 00:07:35.739 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:07:35.739 05:03:37 -- accel/accel.sh@21 -- # val= 00:07:35.739 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:07:35.739 05:03:37 -- accel/accel.sh@21 -- # val= 00:07:35.739 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:07:35.739 05:03:37 -- accel/accel.sh@21 -- # val= 00:07:35.739 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:07:35.739 05:03:37 -- accel/accel.sh@21 -- # val= 00:07:35.739 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:07:35.739 05:03:37 -- accel/accel.sh@21 -- # val= 00:07:35.739 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:07:35.739 05:03:37 -- accel/accel.sh@21 -- # val= 00:07:35.739 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:07:35.739 05:03:37 -- accel/accel.sh@21 -- # val= 00:07:35.739 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:07:35.739 05:03:37 -- accel/accel.sh@21 -- # val= 00:07:35.739 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:07:35.739 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:07:35.739 05:03:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:35.739 05:03:37 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:35.739 05:03:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:35.739 00:07:35.739 real 0m2.850s 00:07:35.739 user 0m9.499s 00:07:35.739 sys 0m0.295s 00:07:35.739 05:03:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:35.739 05:03:37 -- common/autotest_common.sh@10 -- # set +x 00:07:35.739 ************************************ 00:07:35.739 END TEST accel_decomp_full_mcore 00:07:35.739 ************************************ 00:07:35.739 05:03:37 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:35.739 05:03:37 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:35.739 05:03:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:35.739 05:03:37 -- common/autotest_common.sh@10 -- # set +x 00:07:35.740 ************************************ 00:07:35.740 START TEST accel_decomp_mthread 00:07:35.740 ************************************ 00:07:35.740 05:03:37 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:35.740 05:03:37 -- accel/accel.sh@16 -- # local accel_opc 00:07:35.740 05:03:37 -- accel/accel.sh@17 -- # local accel_module 00:07:35.740 05:03:37 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:35.740 05:03:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:35.740 05:03:37 -- accel/accel.sh@12 -- # build_accel_config 00:07:35.740 05:03:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:35.740 05:03:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:35.740 05:03:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:35.740 05:03:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:35.740 05:03:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:35.740 05:03:37 -- accel/accel.sh@41 -- # local IFS=, 00:07:35.740 05:03:37 -- accel/accel.sh@42 -- # jq -r . 00:07:35.740 [2024-11-26 05:03:37.118109] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:35.740 [2024-11-26 05:03:37.118193] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3189523 ] 00:07:35.740 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.740 [2024-11-26 05:03:37.180698] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:35.740 [2024-11-26 05:03:37.268056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.120 05:03:38 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:37.120 00:07:37.120 SPDK Configuration: 00:07:37.120 Core mask: 0x1 00:07:37.120 00:07:37.120 Accel Perf Configuration: 00:07:37.120 Workload Type: decompress 00:07:37.120 Transfer size: 4096 bytes 00:07:37.120 Vector count 1 00:07:37.120 Module: software 00:07:37.120 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.120 Queue depth: 32 00:07:37.120 Allocate depth: 32 00:07:37.120 # threads/core: 2 00:07:37.120 Run time: 1 seconds 00:07:37.120 Verify: Yes 00:07:37.120 00:07:37.120 Running for 1 seconds... 00:07:37.120 00:07:37.120 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:37.120 ------------------------------------------------------------------------------------ 00:07:37.120 0,1 28096/s 51 MiB/s 0 0 00:07:37.120 0,0 27968/s 51 MiB/s 0 0 00:07:37.120 ==================================================================================== 00:07:37.120 Total 56064/s 219 MiB/s 0 0' 00:07:37.120 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:37.121 05:03:38 -- accel/accel.sh@12 -- # build_accel_config 00:07:37.121 05:03:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:37.121 05:03:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:37.121 05:03:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:37.121 05:03:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:37.121 05:03:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:37.121 05:03:38 -- accel/accel.sh@41 -- # local IFS=, 00:07:37.121 05:03:38 -- accel/accel.sh@42 -- # jq -r . 00:07:37.121 [2024-11-26 05:03:38.519795] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:37.121 [2024-11-26 05:03:38.519879] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3189687 ] 00:07:37.121 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.121 [2024-11-26 05:03:38.581861] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:37.121 [2024-11-26 05:03:38.671123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val= 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val= 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val= 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val=0x1 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val= 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val= 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val=decompress 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val= 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val=software 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@23 -- # accel_module=software 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val=32 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val=32 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val=2 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val=Yes 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val= 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.121 05:03:38 -- accel/accel.sh@21 -- # val= 00:07:37.121 05:03:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.121 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.503 05:03:39 -- accel/accel.sh@21 -- # val= 00:07:38.503 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:07:38.503 05:03:39 -- accel/accel.sh@21 -- # val= 00:07:38.503 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:07:38.503 05:03:39 -- accel/accel.sh@21 -- # val= 00:07:38.503 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:07:38.503 05:03:39 -- accel/accel.sh@21 -- # val= 00:07:38.503 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:07:38.503 05:03:39 -- accel/accel.sh@21 -- # val= 00:07:38.503 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:07:38.503 05:03:39 -- accel/accel.sh@21 -- # val= 00:07:38.503 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:07:38.503 05:03:39 -- accel/accel.sh@21 -- # val= 00:07:38.503 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:07:38.503 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:07:38.503 05:03:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:38.503 05:03:39 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:38.503 05:03:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:38.503 00:07:38.503 real 0m2.818s 00:07:38.503 user 0m2.519s 00:07:38.503 sys 0m0.291s 00:07:38.503 05:03:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:38.503 05:03:39 -- common/autotest_common.sh@10 -- # set +x 00:07:38.503 ************************************ 00:07:38.503 END TEST accel_decomp_mthread 00:07:38.503 ************************************ 00:07:38.503 05:03:39 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:38.503 05:03:39 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:38.503 05:03:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:38.503 05:03:39 -- common/autotest_common.sh@10 -- # set +x 00:07:38.503 ************************************ 00:07:38.503 START TEST accel_deomp_full_mthread 00:07:38.503 ************************************ 00:07:38.503 05:03:39 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:38.503 05:03:39 -- accel/accel.sh@16 -- # local accel_opc 00:07:38.503 05:03:39 -- accel/accel.sh@17 -- # local accel_module 00:07:38.503 05:03:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:38.503 05:03:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:38.503 05:03:39 -- accel/accel.sh@12 -- # build_accel_config 00:07:38.503 05:03:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:38.503 05:03:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:38.503 05:03:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:38.503 05:03:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:38.503 05:03:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:38.503 05:03:39 -- accel/accel.sh@41 -- # local IFS=, 00:07:38.503 05:03:39 -- accel/accel.sh@42 -- # jq -r . 00:07:38.503 [2024-11-26 05:03:39.962218] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:38.503 [2024-11-26 05:03:39.962310] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3189946 ] 00:07:38.503 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.503 [2024-11-26 05:03:40.028958] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:38.503 [2024-11-26 05:03:40.123056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:39.885 05:03:41 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:39.885 00:07:39.885 SPDK Configuration: 00:07:39.885 Core mask: 0x1 00:07:39.885 00:07:39.885 Accel Perf Configuration: 00:07:39.885 Workload Type: decompress 00:07:39.885 Transfer size: 111250 bytes 00:07:39.885 Vector count 1 00:07:39.885 Module: software 00:07:39.885 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:39.885 Queue depth: 32 00:07:39.885 Allocate depth: 32 00:07:39.885 # threads/core: 2 00:07:39.885 Run time: 1 seconds 00:07:39.885 Verify: Yes 00:07:39.885 00:07:39.885 Running for 1 seconds... 00:07:39.885 00:07:39.885 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:39.885 ------------------------------------------------------------------------------------ 00:07:39.885 0,1 1952/s 80 MiB/s 0 0 00:07:39.885 0,0 1920/s 79 MiB/s 0 0 00:07:39.885 ==================================================================================== 00:07:39.885 Total 3872/s 410 MiB/s 0 0' 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.885 05:03:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.885 05:03:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:39.885 05:03:41 -- accel/accel.sh@12 -- # build_accel_config 00:07:39.885 05:03:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:39.885 05:03:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:39.885 05:03:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:39.885 05:03:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:39.885 05:03:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:39.885 05:03:41 -- accel/accel.sh@41 -- # local IFS=, 00:07:39.885 05:03:41 -- accel/accel.sh@42 -- # jq -r . 00:07:39.885 [2024-11-26 05:03:41.411529] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:39.885 [2024-11-26 05:03:41.411619] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3190091 ] 00:07:39.885 EAL: No free 2048 kB hugepages reported on node 1 00:07:39.885 [2024-11-26 05:03:41.473513] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:39.885 [2024-11-26 05:03:41.563673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:39.885 05:03:41 -- accel/accel.sh@21 -- # val= 00:07:39.885 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.885 05:03:41 -- accel/accel.sh@21 -- # val= 00:07:39.885 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.885 05:03:41 -- accel/accel.sh@21 -- # val= 00:07:39.885 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.885 05:03:41 -- accel/accel.sh@21 -- # val=0x1 00:07:39.885 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.885 05:03:41 -- accel/accel.sh@21 -- # val= 00:07:39.885 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.885 05:03:41 -- accel/accel.sh@21 -- # val= 00:07:39.885 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.885 05:03:41 -- accel/accel.sh@21 -- # val=decompress 00:07:39.885 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.885 05:03:41 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:39.885 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.886 05:03:41 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:39.886 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.886 05:03:41 -- accel/accel.sh@21 -- # val= 00:07:39.886 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.886 05:03:41 -- accel/accel.sh@21 -- # val=software 00:07:39.886 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.886 05:03:41 -- accel/accel.sh@23 -- # accel_module=software 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.886 05:03:41 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:39.886 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.886 05:03:41 -- accel/accel.sh@21 -- # val=32 00:07:39.886 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.886 05:03:41 -- accel/accel.sh@21 -- # val=32 00:07:39.886 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.886 05:03:41 -- accel/accel.sh@21 -- # val=2 00:07:39.886 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.886 05:03:41 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:39.886 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.886 05:03:41 -- accel/accel.sh@21 -- # val=Yes 00:07:39.886 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.886 05:03:41 -- accel/accel.sh@21 -- # val= 00:07:39.886 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:39.886 05:03:41 -- accel/accel.sh@21 -- # val= 00:07:39.886 05:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:07:39.886 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.265 05:03:42 -- accel/accel.sh@21 -- # val= 00:07:41.265 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:07:41.265 05:03:42 -- accel/accel.sh@21 -- # val= 00:07:41.265 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:07:41.265 05:03:42 -- accel/accel.sh@21 -- # val= 00:07:41.265 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:07:41.265 05:03:42 -- accel/accel.sh@21 -- # val= 00:07:41.265 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:07:41.265 05:03:42 -- accel/accel.sh@21 -- # val= 00:07:41.265 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:07:41.265 05:03:42 -- accel/accel.sh@21 -- # val= 00:07:41.265 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:07:41.265 05:03:42 -- accel/accel.sh@21 -- # val= 00:07:41.265 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:07:41.265 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:07:41.265 05:03:42 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:41.265 05:03:42 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:41.265 05:03:42 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:41.265 00:07:41.265 real 0m2.895s 00:07:41.265 user 0m2.583s 00:07:41.265 sys 0m0.304s 00:07:41.265 05:03:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:41.265 05:03:42 -- common/autotest_common.sh@10 -- # set +x 00:07:41.265 ************************************ 00:07:41.265 END TEST accel_deomp_full_mthread 00:07:41.265 ************************************ 00:07:41.265 05:03:42 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:41.265 05:03:42 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:41.265 05:03:42 -- accel/accel.sh@129 -- # build_accel_config 00:07:41.265 05:03:42 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:41.265 05:03:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:41.265 05:03:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.265 05:03:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.265 05:03:42 -- common/autotest_common.sh@10 -- # set +x 00:07:41.265 05:03:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.265 05:03:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:41.265 05:03:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:41.265 05:03:42 -- accel/accel.sh@41 -- # local IFS=, 00:07:41.265 05:03:42 -- accel/accel.sh@42 -- # jq -r . 00:07:41.265 ************************************ 00:07:41.265 START TEST accel_dif_functional_tests 00:07:41.265 ************************************ 00:07:41.265 05:03:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:41.265 [2024-11-26 05:03:42.904388] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:41.265 [2024-11-26 05:03:42.904485] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3190245 ] 00:07:41.265 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.265 [2024-11-26 05:03:42.972731] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:41.525 [2024-11-26 05:03:43.064238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:41.525 [2024-11-26 05:03:43.064311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:41.525 [2024-11-26 05:03:43.064314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:41.525 00:07:41.525 00:07:41.525 CUnit - A unit testing framework for C - Version 2.1-3 00:07:41.525 http://cunit.sourceforge.net/ 00:07:41.525 00:07:41.525 00:07:41.525 Suite: accel_dif 00:07:41.525 Test: verify: DIF generated, GUARD check ...passed 00:07:41.525 Test: verify: DIF generated, APPTAG check ...passed 00:07:41.525 Test: verify: DIF generated, REFTAG check ...passed 00:07:41.525 Test: verify: DIF not generated, GUARD check ...[2024-11-26 05:03:43.151774] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:41.525 [2024-11-26 05:03:43.151855] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:41.525 passed 00:07:41.525 Test: verify: DIF not generated, APPTAG check ...[2024-11-26 05:03:43.151893] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:41.525 [2024-11-26 05:03:43.151921] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:41.525 passed 00:07:41.525 Test: verify: DIF not generated, REFTAG check ...[2024-11-26 05:03:43.151952] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:41.525 [2024-11-26 05:03:43.151991] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:41.525 passed 00:07:41.525 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:41.525 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-26 05:03:43.152052] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:41.525 passed 00:07:41.525 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:41.525 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:41.525 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:41.525 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-26 05:03:43.152184] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:41.525 passed 00:07:41.525 Test: generate copy: DIF generated, GUARD check ...passed 00:07:41.525 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:41.525 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:41.525 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:41.525 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:41.525 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:41.525 Test: generate copy: iovecs-len validate ...[2024-11-26 05:03:43.152400] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:41.525 passed 00:07:41.525 Test: generate copy: buffer alignment validate ...passed 00:07:41.525 00:07:41.525 Run Summary: Type Total Ran Passed Failed Inactive 00:07:41.525 suites 1 1 n/a 0 0 00:07:41.525 tests 20 20 20 0 0 00:07:41.525 asserts 204 204 204 0 n/a 00:07:41.525 00:07:41.525 Elapsed time = 0.002 seconds 00:07:41.784 00:07:41.784 real 0m0.503s 00:07:41.784 user 0m0.767s 00:07:41.784 sys 0m0.185s 00:07:41.784 05:03:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:41.784 05:03:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.784 ************************************ 00:07:41.784 END TEST accel_dif_functional_tests 00:07:41.784 ************************************ 00:07:41.784 00:07:41.784 real 0m59.965s 00:07:41.784 user 1m7.632s 00:07:41.784 sys 0m7.296s 00:07:41.784 05:03:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:41.784 05:03:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.784 ************************************ 00:07:41.784 END TEST accel 00:07:41.784 ************************************ 00:07:41.784 05:03:43 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:41.784 05:03:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:41.784 05:03:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.784 05:03:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.784 ************************************ 00:07:41.784 START TEST accel_rpc 00:07:41.784 ************************************ 00:07:41.784 05:03:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:41.784 * Looking for test storage... 00:07:41.784 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:41.784 05:03:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:41.784 05:03:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:41.784 05:03:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:41.784 05:03:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:41.784 05:03:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:41.784 05:03:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:41.784 05:03:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:41.784 05:03:43 -- scripts/common.sh@335 -- # IFS=.-: 00:07:41.784 05:03:43 -- scripts/common.sh@335 -- # read -ra ver1 00:07:41.784 05:03:43 -- scripts/common.sh@336 -- # IFS=.-: 00:07:41.784 05:03:43 -- scripts/common.sh@336 -- # read -ra ver2 00:07:41.784 05:03:43 -- scripts/common.sh@337 -- # local 'op=<' 00:07:41.784 05:03:43 -- scripts/common.sh@339 -- # ver1_l=2 00:07:41.784 05:03:43 -- scripts/common.sh@340 -- # ver2_l=1 00:07:41.784 05:03:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:41.784 05:03:43 -- scripts/common.sh@343 -- # case "$op" in 00:07:41.784 05:03:43 -- scripts/common.sh@344 -- # : 1 00:07:41.784 05:03:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:41.784 05:03:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:41.784 05:03:43 -- scripts/common.sh@364 -- # decimal 1 00:07:42.045 05:03:43 -- scripts/common.sh@352 -- # local d=1 00:07:42.045 05:03:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:42.045 05:03:43 -- scripts/common.sh@354 -- # echo 1 00:07:42.045 05:03:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:42.045 05:03:43 -- scripts/common.sh@365 -- # decimal 2 00:07:42.045 05:03:43 -- scripts/common.sh@352 -- # local d=2 00:07:42.045 05:03:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:42.045 05:03:43 -- scripts/common.sh@354 -- # echo 2 00:07:42.045 05:03:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:42.045 05:03:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:42.045 05:03:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:42.045 05:03:43 -- scripts/common.sh@367 -- # return 0 00:07:42.045 05:03:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:42.045 05:03:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:42.045 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:42.045 --rc genhtml_branch_coverage=1 00:07:42.045 --rc genhtml_function_coverage=1 00:07:42.045 --rc genhtml_legend=1 00:07:42.045 --rc geninfo_all_blocks=1 00:07:42.045 --rc geninfo_unexecuted_blocks=1 00:07:42.045 00:07:42.045 ' 00:07:42.045 05:03:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:42.045 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:42.045 --rc genhtml_branch_coverage=1 00:07:42.045 --rc genhtml_function_coverage=1 00:07:42.045 --rc genhtml_legend=1 00:07:42.045 --rc geninfo_all_blocks=1 00:07:42.045 --rc geninfo_unexecuted_blocks=1 00:07:42.045 00:07:42.045 ' 00:07:42.045 05:03:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:42.045 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:42.045 --rc genhtml_branch_coverage=1 00:07:42.045 --rc genhtml_function_coverage=1 00:07:42.045 --rc genhtml_legend=1 00:07:42.045 --rc geninfo_all_blocks=1 00:07:42.046 --rc geninfo_unexecuted_blocks=1 00:07:42.046 00:07:42.046 ' 00:07:42.046 05:03:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:42.046 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:42.046 --rc genhtml_branch_coverage=1 00:07:42.046 --rc genhtml_function_coverage=1 00:07:42.046 --rc genhtml_legend=1 00:07:42.046 --rc geninfo_all_blocks=1 00:07:42.046 --rc geninfo_unexecuted_blocks=1 00:07:42.046 00:07:42.046 ' 00:07:42.046 05:03:43 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:42.046 05:03:43 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3190448 00:07:42.046 05:03:43 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:42.046 05:03:43 -- accel/accel_rpc.sh@15 -- # waitforlisten 3190448 00:07:42.046 05:03:43 -- common/autotest_common.sh@829 -- # '[' -z 3190448 ']' 00:07:42.046 05:03:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:42.046 05:03:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:42.046 05:03:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:42.046 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:42.046 05:03:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:42.046 05:03:43 -- common/autotest_common.sh@10 -- # set +x 00:07:42.046 [2024-11-26 05:03:43.603095] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:42.046 [2024-11-26 05:03:43.603201] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3190448 ] 00:07:42.046 EAL: No free 2048 kB hugepages reported on node 1 00:07:42.046 [2024-11-26 05:03:43.665205] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:42.046 [2024-11-26 05:03:43.752672] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:42.046 [2024-11-26 05:03:43.752876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:42.046 05:03:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:42.046 05:03:43 -- common/autotest_common.sh@862 -- # return 0 00:07:42.046 05:03:43 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:42.046 05:03:43 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:42.046 05:03:43 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:42.046 05:03:43 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:42.046 05:03:43 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:42.046 05:03:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:42.046 05:03:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:42.046 05:03:43 -- common/autotest_common.sh@10 -- # set +x 00:07:42.046 ************************************ 00:07:42.046 START TEST accel_assign_opcode 00:07:42.046 ************************************ 00:07:42.046 05:03:43 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:07:42.046 05:03:43 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:42.046 05:03:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.046 05:03:43 -- common/autotest_common.sh@10 -- # set +x 00:07:42.046 [2024-11-26 05:03:43.809418] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:42.305 05:03:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.305 05:03:43 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:42.305 05:03:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.305 05:03:43 -- common/autotest_common.sh@10 -- # set +x 00:07:42.305 [2024-11-26 05:03:43.817433] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:42.305 05:03:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.305 05:03:43 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:42.305 05:03:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.305 05:03:43 -- common/autotest_common.sh@10 -- # set +x 00:07:42.305 05:03:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.305 05:03:44 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:42.305 05:03:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.305 05:03:44 -- common/autotest_common.sh@10 -- # set +x 00:07:42.305 05:03:44 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:42.305 05:03:44 -- accel/accel_rpc.sh@42 -- # grep software 00:07:42.565 05:03:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.565 software 00:07:42.565 00:07:42.565 real 0m0.295s 00:07:42.565 user 0m0.041s 00:07:42.565 sys 0m0.006s 00:07:42.565 05:03:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:42.565 05:03:44 -- common/autotest_common.sh@10 -- # set +x 00:07:42.565 ************************************ 00:07:42.565 END TEST accel_assign_opcode 00:07:42.565 ************************************ 00:07:42.565 05:03:44 -- accel/accel_rpc.sh@55 -- # killprocess 3190448 00:07:42.565 05:03:44 -- common/autotest_common.sh@936 -- # '[' -z 3190448 ']' 00:07:42.565 05:03:44 -- common/autotest_common.sh@940 -- # kill -0 3190448 00:07:42.565 05:03:44 -- common/autotest_common.sh@941 -- # uname 00:07:42.565 05:03:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:42.565 05:03:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3190448 00:07:42.565 05:03:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:42.565 05:03:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:42.565 05:03:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3190448' 00:07:42.565 killing process with pid 3190448 00:07:42.565 05:03:44 -- common/autotest_common.sh@955 -- # kill 3190448 00:07:42.565 05:03:44 -- common/autotest_common.sh@960 -- # wait 3190448 00:07:42.824 00:07:42.824 real 0m1.141s 00:07:42.824 user 0m1.042s 00:07:42.824 sys 0m0.446s 00:07:42.824 05:03:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:42.824 05:03:44 -- common/autotest_common.sh@10 -- # set +x 00:07:42.824 ************************************ 00:07:42.824 END TEST accel_rpc 00:07:42.824 ************************************ 00:07:42.824 05:03:44 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:42.824 05:03:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:42.824 05:03:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:42.824 05:03:44 -- common/autotest_common.sh@10 -- # set +x 00:07:42.824 ************************************ 00:07:42.824 START TEST app_cmdline 00:07:42.824 ************************************ 00:07:42.824 05:03:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:43.083 * Looking for test storage... 00:07:43.083 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:43.083 05:03:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:43.083 05:03:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:43.083 05:03:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:43.083 05:03:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:43.083 05:03:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:43.083 05:03:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:43.083 05:03:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:43.083 05:03:44 -- scripts/common.sh@335 -- # IFS=.-: 00:07:43.083 05:03:44 -- scripts/common.sh@335 -- # read -ra ver1 00:07:43.083 05:03:44 -- scripts/common.sh@336 -- # IFS=.-: 00:07:43.083 05:03:44 -- scripts/common.sh@336 -- # read -ra ver2 00:07:43.083 05:03:44 -- scripts/common.sh@337 -- # local 'op=<' 00:07:43.083 05:03:44 -- scripts/common.sh@339 -- # ver1_l=2 00:07:43.083 05:03:44 -- scripts/common.sh@340 -- # ver2_l=1 00:07:43.083 05:03:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:43.083 05:03:44 -- scripts/common.sh@343 -- # case "$op" in 00:07:43.083 05:03:44 -- scripts/common.sh@344 -- # : 1 00:07:43.083 05:03:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:43.083 05:03:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:43.083 05:03:44 -- scripts/common.sh@364 -- # decimal 1 00:07:43.083 05:03:44 -- scripts/common.sh@352 -- # local d=1 00:07:43.083 05:03:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:43.083 05:03:44 -- scripts/common.sh@354 -- # echo 1 00:07:43.083 05:03:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:43.083 05:03:44 -- scripts/common.sh@365 -- # decimal 2 00:07:43.083 05:03:44 -- scripts/common.sh@352 -- # local d=2 00:07:43.083 05:03:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:43.083 05:03:44 -- scripts/common.sh@354 -- # echo 2 00:07:43.083 05:03:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:43.083 05:03:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:43.083 05:03:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:43.083 05:03:44 -- scripts/common.sh@367 -- # return 0 00:07:43.083 05:03:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:43.083 05:03:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:43.083 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:43.083 --rc genhtml_branch_coverage=1 00:07:43.083 --rc genhtml_function_coverage=1 00:07:43.083 --rc genhtml_legend=1 00:07:43.083 --rc geninfo_all_blocks=1 00:07:43.083 --rc geninfo_unexecuted_blocks=1 00:07:43.083 00:07:43.083 ' 00:07:43.083 05:03:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:43.083 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:43.083 --rc genhtml_branch_coverage=1 00:07:43.083 --rc genhtml_function_coverage=1 00:07:43.083 --rc genhtml_legend=1 00:07:43.083 --rc geninfo_all_blocks=1 00:07:43.083 --rc geninfo_unexecuted_blocks=1 00:07:43.083 00:07:43.083 ' 00:07:43.083 05:03:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:43.083 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:43.083 --rc genhtml_branch_coverage=1 00:07:43.083 --rc genhtml_function_coverage=1 00:07:43.083 --rc genhtml_legend=1 00:07:43.083 --rc geninfo_all_blocks=1 00:07:43.083 --rc geninfo_unexecuted_blocks=1 00:07:43.083 00:07:43.083 ' 00:07:43.083 05:03:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:43.083 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:43.083 --rc genhtml_branch_coverage=1 00:07:43.083 --rc genhtml_function_coverage=1 00:07:43.083 --rc genhtml_legend=1 00:07:43.083 --rc geninfo_all_blocks=1 00:07:43.083 --rc geninfo_unexecuted_blocks=1 00:07:43.083 00:07:43.083 ' 00:07:43.083 05:03:44 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:43.083 05:03:44 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3190659 00:07:43.083 05:03:44 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:43.083 05:03:44 -- app/cmdline.sh@18 -- # waitforlisten 3190659 00:07:43.083 05:03:44 -- common/autotest_common.sh@829 -- # '[' -z 3190659 ']' 00:07:43.083 05:03:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:43.083 05:03:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:43.083 05:03:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:43.084 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:43.084 05:03:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:43.084 05:03:44 -- common/autotest_common.sh@10 -- # set +x 00:07:43.084 [2024-11-26 05:03:44.762372] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:43.084 [2024-11-26 05:03:44.762460] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3190659 ] 00:07:43.084 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.084 [2024-11-26 05:03:44.819636] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:43.344 [2024-11-26 05:03:44.904482] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:43.344 [2024-11-26 05:03:44.904669] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:44.282 05:03:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:44.282 05:03:45 -- common/autotest_common.sh@862 -- # return 0 00:07:44.282 05:03:45 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:44.282 { 00:07:44.282 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:07:44.282 "fields": { 00:07:44.282 "major": 24, 00:07:44.282 "minor": 1, 00:07:44.282 "patch": 1, 00:07:44.282 "suffix": "-pre", 00:07:44.282 "commit": "c13c99a5e" 00:07:44.282 } 00:07:44.282 } 00:07:44.282 05:03:45 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:44.282 05:03:45 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:44.282 05:03:45 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:44.282 05:03:45 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:44.282 05:03:45 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:44.282 05:03:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.282 05:03:45 -- common/autotest_common.sh@10 -- # set +x 00:07:44.282 05:03:45 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:44.282 05:03:45 -- app/cmdline.sh@26 -- # sort 00:07:44.282 05:03:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.282 05:03:45 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:44.282 05:03:45 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:44.282 05:03:45 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:44.282 05:03:45 -- common/autotest_common.sh@650 -- # local es=0 00:07:44.282 05:03:45 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:44.282 05:03:45 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:44.282 05:03:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:44.282 05:03:45 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:44.282 05:03:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:44.282 05:03:45 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:44.282 05:03:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:44.282 05:03:45 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:44.282 05:03:45 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:44.282 05:03:45 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:44.542 request: 00:07:44.542 { 00:07:44.542 "method": "env_dpdk_get_mem_stats", 00:07:44.542 "req_id": 1 00:07:44.542 } 00:07:44.542 Got JSON-RPC error response 00:07:44.542 response: 00:07:44.542 { 00:07:44.542 "code": -32601, 00:07:44.542 "message": "Method not found" 00:07:44.542 } 00:07:44.542 05:03:46 -- common/autotest_common.sh@653 -- # es=1 00:07:44.542 05:03:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:44.542 05:03:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:44.542 05:03:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:44.542 05:03:46 -- app/cmdline.sh@1 -- # killprocess 3190659 00:07:44.542 05:03:46 -- common/autotest_common.sh@936 -- # '[' -z 3190659 ']' 00:07:44.542 05:03:46 -- common/autotest_common.sh@940 -- # kill -0 3190659 00:07:44.542 05:03:46 -- common/autotest_common.sh@941 -- # uname 00:07:44.542 05:03:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:44.542 05:03:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3190659 00:07:44.542 05:03:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:44.542 05:03:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:44.542 05:03:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3190659' 00:07:44.542 killing process with pid 3190659 00:07:44.542 05:03:46 -- common/autotest_common.sh@955 -- # kill 3190659 00:07:44.542 05:03:46 -- common/autotest_common.sh@960 -- # wait 3190659 00:07:45.109 00:07:45.109 real 0m2.095s 00:07:45.109 user 0m2.628s 00:07:45.109 sys 0m0.500s 00:07:45.109 05:03:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:45.109 05:03:46 -- common/autotest_common.sh@10 -- # set +x 00:07:45.109 ************************************ 00:07:45.109 END TEST app_cmdline 00:07:45.109 ************************************ 00:07:45.109 05:03:46 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:45.109 05:03:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:45.109 05:03:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:45.109 05:03:46 -- common/autotest_common.sh@10 -- # set +x 00:07:45.109 ************************************ 00:07:45.109 START TEST version 00:07:45.109 ************************************ 00:07:45.109 05:03:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:45.109 * Looking for test storage... 00:07:45.109 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:45.109 05:03:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:45.109 05:03:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:45.109 05:03:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:45.109 05:03:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:45.109 05:03:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:45.109 05:03:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:45.109 05:03:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:45.109 05:03:46 -- scripts/common.sh@335 -- # IFS=.-: 00:07:45.109 05:03:46 -- scripts/common.sh@335 -- # read -ra ver1 00:07:45.109 05:03:46 -- scripts/common.sh@336 -- # IFS=.-: 00:07:45.109 05:03:46 -- scripts/common.sh@336 -- # read -ra ver2 00:07:45.109 05:03:46 -- scripts/common.sh@337 -- # local 'op=<' 00:07:45.109 05:03:46 -- scripts/common.sh@339 -- # ver1_l=2 00:07:45.109 05:03:46 -- scripts/common.sh@340 -- # ver2_l=1 00:07:45.109 05:03:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:45.109 05:03:46 -- scripts/common.sh@343 -- # case "$op" in 00:07:45.109 05:03:46 -- scripts/common.sh@344 -- # : 1 00:07:45.109 05:03:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:45.109 05:03:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:45.109 05:03:46 -- scripts/common.sh@364 -- # decimal 1 00:07:45.109 05:03:46 -- scripts/common.sh@352 -- # local d=1 00:07:45.109 05:03:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:45.109 05:03:46 -- scripts/common.sh@354 -- # echo 1 00:07:45.109 05:03:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:45.109 05:03:46 -- scripts/common.sh@365 -- # decimal 2 00:07:45.109 05:03:46 -- scripts/common.sh@352 -- # local d=2 00:07:45.109 05:03:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:45.109 05:03:46 -- scripts/common.sh@354 -- # echo 2 00:07:45.109 05:03:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:45.109 05:03:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:45.109 05:03:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:45.109 05:03:46 -- scripts/common.sh@367 -- # return 0 00:07:45.109 05:03:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:45.109 05:03:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:45.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.109 --rc genhtml_branch_coverage=1 00:07:45.109 --rc genhtml_function_coverage=1 00:07:45.109 --rc genhtml_legend=1 00:07:45.109 --rc geninfo_all_blocks=1 00:07:45.109 --rc geninfo_unexecuted_blocks=1 00:07:45.109 00:07:45.109 ' 00:07:45.109 05:03:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:45.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.109 --rc genhtml_branch_coverage=1 00:07:45.109 --rc genhtml_function_coverage=1 00:07:45.109 --rc genhtml_legend=1 00:07:45.109 --rc geninfo_all_blocks=1 00:07:45.109 --rc geninfo_unexecuted_blocks=1 00:07:45.109 00:07:45.109 ' 00:07:45.109 05:03:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:45.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.110 --rc genhtml_branch_coverage=1 00:07:45.110 --rc genhtml_function_coverage=1 00:07:45.110 --rc genhtml_legend=1 00:07:45.110 --rc geninfo_all_blocks=1 00:07:45.110 --rc geninfo_unexecuted_blocks=1 00:07:45.110 00:07:45.110 ' 00:07:45.110 05:03:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:45.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.110 --rc genhtml_branch_coverage=1 00:07:45.110 --rc genhtml_function_coverage=1 00:07:45.110 --rc genhtml_legend=1 00:07:45.110 --rc geninfo_all_blocks=1 00:07:45.110 --rc geninfo_unexecuted_blocks=1 00:07:45.110 00:07:45.110 ' 00:07:45.110 05:03:46 -- app/version.sh@17 -- # get_header_version major 00:07:45.110 05:03:46 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:45.110 05:03:46 -- app/version.sh@14 -- # cut -f2 00:07:45.110 05:03:46 -- app/version.sh@14 -- # tr -d '"' 00:07:45.110 05:03:46 -- app/version.sh@17 -- # major=24 00:07:45.110 05:03:46 -- app/version.sh@18 -- # get_header_version minor 00:07:45.110 05:03:46 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:45.110 05:03:46 -- app/version.sh@14 -- # cut -f2 00:07:45.110 05:03:46 -- app/version.sh@14 -- # tr -d '"' 00:07:45.110 05:03:46 -- app/version.sh@18 -- # minor=1 00:07:45.110 05:03:46 -- app/version.sh@19 -- # get_header_version patch 00:07:45.110 05:03:46 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:45.110 05:03:46 -- app/version.sh@14 -- # cut -f2 00:07:45.110 05:03:46 -- app/version.sh@14 -- # tr -d '"' 00:07:45.110 05:03:46 -- app/version.sh@19 -- # patch=1 00:07:45.110 05:03:46 -- app/version.sh@20 -- # get_header_version suffix 00:07:45.110 05:03:46 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:45.110 05:03:46 -- app/version.sh@14 -- # cut -f2 00:07:45.110 05:03:46 -- app/version.sh@14 -- # tr -d '"' 00:07:45.110 05:03:46 -- app/version.sh@20 -- # suffix=-pre 00:07:45.110 05:03:46 -- app/version.sh@22 -- # version=24.1 00:07:45.110 05:03:46 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:45.110 05:03:46 -- app/version.sh@25 -- # version=24.1.1 00:07:45.110 05:03:46 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:45.110 05:03:46 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:45.110 05:03:46 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:45.369 05:03:46 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:45.369 05:03:46 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:45.369 00:07:45.369 real 0m0.192s 00:07:45.369 user 0m0.132s 00:07:45.369 sys 0m0.085s 00:07:45.369 05:03:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:45.369 05:03:46 -- common/autotest_common.sh@10 -- # set +x 00:07:45.369 ************************************ 00:07:45.369 END TEST version 00:07:45.369 ************************************ 00:07:45.369 05:03:46 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:07:45.369 05:03:46 -- spdk/autotest.sh@191 -- # uname -s 00:07:45.369 05:03:46 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:07:45.369 05:03:46 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:45.369 05:03:46 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:45.369 05:03:46 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:07:45.369 05:03:46 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:07:45.369 05:03:46 -- spdk/autotest.sh@255 -- # timing_exit lib 00:07:45.369 05:03:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:45.369 05:03:46 -- common/autotest_common.sh@10 -- # set +x 00:07:45.369 05:03:46 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:07:45.369 05:03:46 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:07:45.369 05:03:46 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:07:45.369 05:03:46 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:07:45.369 05:03:46 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:07:45.369 05:03:46 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:07:45.369 05:03:46 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:45.369 05:03:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:45.369 05:03:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:45.369 05:03:46 -- common/autotest_common.sh@10 -- # set +x 00:07:45.369 ************************************ 00:07:45.369 START TEST nvmf_tcp 00:07:45.369 ************************************ 00:07:45.369 05:03:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:45.369 * Looking for test storage... 00:07:45.369 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:45.369 05:03:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:45.369 05:03:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:45.369 05:03:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:45.369 05:03:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:45.369 05:03:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:45.369 05:03:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:45.369 05:03:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:45.369 05:03:47 -- scripts/common.sh@335 -- # IFS=.-: 00:07:45.369 05:03:47 -- scripts/common.sh@335 -- # read -ra ver1 00:07:45.369 05:03:47 -- scripts/common.sh@336 -- # IFS=.-: 00:07:45.369 05:03:47 -- scripts/common.sh@336 -- # read -ra ver2 00:07:45.369 05:03:47 -- scripts/common.sh@337 -- # local 'op=<' 00:07:45.369 05:03:47 -- scripts/common.sh@339 -- # ver1_l=2 00:07:45.369 05:03:47 -- scripts/common.sh@340 -- # ver2_l=1 00:07:45.369 05:03:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:45.369 05:03:47 -- scripts/common.sh@343 -- # case "$op" in 00:07:45.369 05:03:47 -- scripts/common.sh@344 -- # : 1 00:07:45.369 05:03:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:45.369 05:03:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:45.369 05:03:47 -- scripts/common.sh@364 -- # decimal 1 00:07:45.369 05:03:47 -- scripts/common.sh@352 -- # local d=1 00:07:45.369 05:03:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:45.369 05:03:47 -- scripts/common.sh@354 -- # echo 1 00:07:45.369 05:03:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:45.369 05:03:47 -- scripts/common.sh@365 -- # decimal 2 00:07:45.369 05:03:47 -- scripts/common.sh@352 -- # local d=2 00:07:45.369 05:03:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:45.369 05:03:47 -- scripts/common.sh@354 -- # echo 2 00:07:45.369 05:03:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:45.369 05:03:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:45.369 05:03:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:45.369 05:03:47 -- scripts/common.sh@367 -- # return 0 00:07:45.369 05:03:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:45.369 05:03:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:45.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.369 --rc genhtml_branch_coverage=1 00:07:45.369 --rc genhtml_function_coverage=1 00:07:45.369 --rc genhtml_legend=1 00:07:45.369 --rc geninfo_all_blocks=1 00:07:45.369 --rc geninfo_unexecuted_blocks=1 00:07:45.369 00:07:45.369 ' 00:07:45.369 05:03:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:45.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.369 --rc genhtml_branch_coverage=1 00:07:45.369 --rc genhtml_function_coverage=1 00:07:45.369 --rc genhtml_legend=1 00:07:45.369 --rc geninfo_all_blocks=1 00:07:45.369 --rc geninfo_unexecuted_blocks=1 00:07:45.369 00:07:45.369 ' 00:07:45.369 05:03:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:45.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.369 --rc genhtml_branch_coverage=1 00:07:45.369 --rc genhtml_function_coverage=1 00:07:45.369 --rc genhtml_legend=1 00:07:45.369 --rc geninfo_all_blocks=1 00:07:45.369 --rc geninfo_unexecuted_blocks=1 00:07:45.369 00:07:45.369 ' 00:07:45.369 05:03:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:45.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.369 --rc genhtml_branch_coverage=1 00:07:45.369 --rc genhtml_function_coverage=1 00:07:45.369 --rc genhtml_legend=1 00:07:45.369 --rc geninfo_all_blocks=1 00:07:45.369 --rc geninfo_unexecuted_blocks=1 00:07:45.369 00:07:45.369 ' 00:07:45.369 05:03:47 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:45.369 05:03:47 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:45.369 05:03:47 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:45.369 05:03:47 -- nvmf/common.sh@7 -- # uname -s 00:07:45.369 05:03:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:45.369 05:03:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:45.369 05:03:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:45.369 05:03:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:45.369 05:03:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:45.369 05:03:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:45.369 05:03:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:45.370 05:03:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:45.370 05:03:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:45.370 05:03:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:45.370 05:03:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:45.370 05:03:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:45.370 05:03:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:45.370 05:03:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:45.370 05:03:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:45.370 05:03:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:45.370 05:03:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:45.370 05:03:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:45.370 05:03:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:45.370 05:03:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.370 05:03:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.370 05:03:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.370 05:03:47 -- paths/export.sh@5 -- # export PATH 00:07:45.370 05:03:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.370 05:03:47 -- nvmf/common.sh@46 -- # : 0 00:07:45.370 05:03:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:45.370 05:03:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:45.370 05:03:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:45.370 05:03:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:45.370 05:03:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:45.370 05:03:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:45.370 05:03:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:45.370 05:03:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:45.370 05:03:47 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:45.370 05:03:47 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:45.370 05:03:47 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:45.370 05:03:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:45.370 05:03:47 -- common/autotest_common.sh@10 -- # set +x 00:07:45.370 05:03:47 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:45.370 05:03:47 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:45.370 05:03:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:45.370 05:03:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:45.370 05:03:47 -- common/autotest_common.sh@10 -- # set +x 00:07:45.370 ************************************ 00:07:45.370 START TEST nvmf_example 00:07:45.370 ************************************ 00:07:45.370 05:03:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:45.630 * Looking for test storage... 00:07:45.630 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:45.630 05:03:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:45.630 05:03:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:45.630 05:03:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:45.630 05:03:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:45.630 05:03:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:45.630 05:03:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:45.630 05:03:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:45.630 05:03:47 -- scripts/common.sh@335 -- # IFS=.-: 00:07:45.630 05:03:47 -- scripts/common.sh@335 -- # read -ra ver1 00:07:45.630 05:03:47 -- scripts/common.sh@336 -- # IFS=.-: 00:07:45.630 05:03:47 -- scripts/common.sh@336 -- # read -ra ver2 00:07:45.630 05:03:47 -- scripts/common.sh@337 -- # local 'op=<' 00:07:45.630 05:03:47 -- scripts/common.sh@339 -- # ver1_l=2 00:07:45.630 05:03:47 -- scripts/common.sh@340 -- # ver2_l=1 00:07:45.630 05:03:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:45.630 05:03:47 -- scripts/common.sh@343 -- # case "$op" in 00:07:45.630 05:03:47 -- scripts/common.sh@344 -- # : 1 00:07:45.630 05:03:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:45.630 05:03:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:45.630 05:03:47 -- scripts/common.sh@364 -- # decimal 1 00:07:45.630 05:03:47 -- scripts/common.sh@352 -- # local d=1 00:07:45.630 05:03:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:45.630 05:03:47 -- scripts/common.sh@354 -- # echo 1 00:07:45.630 05:03:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:45.630 05:03:47 -- scripts/common.sh@365 -- # decimal 2 00:07:45.630 05:03:47 -- scripts/common.sh@352 -- # local d=2 00:07:45.630 05:03:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:45.630 05:03:47 -- scripts/common.sh@354 -- # echo 2 00:07:45.630 05:03:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:45.630 05:03:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:45.630 05:03:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:45.630 05:03:47 -- scripts/common.sh@367 -- # return 0 00:07:45.630 05:03:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:45.630 05:03:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:45.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.630 --rc genhtml_branch_coverage=1 00:07:45.630 --rc genhtml_function_coverage=1 00:07:45.630 --rc genhtml_legend=1 00:07:45.630 --rc geninfo_all_blocks=1 00:07:45.630 --rc geninfo_unexecuted_blocks=1 00:07:45.630 00:07:45.630 ' 00:07:45.630 05:03:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:45.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.630 --rc genhtml_branch_coverage=1 00:07:45.630 --rc genhtml_function_coverage=1 00:07:45.630 --rc genhtml_legend=1 00:07:45.630 --rc geninfo_all_blocks=1 00:07:45.630 --rc geninfo_unexecuted_blocks=1 00:07:45.630 00:07:45.630 ' 00:07:45.630 05:03:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:45.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.630 --rc genhtml_branch_coverage=1 00:07:45.630 --rc genhtml_function_coverage=1 00:07:45.630 --rc genhtml_legend=1 00:07:45.630 --rc geninfo_all_blocks=1 00:07:45.630 --rc geninfo_unexecuted_blocks=1 00:07:45.630 00:07:45.630 ' 00:07:45.630 05:03:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:45.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.630 --rc genhtml_branch_coverage=1 00:07:45.630 --rc genhtml_function_coverage=1 00:07:45.630 --rc genhtml_legend=1 00:07:45.630 --rc geninfo_all_blocks=1 00:07:45.630 --rc geninfo_unexecuted_blocks=1 00:07:45.630 00:07:45.630 ' 00:07:45.630 05:03:47 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:45.630 05:03:47 -- nvmf/common.sh@7 -- # uname -s 00:07:45.630 05:03:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:45.630 05:03:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:45.630 05:03:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:45.630 05:03:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:45.630 05:03:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:45.630 05:03:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:45.630 05:03:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:45.630 05:03:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:45.630 05:03:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:45.630 05:03:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:45.630 05:03:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:45.630 05:03:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:45.630 05:03:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:45.630 05:03:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:45.630 05:03:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:45.630 05:03:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:45.630 05:03:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:45.630 05:03:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:45.630 05:03:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:45.630 05:03:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.630 05:03:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.630 05:03:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.630 05:03:47 -- paths/export.sh@5 -- # export PATH 00:07:45.630 05:03:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.630 05:03:47 -- nvmf/common.sh@46 -- # : 0 00:07:45.630 05:03:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:45.630 05:03:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:45.630 05:03:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:45.630 05:03:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:45.630 05:03:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:45.630 05:03:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:45.630 05:03:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:45.630 05:03:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:45.630 05:03:47 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:45.630 05:03:47 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:45.630 05:03:47 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:45.630 05:03:47 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:45.630 05:03:47 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:45.630 05:03:47 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:45.630 05:03:47 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:45.630 05:03:47 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:45.630 05:03:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:45.630 05:03:47 -- common/autotest_common.sh@10 -- # set +x 00:07:45.630 05:03:47 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:45.630 05:03:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:45.630 05:03:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:45.630 05:03:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:45.630 05:03:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:45.630 05:03:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:45.630 05:03:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:45.630 05:03:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:45.630 05:03:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:45.630 05:03:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:45.630 05:03:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:45.630 05:03:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:45.630 05:03:47 -- common/autotest_common.sh@10 -- # set +x 00:07:48.165 05:03:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:48.165 05:03:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:48.165 05:03:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:48.165 05:03:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:48.165 05:03:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:48.165 05:03:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:48.165 05:03:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:48.165 05:03:49 -- nvmf/common.sh@294 -- # net_devs=() 00:07:48.165 05:03:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:48.165 05:03:49 -- nvmf/common.sh@295 -- # e810=() 00:07:48.165 05:03:49 -- nvmf/common.sh@295 -- # local -ga e810 00:07:48.165 05:03:49 -- nvmf/common.sh@296 -- # x722=() 00:07:48.165 05:03:49 -- nvmf/common.sh@296 -- # local -ga x722 00:07:48.165 05:03:49 -- nvmf/common.sh@297 -- # mlx=() 00:07:48.165 05:03:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:48.165 05:03:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:48.165 05:03:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:48.165 05:03:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:48.165 05:03:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:48.165 05:03:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:48.165 05:03:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:48.165 05:03:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:48.165 05:03:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:48.165 05:03:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:48.165 05:03:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:48.165 05:03:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:48.165 05:03:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:48.165 05:03:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:48.165 05:03:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:48.165 05:03:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:48.165 05:03:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:48.165 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:48.165 05:03:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:48.165 05:03:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:48.165 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:48.165 05:03:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:48.165 05:03:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:48.165 05:03:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:48.165 05:03:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:48.165 05:03:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:48.165 05:03:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:48.165 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:48.165 05:03:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:48.165 05:03:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:48.165 05:03:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:48.165 05:03:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:48.165 05:03:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:48.165 05:03:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:48.165 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:48.165 05:03:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:48.165 05:03:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:48.165 05:03:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:48.165 05:03:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:48.165 05:03:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:48.165 05:03:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:48.165 05:03:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:48.165 05:03:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:48.165 05:03:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:48.165 05:03:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:48.165 05:03:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:48.165 05:03:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:48.165 05:03:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:48.165 05:03:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:48.165 05:03:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:48.165 05:03:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:48.165 05:03:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:48.165 05:03:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:48.165 05:03:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:48.165 05:03:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:48.165 05:03:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:48.165 05:03:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:48.165 05:03:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:48.165 05:03:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:48.165 05:03:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:48.165 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:48.165 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.306 ms 00:07:48.165 00:07:48.165 --- 10.0.0.2 ping statistics --- 00:07:48.165 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:48.165 rtt min/avg/max/mdev = 0.306/0.306/0.306/0.000 ms 00:07:48.165 05:03:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:48.165 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:48.165 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.158 ms 00:07:48.165 00:07:48.165 --- 10.0.0.1 ping statistics --- 00:07:48.165 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:48.165 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:07:48.165 05:03:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:48.165 05:03:49 -- nvmf/common.sh@410 -- # return 0 00:07:48.166 05:03:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:48.166 05:03:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:48.166 05:03:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:48.166 05:03:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:48.166 05:03:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:48.166 05:03:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:48.166 05:03:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:48.166 05:03:49 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:48.166 05:03:49 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:48.166 05:03:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:48.166 05:03:49 -- common/autotest_common.sh@10 -- # set +x 00:07:48.166 05:03:49 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:48.166 05:03:49 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:48.166 05:03:49 -- target/nvmf_example.sh@34 -- # nvmfpid=3192725 00:07:48.166 05:03:49 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:48.166 05:03:49 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:48.166 05:03:49 -- target/nvmf_example.sh@36 -- # waitforlisten 3192725 00:07:48.166 05:03:49 -- common/autotest_common.sh@829 -- # '[' -z 3192725 ']' 00:07:48.166 05:03:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:48.166 05:03:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:48.166 05:03:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:48.166 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:48.166 05:03:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:48.166 05:03:49 -- common/autotest_common.sh@10 -- # set +x 00:07:48.166 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.107 05:03:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:49.107 05:03:50 -- common/autotest_common.sh@862 -- # return 0 00:07:49.107 05:03:50 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:49.107 05:03:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:49.107 05:03:50 -- common/autotest_common.sh@10 -- # set +x 00:07:49.107 05:03:50 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:49.107 05:03:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.107 05:03:50 -- common/autotest_common.sh@10 -- # set +x 00:07:49.107 05:03:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.107 05:03:50 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:49.107 05:03:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.107 05:03:50 -- common/autotest_common.sh@10 -- # set +x 00:07:49.107 05:03:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.107 05:03:50 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:49.107 05:03:50 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:49.107 05:03:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.107 05:03:50 -- common/autotest_common.sh@10 -- # set +x 00:07:49.107 05:03:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.107 05:03:50 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:49.107 05:03:50 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:49.107 05:03:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.107 05:03:50 -- common/autotest_common.sh@10 -- # set +x 00:07:49.107 05:03:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.107 05:03:50 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:49.107 05:03:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.107 05:03:50 -- common/autotest_common.sh@10 -- # set +x 00:07:49.107 05:03:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.107 05:03:50 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:49.107 05:03:50 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:49.107 EAL: No free 2048 kB hugepages reported on node 1 00:07:59.198 Initializing NVMe Controllers 00:07:59.198 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:07:59.198 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:07:59.198 Initialization complete. Launching workers. 00:07:59.198 ======================================================== 00:07:59.198 Latency(us) 00:07:59.199 Device Information : IOPS MiB/s Average min max 00:07:59.199 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15786.12 61.66 4054.05 834.22 16373.57 00:07:59.199 ======================================================== 00:07:59.199 Total : 15786.12 61.66 4054.05 834.22 16373.57 00:07:59.199 00:07:59.199 05:04:00 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:07:59.199 05:04:00 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:07:59.199 05:04:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:59.199 05:04:00 -- nvmf/common.sh@116 -- # sync 00:07:59.199 05:04:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:59.199 05:04:00 -- nvmf/common.sh@119 -- # set +e 00:07:59.199 05:04:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:59.199 05:04:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:59.199 rmmod nvme_tcp 00:07:59.199 rmmod nvme_fabrics 00:07:59.199 rmmod nvme_keyring 00:07:59.199 05:04:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:59.199 05:04:00 -- nvmf/common.sh@123 -- # set -e 00:07:59.199 05:04:00 -- nvmf/common.sh@124 -- # return 0 00:07:59.199 05:04:00 -- nvmf/common.sh@477 -- # '[' -n 3192725 ']' 00:07:59.199 05:04:00 -- nvmf/common.sh@478 -- # killprocess 3192725 00:07:59.199 05:04:00 -- common/autotest_common.sh@936 -- # '[' -z 3192725 ']' 00:07:59.199 05:04:00 -- common/autotest_common.sh@940 -- # kill -0 3192725 00:07:59.199 05:04:00 -- common/autotest_common.sh@941 -- # uname 00:07:59.199 05:04:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:59.199 05:04:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3192725 00:07:59.199 05:04:00 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:07:59.199 05:04:00 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:07:59.199 05:04:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3192725' 00:07:59.199 killing process with pid 3192725 00:07:59.199 05:04:00 -- common/autotest_common.sh@955 -- # kill 3192725 00:07:59.199 05:04:00 -- common/autotest_common.sh@960 -- # wait 3192725 00:07:59.458 nvmf threads initialize successfully 00:07:59.458 bdev subsystem init successfully 00:07:59.458 created a nvmf target service 00:07:59.458 create targets's poll groups done 00:07:59.458 all subsystems of target started 00:07:59.458 nvmf target is running 00:07:59.458 all subsystems of target stopped 00:07:59.458 destroy targets's poll groups done 00:07:59.458 destroyed the nvmf target service 00:07:59.458 bdev subsystem finish successfully 00:07:59.458 nvmf threads destroy successfully 00:07:59.458 05:04:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:59.458 05:04:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:59.458 05:04:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:59.458 05:04:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:59.458 05:04:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:59.458 05:04:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:59.458 05:04:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:59.458 05:04:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:01.999 05:04:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:01.999 05:04:03 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:01.999 05:04:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:01.999 05:04:03 -- common/autotest_common.sh@10 -- # set +x 00:08:01.999 00:08:01.999 real 0m16.096s 00:08:01.999 user 0m45.170s 00:08:01.999 sys 0m3.436s 00:08:01.999 05:04:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:01.999 05:04:03 -- common/autotest_common.sh@10 -- # set +x 00:08:01.999 ************************************ 00:08:01.999 END TEST nvmf_example 00:08:01.999 ************************************ 00:08:01.999 05:04:03 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:01.999 05:04:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:01.999 05:04:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:01.999 05:04:03 -- common/autotest_common.sh@10 -- # set +x 00:08:01.999 ************************************ 00:08:01.999 START TEST nvmf_filesystem 00:08:01.999 ************************************ 00:08:01.999 05:04:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:01.999 * Looking for test storage... 00:08:01.999 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:01.999 05:04:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:01.999 05:04:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:01.999 05:04:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:01.999 05:04:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:01.999 05:04:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:01.999 05:04:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:01.999 05:04:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:01.999 05:04:03 -- scripts/common.sh@335 -- # IFS=.-: 00:08:01.999 05:04:03 -- scripts/common.sh@335 -- # read -ra ver1 00:08:01.999 05:04:03 -- scripts/common.sh@336 -- # IFS=.-: 00:08:01.999 05:04:03 -- scripts/common.sh@336 -- # read -ra ver2 00:08:01.999 05:04:03 -- scripts/common.sh@337 -- # local 'op=<' 00:08:01.999 05:04:03 -- scripts/common.sh@339 -- # ver1_l=2 00:08:01.999 05:04:03 -- scripts/common.sh@340 -- # ver2_l=1 00:08:01.999 05:04:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:02.000 05:04:03 -- scripts/common.sh@343 -- # case "$op" in 00:08:02.000 05:04:03 -- scripts/common.sh@344 -- # : 1 00:08:02.000 05:04:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:02.000 05:04:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:02.000 05:04:03 -- scripts/common.sh@364 -- # decimal 1 00:08:02.000 05:04:03 -- scripts/common.sh@352 -- # local d=1 00:08:02.000 05:04:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:02.000 05:04:03 -- scripts/common.sh@354 -- # echo 1 00:08:02.000 05:04:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:02.000 05:04:03 -- scripts/common.sh@365 -- # decimal 2 00:08:02.000 05:04:03 -- scripts/common.sh@352 -- # local d=2 00:08:02.000 05:04:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:02.000 05:04:03 -- scripts/common.sh@354 -- # echo 2 00:08:02.000 05:04:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:02.000 05:04:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:02.000 05:04:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:02.000 05:04:03 -- scripts/common.sh@367 -- # return 0 00:08:02.000 05:04:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:02.000 05:04:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:02.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:02.000 --rc genhtml_branch_coverage=1 00:08:02.000 --rc genhtml_function_coverage=1 00:08:02.000 --rc genhtml_legend=1 00:08:02.000 --rc geninfo_all_blocks=1 00:08:02.000 --rc geninfo_unexecuted_blocks=1 00:08:02.000 00:08:02.000 ' 00:08:02.000 05:04:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:02.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:02.000 --rc genhtml_branch_coverage=1 00:08:02.000 --rc genhtml_function_coverage=1 00:08:02.000 --rc genhtml_legend=1 00:08:02.000 --rc geninfo_all_blocks=1 00:08:02.000 --rc geninfo_unexecuted_blocks=1 00:08:02.000 00:08:02.000 ' 00:08:02.000 05:04:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:02.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:02.000 --rc genhtml_branch_coverage=1 00:08:02.000 --rc genhtml_function_coverage=1 00:08:02.000 --rc genhtml_legend=1 00:08:02.000 --rc geninfo_all_blocks=1 00:08:02.000 --rc geninfo_unexecuted_blocks=1 00:08:02.000 00:08:02.000 ' 00:08:02.000 05:04:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:02.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:02.000 --rc genhtml_branch_coverage=1 00:08:02.000 --rc genhtml_function_coverage=1 00:08:02.000 --rc genhtml_legend=1 00:08:02.000 --rc geninfo_all_blocks=1 00:08:02.000 --rc geninfo_unexecuted_blocks=1 00:08:02.000 00:08:02.000 ' 00:08:02.000 05:04:03 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:08:02.000 05:04:03 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:02.000 05:04:03 -- common/autotest_common.sh@34 -- # set -e 00:08:02.000 05:04:03 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:02.000 05:04:03 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:02.000 05:04:03 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:02.000 05:04:03 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:08:02.000 05:04:03 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:02.000 05:04:03 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:02.000 05:04:03 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:02.000 05:04:03 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:02.000 05:04:03 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:02.000 05:04:03 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:02.000 05:04:03 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:02.000 05:04:03 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:02.000 05:04:03 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:02.000 05:04:03 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:02.000 05:04:03 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:02.000 05:04:03 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:02.000 05:04:03 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:02.000 05:04:03 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:02.000 05:04:03 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:02.000 05:04:03 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:02.000 05:04:03 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:02.000 05:04:03 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:02.000 05:04:03 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:02.000 05:04:03 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:02.000 05:04:03 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:02.000 05:04:03 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:02.000 05:04:03 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:02.000 05:04:03 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:02.000 05:04:03 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:02.000 05:04:03 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:02.000 05:04:03 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:02.000 05:04:03 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:02.000 05:04:03 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:02.000 05:04:03 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:02.000 05:04:03 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:02.000 05:04:03 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:02.000 05:04:03 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:02.000 05:04:03 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:02.000 05:04:03 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:02.000 05:04:03 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:02.000 05:04:03 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:02.000 05:04:03 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:02.000 05:04:03 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:02.000 05:04:03 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:02.000 05:04:03 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:02.000 05:04:03 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:02.000 05:04:03 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:02.000 05:04:03 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:02.000 05:04:03 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:02.000 05:04:03 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:02.000 05:04:03 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:02.000 05:04:03 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:02.000 05:04:03 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:02.000 05:04:03 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:02.000 05:04:03 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:08:02.000 05:04:03 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:02.000 05:04:03 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:08:02.000 05:04:03 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:08:02.000 05:04:03 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:08:02.000 05:04:03 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:08:02.000 05:04:03 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:08:02.000 05:04:03 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:08:02.000 05:04:03 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:08:02.000 05:04:03 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:08:02.000 05:04:03 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:02.000 05:04:03 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:08:02.000 05:04:03 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:08:02.000 05:04:03 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:08:02.000 05:04:03 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:08:02.000 05:04:03 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:02.000 05:04:03 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:08:02.000 05:04:03 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:08:02.000 05:04:03 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:08:02.000 05:04:03 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:08:02.000 05:04:03 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:08:02.000 05:04:03 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:08:02.000 05:04:03 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:08:02.000 05:04:03 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:08:02.000 05:04:03 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:08:02.000 05:04:03 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:08:02.000 05:04:03 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:02.000 05:04:03 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:08:02.000 05:04:03 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:08:02.000 05:04:03 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:02.000 05:04:03 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:02.000 05:04:03 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:02.000 05:04:03 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:02.000 05:04:03 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:02.000 05:04:03 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:02.000 05:04:03 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:02.000 05:04:03 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:02.000 05:04:03 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:02.000 05:04:03 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:02.000 05:04:03 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:02.000 05:04:03 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:02.000 05:04:03 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:02.000 05:04:03 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:02.000 05:04:03 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:08:02.000 05:04:03 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:02.000 #define SPDK_CONFIG_H 00:08:02.000 #define SPDK_CONFIG_APPS 1 00:08:02.001 #define SPDK_CONFIG_ARCH native 00:08:02.001 #undef SPDK_CONFIG_ASAN 00:08:02.001 #undef SPDK_CONFIG_AVAHI 00:08:02.001 #undef SPDK_CONFIG_CET 00:08:02.001 #define SPDK_CONFIG_COVERAGE 1 00:08:02.001 #define SPDK_CONFIG_CROSS_PREFIX 00:08:02.001 #undef SPDK_CONFIG_CRYPTO 00:08:02.001 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:02.001 #undef SPDK_CONFIG_CUSTOMOCF 00:08:02.001 #undef SPDK_CONFIG_DAOS 00:08:02.001 #define SPDK_CONFIG_DAOS_DIR 00:08:02.001 #define SPDK_CONFIG_DEBUG 1 00:08:02.001 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:02.001 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:02.001 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:02.001 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:02.001 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:02.001 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:02.001 #define SPDK_CONFIG_EXAMPLES 1 00:08:02.001 #undef SPDK_CONFIG_FC 00:08:02.001 #define SPDK_CONFIG_FC_PATH 00:08:02.001 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:02.001 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:02.001 #undef SPDK_CONFIG_FUSE 00:08:02.001 #undef SPDK_CONFIG_FUZZER 00:08:02.001 #define SPDK_CONFIG_FUZZER_LIB 00:08:02.001 #undef SPDK_CONFIG_GOLANG 00:08:02.001 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:02.001 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:02.001 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:02.001 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:02.001 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:02.001 #define SPDK_CONFIG_IDXD 1 00:08:02.001 #define SPDK_CONFIG_IDXD_KERNEL 1 00:08:02.001 #undef SPDK_CONFIG_IPSEC_MB 00:08:02.001 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:02.001 #define SPDK_CONFIG_ISAL 1 00:08:02.001 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:02.001 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:02.001 #define SPDK_CONFIG_LIBDIR 00:08:02.001 #undef SPDK_CONFIG_LTO 00:08:02.001 #define SPDK_CONFIG_MAX_LCORES 00:08:02.001 #define SPDK_CONFIG_NVME_CUSE 1 00:08:02.001 #undef SPDK_CONFIG_OCF 00:08:02.001 #define SPDK_CONFIG_OCF_PATH 00:08:02.001 #define SPDK_CONFIG_OPENSSL_PATH 00:08:02.001 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:02.001 #undef SPDK_CONFIG_PGO_USE 00:08:02.001 #define SPDK_CONFIG_PREFIX /usr/local 00:08:02.001 #undef SPDK_CONFIG_RAID5F 00:08:02.001 #undef SPDK_CONFIG_RBD 00:08:02.001 #define SPDK_CONFIG_RDMA 1 00:08:02.001 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:02.001 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:02.001 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:02.001 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:02.001 #define SPDK_CONFIG_SHARED 1 00:08:02.001 #undef SPDK_CONFIG_SMA 00:08:02.001 #define SPDK_CONFIG_TESTS 1 00:08:02.001 #undef SPDK_CONFIG_TSAN 00:08:02.001 #define SPDK_CONFIG_UBLK 1 00:08:02.001 #define SPDK_CONFIG_UBSAN 1 00:08:02.001 #undef SPDK_CONFIG_UNIT_TESTS 00:08:02.001 #undef SPDK_CONFIG_URING 00:08:02.001 #define SPDK_CONFIG_URING_PATH 00:08:02.001 #undef SPDK_CONFIG_URING_ZNS 00:08:02.001 #undef SPDK_CONFIG_USDT 00:08:02.001 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:02.001 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:02.001 #define SPDK_CONFIG_VFIO_USER 1 00:08:02.001 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:02.001 #define SPDK_CONFIG_VHOST 1 00:08:02.001 #define SPDK_CONFIG_VIRTIO 1 00:08:02.001 #undef SPDK_CONFIG_VTUNE 00:08:02.001 #define SPDK_CONFIG_VTUNE_DIR 00:08:02.001 #define SPDK_CONFIG_WERROR 1 00:08:02.001 #define SPDK_CONFIG_WPDK_DIR 00:08:02.001 #undef SPDK_CONFIG_XNVME 00:08:02.001 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:02.001 05:04:03 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:02.001 05:04:03 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:02.001 05:04:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:02.001 05:04:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:02.001 05:04:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:02.001 05:04:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.001 05:04:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.001 05:04:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.001 05:04:03 -- paths/export.sh@5 -- # export PATH 00:08:02.001 05:04:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.001 05:04:03 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:02.001 05:04:03 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:02.001 05:04:03 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:02.001 05:04:03 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:02.001 05:04:03 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:02.001 05:04:03 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:02.001 05:04:03 -- pm/common@16 -- # TEST_TAG=N/A 00:08:02.001 05:04:03 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:08:02.001 05:04:03 -- common/autotest_common.sh@52 -- # : 1 00:08:02.001 05:04:03 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:08:02.001 05:04:03 -- common/autotest_common.sh@56 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:02.001 05:04:03 -- common/autotest_common.sh@58 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:08:02.001 05:04:03 -- common/autotest_common.sh@60 -- # : 1 00:08:02.001 05:04:03 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:02.001 05:04:03 -- common/autotest_common.sh@62 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:08:02.001 05:04:03 -- common/autotest_common.sh@64 -- # : 00:08:02.001 05:04:03 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:08:02.001 05:04:03 -- common/autotest_common.sh@66 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:08:02.001 05:04:03 -- common/autotest_common.sh@68 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:08:02.001 05:04:03 -- common/autotest_common.sh@70 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:08:02.001 05:04:03 -- common/autotest_common.sh@72 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:02.001 05:04:03 -- common/autotest_common.sh@74 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:08:02.001 05:04:03 -- common/autotest_common.sh@76 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:08:02.001 05:04:03 -- common/autotest_common.sh@78 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:08:02.001 05:04:03 -- common/autotest_common.sh@80 -- # : 1 00:08:02.001 05:04:03 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:08:02.001 05:04:03 -- common/autotest_common.sh@82 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:08:02.001 05:04:03 -- common/autotest_common.sh@84 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:08:02.001 05:04:03 -- common/autotest_common.sh@86 -- # : 1 00:08:02.001 05:04:03 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:08:02.001 05:04:03 -- common/autotest_common.sh@88 -- # : 1 00:08:02.001 05:04:03 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:08:02.001 05:04:03 -- common/autotest_common.sh@90 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:02.001 05:04:03 -- common/autotest_common.sh@92 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:08:02.001 05:04:03 -- common/autotest_common.sh@94 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:08:02.001 05:04:03 -- common/autotest_common.sh@96 -- # : tcp 00:08:02.001 05:04:03 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:02.001 05:04:03 -- common/autotest_common.sh@98 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:08:02.001 05:04:03 -- common/autotest_common.sh@100 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:08:02.001 05:04:03 -- common/autotest_common.sh@102 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:08:02.001 05:04:03 -- common/autotest_common.sh@104 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:08:02.001 05:04:03 -- common/autotest_common.sh@106 -- # : 0 00:08:02.001 05:04:03 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:08:02.001 05:04:03 -- common/autotest_common.sh@108 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:08:02.002 05:04:03 -- common/autotest_common.sh@110 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:08:02.002 05:04:03 -- common/autotest_common.sh@112 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:02.002 05:04:03 -- common/autotest_common.sh@114 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:08:02.002 05:04:03 -- common/autotest_common.sh@116 -- # : 1 00:08:02.002 05:04:03 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:08:02.002 05:04:03 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:02.002 05:04:03 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:02.002 05:04:03 -- common/autotest_common.sh@120 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:08:02.002 05:04:03 -- common/autotest_common.sh@122 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:08:02.002 05:04:03 -- common/autotest_common.sh@124 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:08:02.002 05:04:03 -- common/autotest_common.sh@126 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:08:02.002 05:04:03 -- common/autotest_common.sh@128 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:08:02.002 05:04:03 -- common/autotest_common.sh@130 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:08:02.002 05:04:03 -- common/autotest_common.sh@132 -- # : v23.11 00:08:02.002 05:04:03 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:08:02.002 05:04:03 -- common/autotest_common.sh@134 -- # : true 00:08:02.002 05:04:03 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:08:02.002 05:04:03 -- common/autotest_common.sh@136 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:08:02.002 05:04:03 -- common/autotest_common.sh@138 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:08:02.002 05:04:03 -- common/autotest_common.sh@140 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:08:02.002 05:04:03 -- common/autotest_common.sh@142 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:08:02.002 05:04:03 -- common/autotest_common.sh@144 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:08:02.002 05:04:03 -- common/autotest_common.sh@146 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:08:02.002 05:04:03 -- common/autotest_common.sh@148 -- # : e810 00:08:02.002 05:04:03 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:08:02.002 05:04:03 -- common/autotest_common.sh@150 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:08:02.002 05:04:03 -- common/autotest_common.sh@152 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:08:02.002 05:04:03 -- common/autotest_common.sh@154 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:08:02.002 05:04:03 -- common/autotest_common.sh@156 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:08:02.002 05:04:03 -- common/autotest_common.sh@158 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:08:02.002 05:04:03 -- common/autotest_common.sh@160 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:08:02.002 05:04:03 -- common/autotest_common.sh@163 -- # : 00:08:02.002 05:04:03 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:08:02.002 05:04:03 -- common/autotest_common.sh@165 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:08:02.002 05:04:03 -- common/autotest_common.sh@167 -- # : 0 00:08:02.002 05:04:03 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:02.002 05:04:03 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:02.002 05:04:03 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:02.002 05:04:03 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:02.002 05:04:03 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:02.002 05:04:03 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:02.002 05:04:03 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:02.002 05:04:03 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:02.002 05:04:03 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:02.002 05:04:03 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:02.002 05:04:03 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:02.002 05:04:03 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:02.002 05:04:03 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:02.002 05:04:03 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:02.002 05:04:03 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:08:02.002 05:04:03 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:02.002 05:04:03 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:02.002 05:04:03 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:02.002 05:04:03 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:02.002 05:04:03 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:02.002 05:04:03 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:08:02.002 05:04:03 -- common/autotest_common.sh@196 -- # cat 00:08:02.002 05:04:03 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:08:02.002 05:04:03 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:02.002 05:04:03 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:02.002 05:04:03 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:02.002 05:04:03 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:02.002 05:04:03 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:08:02.002 05:04:03 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:08:02.002 05:04:03 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:02.002 05:04:03 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:02.002 05:04:03 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:02.002 05:04:03 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:02.002 05:04:03 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:02.002 05:04:03 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:02.002 05:04:03 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:02.002 05:04:03 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:02.002 05:04:03 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:02.002 05:04:03 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:02.002 05:04:03 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:02.002 05:04:03 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:02.002 05:04:03 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:08:02.002 05:04:03 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:08:02.002 05:04:03 -- common/autotest_common.sh@249 -- # _LCOV= 00:08:02.002 05:04:03 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:08:02.002 05:04:03 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:08:02.002 05:04:03 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:08:02.002 05:04:03 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:08:02.002 05:04:03 -- common/autotest_common.sh@255 -- # lcov_opt= 00:08:02.002 05:04:03 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:08:02.002 05:04:03 -- common/autotest_common.sh@259 -- # export valgrind= 00:08:02.003 05:04:03 -- common/autotest_common.sh@259 -- # valgrind= 00:08:02.003 05:04:03 -- common/autotest_common.sh@265 -- # uname -s 00:08:02.003 05:04:03 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:08:02.003 05:04:03 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:08:02.003 05:04:03 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:08:02.003 05:04:03 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:08:02.003 05:04:03 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:02.003 05:04:03 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:02.003 05:04:03 -- common/autotest_common.sh@275 -- # MAKE=make 00:08:02.003 05:04:03 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:08:02.003 05:04:03 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:08:02.003 05:04:03 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:08:02.003 05:04:03 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:08:02.003 05:04:03 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:08:02.003 05:04:03 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:08:02.003 05:04:03 -- common/autotest_common.sh@301 -- # for i in "$@" 00:08:02.003 05:04:03 -- common/autotest_common.sh@302 -- # case "$i" in 00:08:02.003 05:04:03 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:08:02.003 05:04:03 -- common/autotest_common.sh@319 -- # [[ -z 3194480 ]] 00:08:02.003 05:04:03 -- common/autotest_common.sh@319 -- # kill -0 3194480 00:08:02.003 05:04:03 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:08:02.003 05:04:03 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:08:02.003 05:04:03 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:08:02.003 05:04:03 -- common/autotest_common.sh@332 -- # local mount target_dir 00:08:02.003 05:04:03 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:08:02.003 05:04:03 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:08:02.003 05:04:03 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:08:02.003 05:04:03 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:08:02.003 05:04:03 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.MKeDmi 00:08:02.003 05:04:03 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:02.003 05:04:03 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:08:02.003 05:04:03 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:08:02.003 05:04:03 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.MKeDmi/tests/target /tmp/spdk.MKeDmi 00:08:02.003 05:04:03 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:08:02.003 05:04:03 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:02.003 05:04:03 -- common/autotest_common.sh@328 -- # df -T 00:08:02.003 05:04:03 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:08:02.003 05:04:03 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:08:02.003 05:04:03 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:08:02.003 05:04:03 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:08:02.003 05:04:03 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # avails["$mount"]=52681953280 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988515840 00:08:02.003 05:04:03 -- common/autotest_common.sh@364 -- # uses["$mount"]=9306562560 00:08:02.003 05:04:03 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991663104 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994255872 00:08:02.003 05:04:03 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:08:02.003 05:04:03 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:08:02.003 05:04:03 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:08:02.003 05:04:03 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993268736 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:08:02.003 05:04:03 -- common/autotest_common.sh@364 -- # uses["$mount"]=991232 00:08:02.003 05:04:03 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:02.003 05:04:03 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:08:02.003 05:04:03 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:08:02.003 05:04:03 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:08:02.003 05:04:03 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:02.003 05:04:03 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:08:02.003 * Looking for test storage... 00:08:02.003 05:04:03 -- common/autotest_common.sh@369 -- # local target_space new_size 00:08:02.003 05:04:03 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:08:02.003 05:04:03 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:02.003 05:04:03 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:02.003 05:04:03 -- common/autotest_common.sh@373 -- # mount=/ 00:08:02.003 05:04:03 -- common/autotest_common.sh@375 -- # target_space=52681953280 00:08:02.003 05:04:03 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:08:02.003 05:04:03 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:08:02.003 05:04:03 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:08:02.003 05:04:03 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:08:02.003 05:04:03 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:08:02.003 05:04:03 -- common/autotest_common.sh@382 -- # new_size=11521155072 00:08:02.003 05:04:03 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:02.003 05:04:03 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:02.003 05:04:03 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:02.003 05:04:03 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:02.003 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:02.003 05:04:03 -- common/autotest_common.sh@390 -- # return 0 00:08:02.003 05:04:03 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:08:02.003 05:04:03 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:08:02.003 05:04:03 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:02.003 05:04:03 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:02.003 05:04:03 -- common/autotest_common.sh@1682 -- # true 00:08:02.003 05:04:03 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:08:02.003 05:04:03 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:02.003 05:04:03 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:02.003 05:04:03 -- common/autotest_common.sh@27 -- # exec 00:08:02.003 05:04:03 -- common/autotest_common.sh@29 -- # exec 00:08:02.003 05:04:03 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:02.003 05:04:03 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:02.003 05:04:03 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:02.003 05:04:03 -- common/autotest_common.sh@18 -- # set -x 00:08:02.003 05:04:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:02.003 05:04:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:02.003 05:04:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:02.003 05:04:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:02.003 05:04:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:02.003 05:04:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:02.003 05:04:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:02.003 05:04:03 -- scripts/common.sh@335 -- # IFS=.-: 00:08:02.003 05:04:03 -- scripts/common.sh@335 -- # read -ra ver1 00:08:02.003 05:04:03 -- scripts/common.sh@336 -- # IFS=.-: 00:08:02.003 05:04:03 -- scripts/common.sh@336 -- # read -ra ver2 00:08:02.003 05:04:03 -- scripts/common.sh@337 -- # local 'op=<' 00:08:02.003 05:04:03 -- scripts/common.sh@339 -- # ver1_l=2 00:08:02.003 05:04:03 -- scripts/common.sh@340 -- # ver2_l=1 00:08:02.003 05:04:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:02.003 05:04:03 -- scripts/common.sh@343 -- # case "$op" in 00:08:02.003 05:04:03 -- scripts/common.sh@344 -- # : 1 00:08:02.003 05:04:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:02.003 05:04:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:02.003 05:04:03 -- scripts/common.sh@364 -- # decimal 1 00:08:02.003 05:04:03 -- scripts/common.sh@352 -- # local d=1 00:08:02.003 05:04:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:02.003 05:04:03 -- scripts/common.sh@354 -- # echo 1 00:08:02.003 05:04:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:02.003 05:04:03 -- scripts/common.sh@365 -- # decimal 2 00:08:02.003 05:04:03 -- scripts/common.sh@352 -- # local d=2 00:08:02.003 05:04:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:02.003 05:04:03 -- scripts/common.sh@354 -- # echo 2 00:08:02.003 05:04:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:02.004 05:04:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:02.004 05:04:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:02.004 05:04:03 -- scripts/common.sh@367 -- # return 0 00:08:02.004 05:04:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:02.004 05:04:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:02.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:02.004 --rc genhtml_branch_coverage=1 00:08:02.004 --rc genhtml_function_coverage=1 00:08:02.004 --rc genhtml_legend=1 00:08:02.004 --rc geninfo_all_blocks=1 00:08:02.004 --rc geninfo_unexecuted_blocks=1 00:08:02.004 00:08:02.004 ' 00:08:02.004 05:04:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:02.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:02.004 --rc genhtml_branch_coverage=1 00:08:02.004 --rc genhtml_function_coverage=1 00:08:02.004 --rc genhtml_legend=1 00:08:02.004 --rc geninfo_all_blocks=1 00:08:02.004 --rc geninfo_unexecuted_blocks=1 00:08:02.004 00:08:02.004 ' 00:08:02.004 05:04:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:02.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:02.004 --rc genhtml_branch_coverage=1 00:08:02.004 --rc genhtml_function_coverage=1 00:08:02.004 --rc genhtml_legend=1 00:08:02.004 --rc geninfo_all_blocks=1 00:08:02.004 --rc geninfo_unexecuted_blocks=1 00:08:02.004 00:08:02.004 ' 00:08:02.004 05:04:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:02.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:02.004 --rc genhtml_branch_coverage=1 00:08:02.004 --rc genhtml_function_coverage=1 00:08:02.004 --rc genhtml_legend=1 00:08:02.004 --rc geninfo_all_blocks=1 00:08:02.004 --rc geninfo_unexecuted_blocks=1 00:08:02.004 00:08:02.004 ' 00:08:02.004 05:04:03 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:02.004 05:04:03 -- nvmf/common.sh@7 -- # uname -s 00:08:02.004 05:04:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:02.004 05:04:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:02.004 05:04:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:02.004 05:04:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:02.004 05:04:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:02.004 05:04:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:02.004 05:04:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:02.004 05:04:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:02.004 05:04:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:02.004 05:04:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:02.004 05:04:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:02.004 05:04:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:02.004 05:04:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:02.004 05:04:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:02.004 05:04:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:02.004 05:04:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:02.004 05:04:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:02.004 05:04:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:02.004 05:04:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:02.004 05:04:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.004 05:04:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.004 05:04:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.004 05:04:03 -- paths/export.sh@5 -- # export PATH 00:08:02.004 05:04:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.004 05:04:03 -- nvmf/common.sh@46 -- # : 0 00:08:02.004 05:04:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:02.004 05:04:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:02.004 05:04:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:02.004 05:04:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:02.004 05:04:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:02.004 05:04:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:02.004 05:04:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:02.004 05:04:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:02.004 05:04:03 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:02.004 05:04:03 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:02.004 05:04:03 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:02.004 05:04:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:02.004 05:04:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:02.004 05:04:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:02.004 05:04:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:02.004 05:04:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:02.004 05:04:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:02.004 05:04:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:02.004 05:04:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:02.004 05:04:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:02.004 05:04:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:02.004 05:04:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:02.004 05:04:03 -- common/autotest_common.sh@10 -- # set +x 00:08:03.925 05:04:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:03.925 05:04:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:03.925 05:04:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:03.925 05:04:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:03.925 05:04:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:03.925 05:04:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:03.925 05:04:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:03.925 05:04:05 -- nvmf/common.sh@294 -- # net_devs=() 00:08:03.925 05:04:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:03.925 05:04:05 -- nvmf/common.sh@295 -- # e810=() 00:08:03.925 05:04:05 -- nvmf/common.sh@295 -- # local -ga e810 00:08:03.925 05:04:05 -- nvmf/common.sh@296 -- # x722=() 00:08:03.925 05:04:05 -- nvmf/common.sh@296 -- # local -ga x722 00:08:03.925 05:04:05 -- nvmf/common.sh@297 -- # mlx=() 00:08:03.925 05:04:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:03.925 05:04:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:03.925 05:04:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:03.925 05:04:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:03.925 05:04:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:03.925 05:04:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:03.925 05:04:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:03.925 05:04:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:03.925 05:04:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:03.925 05:04:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:03.925 05:04:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:03.925 05:04:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:03.925 05:04:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:03.925 05:04:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:03.925 05:04:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:03.925 05:04:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:03.925 05:04:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:03.925 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:03.925 05:04:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:03.925 05:04:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:03.925 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:03.925 05:04:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:03.925 05:04:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:03.925 05:04:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:03.925 05:04:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:03.926 05:04:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:03.926 05:04:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:03.926 05:04:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:03.926 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:03.926 05:04:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:03.926 05:04:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:03.926 05:04:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:03.926 05:04:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:03.926 05:04:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:03.926 05:04:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:03.926 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:03.926 05:04:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:03.926 05:04:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:03.926 05:04:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:03.926 05:04:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:03.926 05:04:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:03.926 05:04:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:03.926 05:04:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:03.926 05:04:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:03.926 05:04:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:03.926 05:04:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:03.926 05:04:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:03.926 05:04:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:03.926 05:04:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:03.926 05:04:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:03.926 05:04:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:03.926 05:04:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:03.926 05:04:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:03.926 05:04:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:03.926 05:04:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:03.926 05:04:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:03.926 05:04:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:03.926 05:04:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:03.926 05:04:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:03.926 05:04:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:03.926 05:04:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:03.926 05:04:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:03.926 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:03.926 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:08:03.926 00:08:03.926 --- 10.0.0.2 ping statistics --- 00:08:03.926 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:03.926 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:08:03.926 05:04:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:03.926 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:03.926 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:08:03.926 00:08:03.926 --- 10.0.0.1 ping statistics --- 00:08:03.926 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:03.926 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:08:03.926 05:04:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:03.926 05:04:05 -- nvmf/common.sh@410 -- # return 0 00:08:03.926 05:04:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:03.926 05:04:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:03.926 05:04:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:03.926 05:04:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:03.926 05:04:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:03.926 05:04:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:03.926 05:04:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:03.926 05:04:05 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:03.926 05:04:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:03.926 05:04:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:03.926 05:04:05 -- common/autotest_common.sh@10 -- # set +x 00:08:03.926 ************************************ 00:08:03.926 START TEST nvmf_filesystem_no_in_capsule 00:08:03.926 ************************************ 00:08:03.926 05:04:05 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:08:03.926 05:04:05 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:03.926 05:04:05 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:03.926 05:04:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:03.926 05:04:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:03.926 05:04:05 -- common/autotest_common.sh@10 -- # set +x 00:08:03.926 05:04:05 -- nvmf/common.sh@469 -- # nvmfpid=3196123 00:08:03.926 05:04:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:03.926 05:04:05 -- nvmf/common.sh@470 -- # waitforlisten 3196123 00:08:03.926 05:04:05 -- common/autotest_common.sh@829 -- # '[' -z 3196123 ']' 00:08:03.926 05:04:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:03.926 05:04:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:03.926 05:04:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:03.926 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:03.926 05:04:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:03.926 05:04:05 -- common/autotest_common.sh@10 -- # set +x 00:08:04.186 [2024-11-26 05:04:05.733557] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:04.186 [2024-11-26 05:04:05.733636] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:04.186 EAL: No free 2048 kB hugepages reported on node 1 00:08:04.186 [2024-11-26 05:04:05.810683] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:04.186 [2024-11-26 05:04:05.908586] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:04.186 [2024-11-26 05:04:05.908774] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:04.186 [2024-11-26 05:04:05.908795] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:04.186 [2024-11-26 05:04:05.908810] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:04.186 [2024-11-26 05:04:05.908885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:04.186 [2024-11-26 05:04:05.908943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:04.186 [2024-11-26 05:04:05.908998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:04.186 [2024-11-26 05:04:05.909002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:05.125 05:04:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:05.125 05:04:06 -- common/autotest_common.sh@862 -- # return 0 00:08:05.125 05:04:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:05.125 05:04:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:05.125 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:08:05.125 05:04:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:05.125 05:04:06 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:05.125 05:04:06 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:05.125 05:04:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.125 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:08:05.125 [2024-11-26 05:04:06.773453] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:05.125 05:04:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.125 05:04:06 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:05.125 05:04:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.125 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:08:05.385 Malloc1 00:08:05.385 05:04:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.385 05:04:06 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:05.385 05:04:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.385 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:08:05.385 05:04:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.385 05:04:06 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:05.385 05:04:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.385 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:08:05.385 05:04:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.385 05:04:06 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:05.385 05:04:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.385 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:08:05.385 [2024-11-26 05:04:06.964852] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:05.385 05:04:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.385 05:04:06 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:05.385 05:04:06 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:05.385 05:04:06 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:05.385 05:04:06 -- common/autotest_common.sh@1369 -- # local bs 00:08:05.385 05:04:06 -- common/autotest_common.sh@1370 -- # local nb 00:08:05.385 05:04:06 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:05.385 05:04:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.385 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:08:05.385 05:04:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.385 05:04:06 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:05.385 { 00:08:05.385 "name": "Malloc1", 00:08:05.385 "aliases": [ 00:08:05.385 "cbcd8b54-a494-40e4-9518-98af6f627024" 00:08:05.385 ], 00:08:05.385 "product_name": "Malloc disk", 00:08:05.385 "block_size": 512, 00:08:05.385 "num_blocks": 1048576, 00:08:05.385 "uuid": "cbcd8b54-a494-40e4-9518-98af6f627024", 00:08:05.385 "assigned_rate_limits": { 00:08:05.385 "rw_ios_per_sec": 0, 00:08:05.385 "rw_mbytes_per_sec": 0, 00:08:05.385 "r_mbytes_per_sec": 0, 00:08:05.385 "w_mbytes_per_sec": 0 00:08:05.385 }, 00:08:05.385 "claimed": true, 00:08:05.385 "claim_type": "exclusive_write", 00:08:05.385 "zoned": false, 00:08:05.385 "supported_io_types": { 00:08:05.385 "read": true, 00:08:05.385 "write": true, 00:08:05.385 "unmap": true, 00:08:05.385 "write_zeroes": true, 00:08:05.385 "flush": true, 00:08:05.385 "reset": true, 00:08:05.385 "compare": false, 00:08:05.385 "compare_and_write": false, 00:08:05.385 "abort": true, 00:08:05.385 "nvme_admin": false, 00:08:05.385 "nvme_io": false 00:08:05.385 }, 00:08:05.385 "memory_domains": [ 00:08:05.385 { 00:08:05.385 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:05.385 "dma_device_type": 2 00:08:05.385 } 00:08:05.385 ], 00:08:05.385 "driver_specific": {} 00:08:05.385 } 00:08:05.385 ]' 00:08:05.385 05:04:06 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:05.385 05:04:07 -- common/autotest_common.sh@1372 -- # bs=512 00:08:05.385 05:04:07 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:05.385 05:04:07 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:05.385 05:04:07 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:05.385 05:04:07 -- common/autotest_common.sh@1377 -- # echo 512 00:08:05.385 05:04:07 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:05.385 05:04:07 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:06.322 05:04:07 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:06.322 05:04:07 -- common/autotest_common.sh@1187 -- # local i=0 00:08:06.322 05:04:07 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:06.322 05:04:07 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:06.322 05:04:07 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:08.231 05:04:09 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:08.231 05:04:09 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:08.231 05:04:09 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:08.231 05:04:09 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:08.231 05:04:09 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:08.231 05:04:09 -- common/autotest_common.sh@1197 -- # return 0 00:08:08.231 05:04:09 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:08.231 05:04:09 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:08.231 05:04:09 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:08.231 05:04:09 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:08.231 05:04:09 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:08.231 05:04:09 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:08.231 05:04:09 -- setup/common.sh@80 -- # echo 536870912 00:08:08.231 05:04:09 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:08.231 05:04:09 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:08.231 05:04:09 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:08.231 05:04:09 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:08.492 05:04:10 -- target/filesystem.sh@69 -- # partprobe 00:08:08.751 05:04:10 -- target/filesystem.sh@70 -- # sleep 1 00:08:10.132 05:04:11 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:10.132 05:04:11 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:10.132 05:04:11 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:10.132 05:04:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:10.132 05:04:11 -- common/autotest_common.sh@10 -- # set +x 00:08:10.132 ************************************ 00:08:10.132 START TEST filesystem_ext4 00:08:10.132 ************************************ 00:08:10.132 05:04:11 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:10.132 05:04:11 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:10.132 05:04:11 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:10.132 05:04:11 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:10.132 05:04:11 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:10.132 05:04:11 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:10.132 05:04:11 -- common/autotest_common.sh@914 -- # local i=0 00:08:10.132 05:04:11 -- common/autotest_common.sh@915 -- # local force 00:08:10.132 05:04:11 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:10.132 05:04:11 -- common/autotest_common.sh@918 -- # force=-F 00:08:10.132 05:04:11 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:10.132 mke2fs 1.47.0 (5-Feb-2023) 00:08:10.132 Discarding device blocks: 0/522240 done 00:08:10.132 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:10.132 Filesystem UUID: 3b6c9b2e-b739-4b3c-9819-0223e4cac679 00:08:10.132 Superblock backups stored on blocks: 00:08:10.132 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:10.132 00:08:10.132 Allocating group tables: 0/64 done 00:08:10.132 Writing inode tables: 0/64 done 00:08:10.132 Creating journal (8192 blocks): done 00:08:10.132 Writing superblocks and filesystem accounting information: 0/64 done 00:08:10.132 00:08:10.132 05:04:11 -- common/autotest_common.sh@931 -- # return 0 00:08:10.132 05:04:11 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:16.699 05:04:17 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:16.700 05:04:17 -- target/filesystem.sh@25 -- # sync 00:08:16.700 05:04:17 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:16.700 05:04:17 -- target/filesystem.sh@27 -- # sync 00:08:16.700 05:04:17 -- target/filesystem.sh@29 -- # i=0 00:08:16.700 05:04:17 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:16.700 05:04:17 -- target/filesystem.sh@37 -- # kill -0 3196123 00:08:16.700 05:04:17 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:16.700 05:04:17 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:16.700 05:04:17 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:16.700 05:04:17 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:16.700 00:08:16.700 real 0m6.056s 00:08:16.700 user 0m0.022s 00:08:16.700 sys 0m0.059s 00:08:16.700 05:04:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:16.700 05:04:17 -- common/autotest_common.sh@10 -- # set +x 00:08:16.700 ************************************ 00:08:16.700 END TEST filesystem_ext4 00:08:16.700 ************************************ 00:08:16.700 05:04:17 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:16.700 05:04:17 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:16.700 05:04:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:16.700 05:04:17 -- common/autotest_common.sh@10 -- # set +x 00:08:16.700 ************************************ 00:08:16.700 START TEST filesystem_btrfs 00:08:16.700 ************************************ 00:08:16.700 05:04:17 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:16.700 05:04:17 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:16.700 05:04:17 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:16.700 05:04:17 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:16.700 05:04:17 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:16.700 05:04:17 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:16.700 05:04:17 -- common/autotest_common.sh@914 -- # local i=0 00:08:16.700 05:04:17 -- common/autotest_common.sh@915 -- # local force 00:08:16.700 05:04:17 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:16.700 05:04:17 -- common/autotest_common.sh@920 -- # force=-f 00:08:16.700 05:04:17 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:16.700 btrfs-progs v6.8.1 00:08:16.700 See https://btrfs.readthedocs.io for more information. 00:08:16.700 00:08:16.700 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:16.700 NOTE: several default settings have changed in version 5.15, please make sure 00:08:16.700 this does not affect your deployments: 00:08:16.700 - DUP for metadata (-m dup) 00:08:16.700 - enabled no-holes (-O no-holes) 00:08:16.700 - enabled free-space-tree (-R free-space-tree) 00:08:16.700 00:08:16.700 Label: (null) 00:08:16.700 UUID: 876cb98b-f218-4d05-a249-4adbeb4740a6 00:08:16.700 Node size: 16384 00:08:16.700 Sector size: 4096 (CPU page size: 4096) 00:08:16.700 Filesystem size: 510.00MiB 00:08:16.700 Block group profiles: 00:08:16.700 Data: single 8.00MiB 00:08:16.700 Metadata: DUP 32.00MiB 00:08:16.700 System: DUP 8.00MiB 00:08:16.700 SSD detected: yes 00:08:16.700 Zoned device: no 00:08:16.700 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:16.700 Checksum: crc32c 00:08:16.700 Number of devices: 1 00:08:16.700 Devices: 00:08:16.700 ID SIZE PATH 00:08:16.700 1 510.00MiB /dev/nvme0n1p1 00:08:16.700 00:08:16.700 05:04:17 -- common/autotest_common.sh@931 -- # return 0 00:08:16.700 05:04:17 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:16.700 05:04:18 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:16.700 05:04:18 -- target/filesystem.sh@25 -- # sync 00:08:16.700 05:04:18 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:16.700 05:04:18 -- target/filesystem.sh@27 -- # sync 00:08:16.700 05:04:18 -- target/filesystem.sh@29 -- # i=0 00:08:16.700 05:04:18 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:16.700 05:04:18 -- target/filesystem.sh@37 -- # kill -0 3196123 00:08:16.700 05:04:18 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:16.700 05:04:18 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:16.958 05:04:18 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:16.958 05:04:18 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:16.958 00:08:16.958 real 0m0.879s 00:08:16.958 user 0m0.022s 00:08:16.958 sys 0m0.096s 00:08:16.958 05:04:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:16.958 05:04:18 -- common/autotest_common.sh@10 -- # set +x 00:08:16.958 ************************************ 00:08:16.958 END TEST filesystem_btrfs 00:08:16.958 ************************************ 00:08:16.958 05:04:18 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:16.958 05:04:18 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:16.958 05:04:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:16.958 05:04:18 -- common/autotest_common.sh@10 -- # set +x 00:08:16.958 ************************************ 00:08:16.958 START TEST filesystem_xfs 00:08:16.958 ************************************ 00:08:16.958 05:04:18 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:16.958 05:04:18 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:16.958 05:04:18 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:16.958 05:04:18 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:16.958 05:04:18 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:16.958 05:04:18 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:16.958 05:04:18 -- common/autotest_common.sh@914 -- # local i=0 00:08:16.958 05:04:18 -- common/autotest_common.sh@915 -- # local force 00:08:16.958 05:04:18 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:16.958 05:04:18 -- common/autotest_common.sh@920 -- # force=-f 00:08:16.958 05:04:18 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:16.958 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:16.958 = sectsz=512 attr=2, projid32bit=1 00:08:16.958 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:16.958 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:16.958 data = bsize=4096 blocks=130560, imaxpct=25 00:08:16.958 = sunit=0 swidth=0 blks 00:08:16.958 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:16.958 log =internal log bsize=4096 blocks=16384, version=2 00:08:16.958 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:16.958 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:17.897 Discarding blocks...Done. 00:08:17.897 05:04:19 -- common/autotest_common.sh@931 -- # return 0 00:08:17.897 05:04:19 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:20.436 05:04:21 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:20.436 05:04:21 -- target/filesystem.sh@25 -- # sync 00:08:20.436 05:04:21 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:20.436 05:04:21 -- target/filesystem.sh@27 -- # sync 00:08:20.436 05:04:21 -- target/filesystem.sh@29 -- # i=0 00:08:20.436 05:04:21 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:20.436 05:04:21 -- target/filesystem.sh@37 -- # kill -0 3196123 00:08:20.436 05:04:21 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:20.436 05:04:21 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:20.436 05:04:21 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:20.436 05:04:21 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:20.436 00:08:20.436 real 0m3.372s 00:08:20.436 user 0m0.015s 00:08:20.436 sys 0m0.061s 00:08:20.436 05:04:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:20.436 05:04:21 -- common/autotest_common.sh@10 -- # set +x 00:08:20.436 ************************************ 00:08:20.436 END TEST filesystem_xfs 00:08:20.436 ************************************ 00:08:20.436 05:04:21 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:20.436 05:04:21 -- target/filesystem.sh@93 -- # sync 00:08:20.436 05:04:21 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:20.436 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:20.436 05:04:22 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:20.436 05:04:22 -- common/autotest_common.sh@1208 -- # local i=0 00:08:20.436 05:04:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:20.436 05:04:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:20.436 05:04:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:20.436 05:04:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:20.436 05:04:22 -- common/autotest_common.sh@1220 -- # return 0 00:08:20.436 05:04:22 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:20.436 05:04:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:20.436 05:04:22 -- common/autotest_common.sh@10 -- # set +x 00:08:20.436 05:04:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:20.436 05:04:22 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:20.436 05:04:22 -- target/filesystem.sh@101 -- # killprocess 3196123 00:08:20.436 05:04:22 -- common/autotest_common.sh@936 -- # '[' -z 3196123 ']' 00:08:20.436 05:04:22 -- common/autotest_common.sh@940 -- # kill -0 3196123 00:08:20.436 05:04:22 -- common/autotest_common.sh@941 -- # uname 00:08:20.436 05:04:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:20.436 05:04:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3196123 00:08:20.436 05:04:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:20.436 05:04:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:20.436 05:04:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3196123' 00:08:20.436 killing process with pid 3196123 00:08:20.436 05:04:22 -- common/autotest_common.sh@955 -- # kill 3196123 00:08:20.436 05:04:22 -- common/autotest_common.sh@960 -- # wait 3196123 00:08:21.006 05:04:22 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:21.006 00:08:21.006 real 0m16.860s 00:08:21.006 user 1m5.255s 00:08:21.006 sys 0m2.149s 00:08:21.006 05:04:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:21.006 05:04:22 -- common/autotest_common.sh@10 -- # set +x 00:08:21.006 ************************************ 00:08:21.006 END TEST nvmf_filesystem_no_in_capsule 00:08:21.006 ************************************ 00:08:21.006 05:04:22 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:21.006 05:04:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:21.006 05:04:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:21.006 05:04:22 -- common/autotest_common.sh@10 -- # set +x 00:08:21.006 ************************************ 00:08:21.006 START TEST nvmf_filesystem_in_capsule 00:08:21.006 ************************************ 00:08:21.006 05:04:22 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:21.006 05:04:22 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:21.006 05:04:22 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:21.006 05:04:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:21.006 05:04:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:21.006 05:04:22 -- common/autotest_common.sh@10 -- # set +x 00:08:21.006 05:04:22 -- nvmf/common.sh@469 -- # nvmfpid=3198409 00:08:21.006 05:04:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:21.006 05:04:22 -- nvmf/common.sh@470 -- # waitforlisten 3198409 00:08:21.006 05:04:22 -- common/autotest_common.sh@829 -- # '[' -z 3198409 ']' 00:08:21.006 05:04:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:21.006 05:04:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:21.006 05:04:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:21.006 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:21.006 05:04:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:21.006 05:04:22 -- common/autotest_common.sh@10 -- # set +x 00:08:21.006 [2024-11-26 05:04:22.622181] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:21.006 [2024-11-26 05:04:22.622256] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:21.006 EAL: No free 2048 kB hugepages reported on node 1 00:08:21.006 [2024-11-26 05:04:22.691985] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:21.264 [2024-11-26 05:04:22.780177] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:21.264 [2024-11-26 05:04:22.780349] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:21.264 [2024-11-26 05:04:22.780369] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:21.264 [2024-11-26 05:04:22.780384] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:21.264 [2024-11-26 05:04:22.780447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:21.264 [2024-11-26 05:04:22.780505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:21.264 [2024-11-26 05:04:22.780620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:21.264 [2024-11-26 05:04:22.780623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:22.203 05:04:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:22.203 05:04:23 -- common/autotest_common.sh@862 -- # return 0 00:08:22.203 05:04:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:22.203 05:04:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:22.203 05:04:23 -- common/autotest_common.sh@10 -- # set +x 00:08:22.203 05:04:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:22.203 05:04:23 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:22.203 05:04:23 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:22.203 05:04:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:22.203 05:04:23 -- common/autotest_common.sh@10 -- # set +x 00:08:22.203 [2024-11-26 05:04:23.644484] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:22.203 05:04:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:22.203 05:04:23 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:22.203 05:04:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:22.203 05:04:23 -- common/autotest_common.sh@10 -- # set +x 00:08:22.203 Malloc1 00:08:22.203 05:04:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:22.203 05:04:23 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:22.203 05:04:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:22.203 05:04:23 -- common/autotest_common.sh@10 -- # set +x 00:08:22.203 05:04:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:22.203 05:04:23 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:22.203 05:04:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:22.203 05:04:23 -- common/autotest_common.sh@10 -- # set +x 00:08:22.203 05:04:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:22.203 05:04:23 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:22.203 05:04:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:22.203 05:04:23 -- common/autotest_common.sh@10 -- # set +x 00:08:22.203 [2024-11-26 05:04:23.825258] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:22.203 05:04:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:22.203 05:04:23 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:22.203 05:04:23 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:22.203 05:04:23 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:22.203 05:04:23 -- common/autotest_common.sh@1369 -- # local bs 00:08:22.203 05:04:23 -- common/autotest_common.sh@1370 -- # local nb 00:08:22.203 05:04:23 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:22.203 05:04:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:22.203 05:04:23 -- common/autotest_common.sh@10 -- # set +x 00:08:22.203 05:04:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:22.203 05:04:23 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:22.203 { 00:08:22.203 "name": "Malloc1", 00:08:22.203 "aliases": [ 00:08:22.203 "8632691c-24cf-4efd-8cab-1dc906d6f8d4" 00:08:22.203 ], 00:08:22.203 "product_name": "Malloc disk", 00:08:22.203 "block_size": 512, 00:08:22.203 "num_blocks": 1048576, 00:08:22.203 "uuid": "8632691c-24cf-4efd-8cab-1dc906d6f8d4", 00:08:22.203 "assigned_rate_limits": { 00:08:22.203 "rw_ios_per_sec": 0, 00:08:22.203 "rw_mbytes_per_sec": 0, 00:08:22.203 "r_mbytes_per_sec": 0, 00:08:22.203 "w_mbytes_per_sec": 0 00:08:22.203 }, 00:08:22.203 "claimed": true, 00:08:22.203 "claim_type": "exclusive_write", 00:08:22.203 "zoned": false, 00:08:22.203 "supported_io_types": { 00:08:22.203 "read": true, 00:08:22.203 "write": true, 00:08:22.203 "unmap": true, 00:08:22.203 "write_zeroes": true, 00:08:22.203 "flush": true, 00:08:22.203 "reset": true, 00:08:22.203 "compare": false, 00:08:22.203 "compare_and_write": false, 00:08:22.203 "abort": true, 00:08:22.203 "nvme_admin": false, 00:08:22.203 "nvme_io": false 00:08:22.203 }, 00:08:22.203 "memory_domains": [ 00:08:22.203 { 00:08:22.203 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:22.203 "dma_device_type": 2 00:08:22.203 } 00:08:22.203 ], 00:08:22.203 "driver_specific": {} 00:08:22.203 } 00:08:22.203 ]' 00:08:22.203 05:04:23 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:22.203 05:04:23 -- common/autotest_common.sh@1372 -- # bs=512 00:08:22.203 05:04:23 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:22.203 05:04:23 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:22.203 05:04:23 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:22.203 05:04:23 -- common/autotest_common.sh@1377 -- # echo 512 00:08:22.203 05:04:23 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:22.203 05:04:23 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:22.772 05:04:24 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:22.772 05:04:24 -- common/autotest_common.sh@1187 -- # local i=0 00:08:22.772 05:04:24 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:22.772 05:04:24 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:22.772 05:04:24 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:25.310 05:04:26 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:25.310 05:04:26 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:25.310 05:04:26 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:25.310 05:04:26 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:25.310 05:04:26 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:25.310 05:04:26 -- common/autotest_common.sh@1197 -- # return 0 00:08:25.310 05:04:26 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:25.310 05:04:26 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:25.310 05:04:26 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:25.310 05:04:26 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:25.310 05:04:26 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:25.310 05:04:26 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:25.310 05:04:26 -- setup/common.sh@80 -- # echo 536870912 00:08:25.310 05:04:26 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:25.310 05:04:26 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:25.310 05:04:26 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:25.310 05:04:26 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:25.310 05:04:26 -- target/filesystem.sh@69 -- # partprobe 00:08:25.877 05:04:27 -- target/filesystem.sh@70 -- # sleep 1 00:08:27.257 05:04:28 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:27.257 05:04:28 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:27.257 05:04:28 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:27.257 05:04:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:27.257 05:04:28 -- common/autotest_common.sh@10 -- # set +x 00:08:27.257 ************************************ 00:08:27.257 START TEST filesystem_in_capsule_ext4 00:08:27.257 ************************************ 00:08:27.257 05:04:28 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:27.257 05:04:28 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:27.257 05:04:28 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:27.257 05:04:28 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:27.257 05:04:28 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:27.257 05:04:28 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:27.257 05:04:28 -- common/autotest_common.sh@914 -- # local i=0 00:08:27.257 05:04:28 -- common/autotest_common.sh@915 -- # local force 00:08:27.257 05:04:28 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:27.257 05:04:28 -- common/autotest_common.sh@918 -- # force=-F 00:08:27.257 05:04:28 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:27.257 mke2fs 1.47.0 (5-Feb-2023) 00:08:27.257 Discarding device blocks: 0/522240 done 00:08:27.257 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:27.257 Filesystem UUID: bd47947a-4b85-48d5-9052-62c44db8fa9d 00:08:27.257 Superblock backups stored on blocks: 00:08:27.257 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:27.257 00:08:27.257 Allocating group tables: 0/64 done 00:08:27.257 Writing inode tables: 0/64 done 00:08:27.257 Creating journal (8192 blocks): done 00:08:29.586 Writing superblocks and filesystem accounting information: 0/6428/64 done 00:08:29.586 00:08:29.586 05:04:31 -- common/autotest_common.sh@931 -- # return 0 00:08:29.586 05:04:31 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:36.253 05:04:36 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:36.253 05:04:36 -- target/filesystem.sh@25 -- # sync 00:08:36.253 05:04:36 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:36.253 05:04:36 -- target/filesystem.sh@27 -- # sync 00:08:36.253 05:04:36 -- target/filesystem.sh@29 -- # i=0 00:08:36.253 05:04:36 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:36.253 05:04:36 -- target/filesystem.sh@37 -- # kill -0 3198409 00:08:36.253 05:04:36 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:36.253 05:04:36 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:36.253 05:04:36 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:36.253 05:04:36 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:36.253 00:08:36.253 real 0m8.317s 00:08:36.253 user 0m0.022s 00:08:36.253 sys 0m0.063s 00:08:36.253 05:04:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:36.253 05:04:36 -- common/autotest_common.sh@10 -- # set +x 00:08:36.253 ************************************ 00:08:36.253 END TEST filesystem_in_capsule_ext4 00:08:36.253 ************************************ 00:08:36.253 05:04:36 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:36.253 05:04:36 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:36.253 05:04:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:36.253 05:04:36 -- common/autotest_common.sh@10 -- # set +x 00:08:36.253 ************************************ 00:08:36.253 START TEST filesystem_in_capsule_btrfs 00:08:36.253 ************************************ 00:08:36.253 05:04:36 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:36.253 05:04:36 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:36.253 05:04:36 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:36.253 05:04:36 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:36.253 05:04:36 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:36.253 05:04:36 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:36.253 05:04:36 -- common/autotest_common.sh@914 -- # local i=0 00:08:36.253 05:04:36 -- common/autotest_common.sh@915 -- # local force 00:08:36.253 05:04:36 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:36.253 05:04:36 -- common/autotest_common.sh@920 -- # force=-f 00:08:36.253 05:04:36 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:36.253 btrfs-progs v6.8.1 00:08:36.253 See https://btrfs.readthedocs.io for more information. 00:08:36.253 00:08:36.253 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:36.253 NOTE: several default settings have changed in version 5.15, please make sure 00:08:36.253 this does not affect your deployments: 00:08:36.253 - DUP for metadata (-m dup) 00:08:36.253 - enabled no-holes (-O no-holes) 00:08:36.253 - enabled free-space-tree (-R free-space-tree) 00:08:36.253 00:08:36.253 Label: (null) 00:08:36.253 UUID: 6d52835b-9d59-46b5-b28e-e60b262c5ec7 00:08:36.253 Node size: 16384 00:08:36.253 Sector size: 4096 (CPU page size: 4096) 00:08:36.253 Filesystem size: 510.00MiB 00:08:36.253 Block group profiles: 00:08:36.253 Data: single 8.00MiB 00:08:36.253 Metadata: DUP 32.00MiB 00:08:36.253 System: DUP 8.00MiB 00:08:36.253 SSD detected: yes 00:08:36.253 Zoned device: no 00:08:36.253 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:36.253 Checksum: crc32c 00:08:36.253 Number of devices: 1 00:08:36.253 Devices: 00:08:36.253 ID SIZE PATH 00:08:36.253 1 510.00MiB /dev/nvme0n1p1 00:08:36.253 00:08:36.253 05:04:37 -- common/autotest_common.sh@931 -- # return 0 00:08:36.253 05:04:37 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:36.512 05:04:38 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:36.512 05:04:38 -- target/filesystem.sh@25 -- # sync 00:08:36.512 05:04:38 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:36.512 05:04:38 -- target/filesystem.sh@27 -- # sync 00:08:36.512 05:04:38 -- target/filesystem.sh@29 -- # i=0 00:08:36.512 05:04:38 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:36.512 05:04:38 -- target/filesystem.sh@37 -- # kill -0 3198409 00:08:36.512 05:04:38 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:36.512 05:04:38 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:36.512 05:04:38 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:36.512 05:04:38 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:36.512 00:08:36.512 real 0m1.254s 00:08:36.512 user 0m0.015s 00:08:36.512 sys 0m0.110s 00:08:36.512 05:04:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:36.512 05:04:38 -- common/autotest_common.sh@10 -- # set +x 00:08:36.512 ************************************ 00:08:36.512 END TEST filesystem_in_capsule_btrfs 00:08:36.512 ************************************ 00:08:36.512 05:04:38 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:36.512 05:04:38 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:36.512 05:04:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:36.512 05:04:38 -- common/autotest_common.sh@10 -- # set +x 00:08:36.512 ************************************ 00:08:36.512 START TEST filesystem_in_capsule_xfs 00:08:36.512 ************************************ 00:08:36.512 05:04:38 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:36.512 05:04:38 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:36.512 05:04:38 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:36.512 05:04:38 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:36.512 05:04:38 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:36.512 05:04:38 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:36.512 05:04:38 -- common/autotest_common.sh@914 -- # local i=0 00:08:36.512 05:04:38 -- common/autotest_common.sh@915 -- # local force 00:08:36.512 05:04:38 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:36.512 05:04:38 -- common/autotest_common.sh@920 -- # force=-f 00:08:36.512 05:04:38 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:36.770 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:36.770 = sectsz=512 attr=2, projid32bit=1 00:08:36.770 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:36.770 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:36.770 data = bsize=4096 blocks=130560, imaxpct=25 00:08:36.770 = sunit=0 swidth=0 blks 00:08:36.770 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:36.770 log =internal log bsize=4096 blocks=16384, version=2 00:08:36.770 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:36.770 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:37.335 Discarding blocks...Done. 00:08:37.335 05:04:39 -- common/autotest_common.sh@931 -- # return 0 00:08:37.335 05:04:39 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:39.868 05:04:41 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:39.868 05:04:41 -- target/filesystem.sh@25 -- # sync 00:08:39.868 05:04:41 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:39.868 05:04:41 -- target/filesystem.sh@27 -- # sync 00:08:39.868 05:04:41 -- target/filesystem.sh@29 -- # i=0 00:08:39.868 05:04:41 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:39.868 05:04:41 -- target/filesystem.sh@37 -- # kill -0 3198409 00:08:39.868 05:04:41 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:39.868 05:04:41 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:39.868 05:04:41 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:39.868 05:04:41 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:39.868 00:08:39.868 real 0m2.973s 00:08:39.868 user 0m0.019s 00:08:39.868 sys 0m0.057s 00:08:39.868 05:04:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:39.868 05:04:41 -- common/autotest_common.sh@10 -- # set +x 00:08:39.868 ************************************ 00:08:39.868 END TEST filesystem_in_capsule_xfs 00:08:39.868 ************************************ 00:08:39.868 05:04:41 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:39.868 05:04:41 -- target/filesystem.sh@93 -- # sync 00:08:39.868 05:04:41 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:39.868 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.868 05:04:41 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:39.868 05:04:41 -- common/autotest_common.sh@1208 -- # local i=0 00:08:39.868 05:04:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:39.868 05:04:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:40.128 05:04:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:40.128 05:04:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:40.128 05:04:41 -- common/autotest_common.sh@1220 -- # return 0 00:08:40.128 05:04:41 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:40.128 05:04:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:40.128 05:04:41 -- common/autotest_common.sh@10 -- # set +x 00:08:40.128 05:04:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:40.128 05:04:41 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:40.128 05:04:41 -- target/filesystem.sh@101 -- # killprocess 3198409 00:08:40.128 05:04:41 -- common/autotest_common.sh@936 -- # '[' -z 3198409 ']' 00:08:40.128 05:04:41 -- common/autotest_common.sh@940 -- # kill -0 3198409 00:08:40.128 05:04:41 -- common/autotest_common.sh@941 -- # uname 00:08:40.128 05:04:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:40.128 05:04:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3198409 00:08:40.128 05:04:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:40.128 05:04:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:40.128 05:04:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3198409' 00:08:40.128 killing process with pid 3198409 00:08:40.128 05:04:41 -- common/autotest_common.sh@955 -- # kill 3198409 00:08:40.128 05:04:41 -- common/autotest_common.sh@960 -- # wait 3198409 00:08:40.388 05:04:42 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:40.388 00:08:40.388 real 0m19.579s 00:08:40.388 user 1m15.963s 00:08:40.388 sys 0m2.330s 00:08:40.388 05:04:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:40.388 05:04:42 -- common/autotest_common.sh@10 -- # set +x 00:08:40.388 ************************************ 00:08:40.388 END TEST nvmf_filesystem_in_capsule 00:08:40.388 ************************************ 00:08:40.646 05:04:42 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:40.646 05:04:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:40.646 05:04:42 -- nvmf/common.sh@116 -- # sync 00:08:40.646 05:04:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:40.646 05:04:42 -- nvmf/common.sh@119 -- # set +e 00:08:40.646 05:04:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:40.646 05:04:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:40.646 rmmod nvme_tcp 00:08:40.646 rmmod nvme_fabrics 00:08:40.646 rmmod nvme_keyring 00:08:40.646 05:04:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:40.646 05:04:42 -- nvmf/common.sh@123 -- # set -e 00:08:40.646 05:04:42 -- nvmf/common.sh@124 -- # return 0 00:08:40.646 05:04:42 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:40.646 05:04:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:40.646 05:04:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:40.646 05:04:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:40.646 05:04:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:40.646 05:04:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:40.646 05:04:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:40.646 05:04:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:40.646 05:04:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:42.557 05:04:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:42.557 00:08:42.557 real 0m41.048s 00:08:42.557 user 2m22.223s 00:08:42.557 sys 0m6.076s 00:08:42.557 05:04:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:42.557 05:04:44 -- common/autotest_common.sh@10 -- # set +x 00:08:42.557 ************************************ 00:08:42.557 END TEST nvmf_filesystem 00:08:42.557 ************************************ 00:08:42.557 05:04:44 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:42.557 05:04:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:42.557 05:04:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:42.557 05:04:44 -- common/autotest_common.sh@10 -- # set +x 00:08:42.557 ************************************ 00:08:42.557 START TEST nvmf_discovery 00:08:42.557 ************************************ 00:08:42.557 05:04:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:42.816 * Looking for test storage... 00:08:42.816 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:42.816 05:04:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:42.816 05:04:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:42.816 05:04:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:42.816 05:04:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:42.816 05:04:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:42.816 05:04:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:42.816 05:04:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:42.816 05:04:44 -- scripts/common.sh@335 -- # IFS=.-: 00:08:42.816 05:04:44 -- scripts/common.sh@335 -- # read -ra ver1 00:08:42.816 05:04:44 -- scripts/common.sh@336 -- # IFS=.-: 00:08:42.816 05:04:44 -- scripts/common.sh@336 -- # read -ra ver2 00:08:42.816 05:04:44 -- scripts/common.sh@337 -- # local 'op=<' 00:08:42.816 05:04:44 -- scripts/common.sh@339 -- # ver1_l=2 00:08:42.816 05:04:44 -- scripts/common.sh@340 -- # ver2_l=1 00:08:42.816 05:04:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:42.816 05:04:44 -- scripts/common.sh@343 -- # case "$op" in 00:08:42.816 05:04:44 -- scripts/common.sh@344 -- # : 1 00:08:42.816 05:04:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:42.816 05:04:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:42.816 05:04:44 -- scripts/common.sh@364 -- # decimal 1 00:08:42.816 05:04:44 -- scripts/common.sh@352 -- # local d=1 00:08:42.816 05:04:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:42.816 05:04:44 -- scripts/common.sh@354 -- # echo 1 00:08:42.816 05:04:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:42.816 05:04:44 -- scripts/common.sh@365 -- # decimal 2 00:08:42.816 05:04:44 -- scripts/common.sh@352 -- # local d=2 00:08:42.816 05:04:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:42.816 05:04:44 -- scripts/common.sh@354 -- # echo 2 00:08:42.816 05:04:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:42.816 05:04:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:42.816 05:04:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:42.816 05:04:44 -- scripts/common.sh@367 -- # return 0 00:08:42.816 05:04:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:42.816 05:04:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:42.816 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:42.816 --rc genhtml_branch_coverage=1 00:08:42.816 --rc genhtml_function_coverage=1 00:08:42.816 --rc genhtml_legend=1 00:08:42.816 --rc geninfo_all_blocks=1 00:08:42.816 --rc geninfo_unexecuted_blocks=1 00:08:42.816 00:08:42.816 ' 00:08:42.816 05:04:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:42.816 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:42.816 --rc genhtml_branch_coverage=1 00:08:42.816 --rc genhtml_function_coverage=1 00:08:42.816 --rc genhtml_legend=1 00:08:42.816 --rc geninfo_all_blocks=1 00:08:42.816 --rc geninfo_unexecuted_blocks=1 00:08:42.816 00:08:42.816 ' 00:08:42.816 05:04:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:42.816 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:42.816 --rc genhtml_branch_coverage=1 00:08:42.816 --rc genhtml_function_coverage=1 00:08:42.816 --rc genhtml_legend=1 00:08:42.816 --rc geninfo_all_blocks=1 00:08:42.816 --rc geninfo_unexecuted_blocks=1 00:08:42.816 00:08:42.816 ' 00:08:42.816 05:04:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:42.816 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:42.816 --rc genhtml_branch_coverage=1 00:08:42.816 --rc genhtml_function_coverage=1 00:08:42.816 --rc genhtml_legend=1 00:08:42.816 --rc geninfo_all_blocks=1 00:08:42.816 --rc geninfo_unexecuted_blocks=1 00:08:42.816 00:08:42.816 ' 00:08:42.816 05:04:44 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:42.816 05:04:44 -- nvmf/common.sh@7 -- # uname -s 00:08:42.817 05:04:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:42.817 05:04:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:42.817 05:04:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:42.817 05:04:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:42.817 05:04:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:42.817 05:04:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:42.817 05:04:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:42.817 05:04:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:42.817 05:04:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:42.817 05:04:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:42.817 05:04:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:42.817 05:04:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:42.817 05:04:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:42.817 05:04:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:42.817 05:04:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:42.817 05:04:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:42.817 05:04:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:42.817 05:04:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:42.817 05:04:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:42.817 05:04:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.817 05:04:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.817 05:04:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.817 05:04:44 -- paths/export.sh@5 -- # export PATH 00:08:42.817 05:04:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.817 05:04:44 -- nvmf/common.sh@46 -- # : 0 00:08:42.817 05:04:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:42.817 05:04:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:42.817 05:04:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:42.817 05:04:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:42.817 05:04:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:42.817 05:04:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:42.817 05:04:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:42.817 05:04:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:42.817 05:04:44 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:42.817 05:04:44 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:42.817 05:04:44 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:42.817 05:04:44 -- target/discovery.sh@15 -- # hash nvme 00:08:42.817 05:04:44 -- target/discovery.sh@20 -- # nvmftestinit 00:08:42.817 05:04:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:42.817 05:04:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:42.817 05:04:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:42.817 05:04:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:42.817 05:04:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:42.817 05:04:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:42.817 05:04:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:42.817 05:04:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:42.817 05:04:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:42.817 05:04:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:42.817 05:04:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:42.817 05:04:44 -- common/autotest_common.sh@10 -- # set +x 00:08:45.354 05:04:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:45.354 05:04:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:45.354 05:04:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:45.354 05:04:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:45.354 05:04:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:45.354 05:04:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:45.354 05:04:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:45.354 05:04:46 -- nvmf/common.sh@294 -- # net_devs=() 00:08:45.354 05:04:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:45.354 05:04:46 -- nvmf/common.sh@295 -- # e810=() 00:08:45.354 05:04:46 -- nvmf/common.sh@295 -- # local -ga e810 00:08:45.354 05:04:46 -- nvmf/common.sh@296 -- # x722=() 00:08:45.354 05:04:46 -- nvmf/common.sh@296 -- # local -ga x722 00:08:45.354 05:04:46 -- nvmf/common.sh@297 -- # mlx=() 00:08:45.354 05:04:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:45.354 05:04:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:45.354 05:04:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:45.354 05:04:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:45.354 05:04:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:45.354 05:04:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:45.354 05:04:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:45.354 05:04:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:45.354 05:04:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:45.354 05:04:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:45.354 05:04:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:45.354 05:04:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:45.354 05:04:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:45.354 05:04:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:45.354 05:04:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:45.354 05:04:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:45.354 05:04:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:45.354 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:45.354 05:04:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:45.354 05:04:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:45.354 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:45.354 05:04:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:45.354 05:04:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:45.354 05:04:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:45.354 05:04:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:45.354 05:04:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:45.354 05:04:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:45.354 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:45.354 05:04:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:45.354 05:04:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:45.354 05:04:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:45.354 05:04:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:45.354 05:04:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:45.354 05:04:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:45.354 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:45.354 05:04:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:45.354 05:04:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:45.354 05:04:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:45.354 05:04:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:45.354 05:04:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:45.354 05:04:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:45.354 05:04:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:45.354 05:04:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:45.354 05:04:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:45.354 05:04:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:45.354 05:04:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:45.354 05:04:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:45.354 05:04:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:45.354 05:04:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:45.354 05:04:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:45.354 05:04:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:45.354 05:04:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:45.355 05:04:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:45.355 05:04:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:45.355 05:04:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:45.355 05:04:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:45.355 05:04:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:45.355 05:04:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:45.355 05:04:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:45.355 05:04:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:45.355 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:45.355 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.457 ms 00:08:45.355 00:08:45.355 --- 10.0.0.2 ping statistics --- 00:08:45.355 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:45.355 rtt min/avg/max/mdev = 0.457/0.457/0.457/0.000 ms 00:08:45.355 05:04:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:45.355 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:45.355 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:08:45.355 00:08:45.355 --- 10.0.0.1 ping statistics --- 00:08:45.355 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:45.355 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:08:45.355 05:04:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:45.355 05:04:46 -- nvmf/common.sh@410 -- # return 0 00:08:45.355 05:04:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:45.355 05:04:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:45.355 05:04:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:45.355 05:04:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:45.355 05:04:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:45.355 05:04:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:45.355 05:04:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:45.355 05:04:46 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:45.355 05:04:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:45.355 05:04:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:45.355 05:04:46 -- common/autotest_common.sh@10 -- # set +x 00:08:45.355 05:04:46 -- nvmf/common.sh@469 -- # nvmfpid=3202918 00:08:45.355 05:04:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:45.355 05:04:46 -- nvmf/common.sh@470 -- # waitforlisten 3202918 00:08:45.355 05:04:46 -- common/autotest_common.sh@829 -- # '[' -z 3202918 ']' 00:08:45.355 05:04:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:45.355 05:04:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:45.355 05:04:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:45.355 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:45.355 05:04:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:45.355 05:04:46 -- common/autotest_common.sh@10 -- # set +x 00:08:45.355 [2024-11-26 05:04:46.777367] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:45.355 [2024-11-26 05:04:46.777464] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:45.355 EAL: No free 2048 kB hugepages reported on node 1 00:08:45.355 [2024-11-26 05:04:46.857985] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:45.355 [2024-11-26 05:04:46.955254] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:45.355 [2024-11-26 05:04:46.955428] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:45.355 [2024-11-26 05:04:46.955447] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:45.355 [2024-11-26 05:04:46.955460] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:45.355 [2024-11-26 05:04:46.955518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:45.355 [2024-11-26 05:04:46.955553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:45.355 [2024-11-26 05:04:46.955607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:45.355 [2024-11-26 05:04:46.955612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:46.293 05:04:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:46.293 05:04:47 -- common/autotest_common.sh@862 -- # return 0 00:08:46.293 05:04:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:46.293 05:04:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 05:04:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:46.293 05:04:47 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 [2024-11-26 05:04:47.844516] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@26 -- # seq 1 4 00:08:46.293 05:04:47 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:46.293 05:04:47 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 Null1 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 [2024-11-26 05:04:47.884901] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:46.293 05:04:47 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 Null2 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:46.293 05:04:47 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 Null3 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:46.293 05:04:47 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 Null4 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:46.293 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.293 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.293 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.293 05:04:47 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:46.294 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.294 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.294 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.294 05:04:47 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:46.294 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.294 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.294 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.294 05:04:47 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:46.294 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.294 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.294 05:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.294 05:04:47 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:46.294 05:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.294 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:08:46.294 05:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.294 05:04:48 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:46.554 00:08:46.554 Discovery Log Number of Records 6, Generation counter 6 00:08:46.554 =====Discovery Log Entry 0====== 00:08:46.554 trtype: tcp 00:08:46.554 adrfam: ipv4 00:08:46.554 subtype: current discovery subsystem 00:08:46.554 treq: not required 00:08:46.554 portid: 0 00:08:46.554 trsvcid: 4420 00:08:46.554 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:46.554 traddr: 10.0.0.2 00:08:46.554 eflags: explicit discovery connections, duplicate discovery information 00:08:46.554 sectype: none 00:08:46.554 =====Discovery Log Entry 1====== 00:08:46.554 trtype: tcp 00:08:46.554 adrfam: ipv4 00:08:46.554 subtype: nvme subsystem 00:08:46.554 treq: not required 00:08:46.554 portid: 0 00:08:46.554 trsvcid: 4420 00:08:46.554 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:46.554 traddr: 10.0.0.2 00:08:46.554 eflags: none 00:08:46.554 sectype: none 00:08:46.554 =====Discovery Log Entry 2====== 00:08:46.554 trtype: tcp 00:08:46.554 adrfam: ipv4 00:08:46.554 subtype: nvme subsystem 00:08:46.554 treq: not required 00:08:46.554 portid: 0 00:08:46.554 trsvcid: 4420 00:08:46.554 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:46.554 traddr: 10.0.0.2 00:08:46.554 eflags: none 00:08:46.554 sectype: none 00:08:46.554 =====Discovery Log Entry 3====== 00:08:46.554 trtype: tcp 00:08:46.554 adrfam: ipv4 00:08:46.554 subtype: nvme subsystem 00:08:46.554 treq: not required 00:08:46.554 portid: 0 00:08:46.554 trsvcid: 4420 00:08:46.554 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:46.554 traddr: 10.0.0.2 00:08:46.554 eflags: none 00:08:46.554 sectype: none 00:08:46.554 =====Discovery Log Entry 4====== 00:08:46.554 trtype: tcp 00:08:46.554 adrfam: ipv4 00:08:46.554 subtype: nvme subsystem 00:08:46.554 treq: not required 00:08:46.554 portid: 0 00:08:46.554 trsvcid: 4420 00:08:46.554 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:46.554 traddr: 10.0.0.2 00:08:46.554 eflags: none 00:08:46.554 sectype: none 00:08:46.554 =====Discovery Log Entry 5====== 00:08:46.554 trtype: tcp 00:08:46.554 adrfam: ipv4 00:08:46.554 subtype: discovery subsystem referral 00:08:46.554 treq: not required 00:08:46.554 portid: 0 00:08:46.554 trsvcid: 4430 00:08:46.554 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:46.554 traddr: 10.0.0.2 00:08:46.554 eflags: none 00:08:46.554 sectype: none 00:08:46.554 05:04:48 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:46.554 Perform nvmf subsystem discovery via RPC 00:08:46.554 05:04:48 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:46.554 05:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.554 05:04:48 -- common/autotest_common.sh@10 -- # set +x 00:08:46.554 [2024-11-26 05:04:48.225761] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:46.554 [ 00:08:46.554 { 00:08:46.554 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:46.554 "subtype": "Discovery", 00:08:46.554 "listen_addresses": [ 00:08:46.554 { 00:08:46.554 "transport": "TCP", 00:08:46.554 "trtype": "TCP", 00:08:46.554 "adrfam": "IPv4", 00:08:46.554 "traddr": "10.0.0.2", 00:08:46.554 "trsvcid": "4420" 00:08:46.554 } 00:08:46.554 ], 00:08:46.554 "allow_any_host": true, 00:08:46.554 "hosts": [] 00:08:46.554 }, 00:08:46.554 { 00:08:46.554 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:46.554 "subtype": "NVMe", 00:08:46.554 "listen_addresses": [ 00:08:46.554 { 00:08:46.554 "transport": "TCP", 00:08:46.554 "trtype": "TCP", 00:08:46.554 "adrfam": "IPv4", 00:08:46.554 "traddr": "10.0.0.2", 00:08:46.554 "trsvcid": "4420" 00:08:46.555 } 00:08:46.555 ], 00:08:46.555 "allow_any_host": true, 00:08:46.555 "hosts": [], 00:08:46.555 "serial_number": "SPDK00000000000001", 00:08:46.555 "model_number": "SPDK bdev Controller", 00:08:46.555 "max_namespaces": 32, 00:08:46.555 "min_cntlid": 1, 00:08:46.555 "max_cntlid": 65519, 00:08:46.555 "namespaces": [ 00:08:46.555 { 00:08:46.555 "nsid": 1, 00:08:46.555 "bdev_name": "Null1", 00:08:46.555 "name": "Null1", 00:08:46.555 "nguid": "47810931AEE04182BF7DB0934DEA3AB3", 00:08:46.555 "uuid": "47810931-aee0-4182-bf7d-b0934dea3ab3" 00:08:46.555 } 00:08:46.555 ] 00:08:46.555 }, 00:08:46.555 { 00:08:46.555 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:46.555 "subtype": "NVMe", 00:08:46.555 "listen_addresses": [ 00:08:46.555 { 00:08:46.555 "transport": "TCP", 00:08:46.555 "trtype": "TCP", 00:08:46.555 "adrfam": "IPv4", 00:08:46.555 "traddr": "10.0.0.2", 00:08:46.555 "trsvcid": "4420" 00:08:46.555 } 00:08:46.555 ], 00:08:46.555 "allow_any_host": true, 00:08:46.555 "hosts": [], 00:08:46.555 "serial_number": "SPDK00000000000002", 00:08:46.555 "model_number": "SPDK bdev Controller", 00:08:46.555 "max_namespaces": 32, 00:08:46.555 "min_cntlid": 1, 00:08:46.555 "max_cntlid": 65519, 00:08:46.555 "namespaces": [ 00:08:46.555 { 00:08:46.555 "nsid": 1, 00:08:46.555 "bdev_name": "Null2", 00:08:46.555 "name": "Null2", 00:08:46.555 "nguid": "99FA4086BB61495DB635A7B938D0E763", 00:08:46.555 "uuid": "99fa4086-bb61-495d-b635-a7b938d0e763" 00:08:46.555 } 00:08:46.555 ] 00:08:46.555 }, 00:08:46.555 { 00:08:46.555 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:46.555 "subtype": "NVMe", 00:08:46.555 "listen_addresses": [ 00:08:46.555 { 00:08:46.555 "transport": "TCP", 00:08:46.555 "trtype": "TCP", 00:08:46.555 "adrfam": "IPv4", 00:08:46.555 "traddr": "10.0.0.2", 00:08:46.555 "trsvcid": "4420" 00:08:46.555 } 00:08:46.555 ], 00:08:46.555 "allow_any_host": true, 00:08:46.555 "hosts": [], 00:08:46.555 "serial_number": "SPDK00000000000003", 00:08:46.555 "model_number": "SPDK bdev Controller", 00:08:46.555 "max_namespaces": 32, 00:08:46.555 "min_cntlid": 1, 00:08:46.555 "max_cntlid": 65519, 00:08:46.555 "namespaces": [ 00:08:46.555 { 00:08:46.555 "nsid": 1, 00:08:46.555 "bdev_name": "Null3", 00:08:46.555 "name": "Null3", 00:08:46.555 "nguid": "EB341958A25C42AEB1F62F746B2E9F03", 00:08:46.555 "uuid": "eb341958-a25c-42ae-b1f6-2f746b2e9f03" 00:08:46.555 } 00:08:46.555 ] 00:08:46.555 }, 00:08:46.555 { 00:08:46.555 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:46.555 "subtype": "NVMe", 00:08:46.555 "listen_addresses": [ 00:08:46.555 { 00:08:46.555 "transport": "TCP", 00:08:46.555 "trtype": "TCP", 00:08:46.555 "adrfam": "IPv4", 00:08:46.555 "traddr": "10.0.0.2", 00:08:46.555 "trsvcid": "4420" 00:08:46.555 } 00:08:46.555 ], 00:08:46.555 "allow_any_host": true, 00:08:46.555 "hosts": [], 00:08:46.555 "serial_number": "SPDK00000000000004", 00:08:46.555 "model_number": "SPDK bdev Controller", 00:08:46.555 "max_namespaces": 32, 00:08:46.555 "min_cntlid": 1, 00:08:46.555 "max_cntlid": 65519, 00:08:46.555 "namespaces": [ 00:08:46.555 { 00:08:46.555 "nsid": 1, 00:08:46.555 "bdev_name": "Null4", 00:08:46.555 "name": "Null4", 00:08:46.555 "nguid": "E435482BB89847BF95FAC9DF076D997C", 00:08:46.555 "uuid": "e435482b-b898-47bf-95fa-c9df076d997c" 00:08:46.555 } 00:08:46.555 ] 00:08:46.555 } 00:08:46.555 ] 00:08:46.555 05:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.555 05:04:48 -- target/discovery.sh@42 -- # seq 1 4 00:08:46.555 05:04:48 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:46.555 05:04:48 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:46.555 05:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.555 05:04:48 -- common/autotest_common.sh@10 -- # set +x 00:08:46.555 05:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.555 05:04:48 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:46.555 05:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.555 05:04:48 -- common/autotest_common.sh@10 -- # set +x 00:08:46.555 05:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.555 05:04:48 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:46.555 05:04:48 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:46.555 05:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.555 05:04:48 -- common/autotest_common.sh@10 -- # set +x 00:08:46.555 05:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.555 05:04:48 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:46.555 05:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.555 05:04:48 -- common/autotest_common.sh@10 -- # set +x 00:08:46.555 05:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.555 05:04:48 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:46.555 05:04:48 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:46.555 05:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.555 05:04:48 -- common/autotest_common.sh@10 -- # set +x 00:08:46.555 05:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.555 05:04:48 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:46.555 05:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.555 05:04:48 -- common/autotest_common.sh@10 -- # set +x 00:08:46.555 05:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.555 05:04:48 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:46.555 05:04:48 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:46.555 05:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.555 05:04:48 -- common/autotest_common.sh@10 -- # set +x 00:08:46.555 05:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.555 05:04:48 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:46.555 05:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.555 05:04:48 -- common/autotest_common.sh@10 -- # set +x 00:08:46.555 05:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.555 05:04:48 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:46.555 05:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.555 05:04:48 -- common/autotest_common.sh@10 -- # set +x 00:08:46.816 05:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.816 05:04:48 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:46.816 05:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.816 05:04:48 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:46.816 05:04:48 -- common/autotest_common.sh@10 -- # set +x 00:08:46.816 05:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.816 05:04:48 -- target/discovery.sh@49 -- # check_bdevs= 00:08:46.816 05:04:48 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:46.816 05:04:48 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:46.816 05:04:48 -- target/discovery.sh@57 -- # nvmftestfini 00:08:46.816 05:04:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:46.816 05:04:48 -- nvmf/common.sh@116 -- # sync 00:08:46.816 05:04:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:46.816 05:04:48 -- nvmf/common.sh@119 -- # set +e 00:08:46.816 05:04:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:46.816 05:04:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:46.816 rmmod nvme_tcp 00:08:46.816 rmmod nvme_fabrics 00:08:46.816 rmmod nvme_keyring 00:08:46.816 05:04:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:46.816 05:04:48 -- nvmf/common.sh@123 -- # set -e 00:08:46.816 05:04:48 -- nvmf/common.sh@124 -- # return 0 00:08:46.816 05:04:48 -- nvmf/common.sh@477 -- # '[' -n 3202918 ']' 00:08:46.816 05:04:48 -- nvmf/common.sh@478 -- # killprocess 3202918 00:08:46.816 05:04:48 -- common/autotest_common.sh@936 -- # '[' -z 3202918 ']' 00:08:46.816 05:04:48 -- common/autotest_common.sh@940 -- # kill -0 3202918 00:08:46.816 05:04:48 -- common/autotest_common.sh@941 -- # uname 00:08:46.816 05:04:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:46.816 05:04:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3202918 00:08:46.816 05:04:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:46.816 05:04:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:46.816 05:04:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3202918' 00:08:46.816 killing process with pid 3202918 00:08:46.816 05:04:48 -- common/autotest_common.sh@955 -- # kill 3202918 00:08:46.816 [2024-11-26 05:04:48.453653] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:46.816 05:04:48 -- common/autotest_common.sh@960 -- # wait 3202918 00:08:47.076 05:04:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:47.076 05:04:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:47.076 05:04:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:47.076 05:04:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:47.076 05:04:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:47.076 05:04:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:47.076 05:04:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:47.076 05:04:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:48.985 05:04:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:48.985 00:08:48.985 real 0m6.420s 00:08:48.985 user 0m8.003s 00:08:48.985 sys 0m1.969s 00:08:48.985 05:04:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:48.985 05:04:50 -- common/autotest_common.sh@10 -- # set +x 00:08:48.985 ************************************ 00:08:48.985 END TEST nvmf_discovery 00:08:48.985 ************************************ 00:08:48.985 05:04:50 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:48.985 05:04:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:48.985 05:04:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:48.985 05:04:50 -- common/autotest_common.sh@10 -- # set +x 00:08:49.244 ************************************ 00:08:49.244 START TEST nvmf_referrals 00:08:49.244 ************************************ 00:08:49.244 05:04:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:49.244 * Looking for test storage... 00:08:49.244 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:49.244 05:04:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:49.244 05:04:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:49.244 05:04:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:49.244 05:04:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:49.244 05:04:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:49.244 05:04:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:49.244 05:04:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:49.244 05:04:50 -- scripts/common.sh@335 -- # IFS=.-: 00:08:49.244 05:04:50 -- scripts/common.sh@335 -- # read -ra ver1 00:08:49.244 05:04:50 -- scripts/common.sh@336 -- # IFS=.-: 00:08:49.244 05:04:50 -- scripts/common.sh@336 -- # read -ra ver2 00:08:49.244 05:04:50 -- scripts/common.sh@337 -- # local 'op=<' 00:08:49.244 05:04:50 -- scripts/common.sh@339 -- # ver1_l=2 00:08:49.244 05:04:50 -- scripts/common.sh@340 -- # ver2_l=1 00:08:49.244 05:04:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:49.244 05:04:50 -- scripts/common.sh@343 -- # case "$op" in 00:08:49.244 05:04:50 -- scripts/common.sh@344 -- # : 1 00:08:49.244 05:04:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:49.244 05:04:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:49.244 05:04:50 -- scripts/common.sh@364 -- # decimal 1 00:08:49.244 05:04:50 -- scripts/common.sh@352 -- # local d=1 00:08:49.244 05:04:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:49.244 05:04:50 -- scripts/common.sh@354 -- # echo 1 00:08:49.244 05:04:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:49.244 05:04:50 -- scripts/common.sh@365 -- # decimal 2 00:08:49.244 05:04:50 -- scripts/common.sh@352 -- # local d=2 00:08:49.244 05:04:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:49.244 05:04:50 -- scripts/common.sh@354 -- # echo 2 00:08:49.244 05:04:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:49.244 05:04:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:49.244 05:04:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:49.244 05:04:50 -- scripts/common.sh@367 -- # return 0 00:08:49.244 05:04:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:49.244 05:04:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:49.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:49.245 --rc genhtml_branch_coverage=1 00:08:49.245 --rc genhtml_function_coverage=1 00:08:49.245 --rc genhtml_legend=1 00:08:49.245 --rc geninfo_all_blocks=1 00:08:49.245 --rc geninfo_unexecuted_blocks=1 00:08:49.245 00:08:49.245 ' 00:08:49.245 05:04:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:49.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:49.245 --rc genhtml_branch_coverage=1 00:08:49.245 --rc genhtml_function_coverage=1 00:08:49.245 --rc genhtml_legend=1 00:08:49.245 --rc geninfo_all_blocks=1 00:08:49.245 --rc geninfo_unexecuted_blocks=1 00:08:49.245 00:08:49.245 ' 00:08:49.245 05:04:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:49.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:49.245 --rc genhtml_branch_coverage=1 00:08:49.245 --rc genhtml_function_coverage=1 00:08:49.245 --rc genhtml_legend=1 00:08:49.245 --rc geninfo_all_blocks=1 00:08:49.245 --rc geninfo_unexecuted_blocks=1 00:08:49.245 00:08:49.245 ' 00:08:49.245 05:04:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:49.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:49.245 --rc genhtml_branch_coverage=1 00:08:49.245 --rc genhtml_function_coverage=1 00:08:49.245 --rc genhtml_legend=1 00:08:49.245 --rc geninfo_all_blocks=1 00:08:49.245 --rc geninfo_unexecuted_blocks=1 00:08:49.245 00:08:49.245 ' 00:08:49.245 05:04:50 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:49.245 05:04:50 -- nvmf/common.sh@7 -- # uname -s 00:08:49.245 05:04:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:49.245 05:04:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:49.245 05:04:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:49.245 05:04:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:49.245 05:04:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:49.245 05:04:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:49.245 05:04:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:49.245 05:04:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:49.245 05:04:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:49.245 05:04:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:49.245 05:04:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:49.245 05:04:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:49.245 05:04:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:49.245 05:04:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:49.245 05:04:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:49.245 05:04:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:49.245 05:04:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:49.245 05:04:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:49.245 05:04:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:49.245 05:04:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:49.245 05:04:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:49.245 05:04:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:49.245 05:04:50 -- paths/export.sh@5 -- # export PATH 00:08:49.245 05:04:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:49.245 05:04:50 -- nvmf/common.sh@46 -- # : 0 00:08:49.245 05:04:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:49.245 05:04:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:49.245 05:04:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:49.245 05:04:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:49.245 05:04:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:49.245 05:04:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:49.245 05:04:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:49.245 05:04:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:49.245 05:04:50 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:49.245 05:04:50 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:49.245 05:04:50 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:49.245 05:04:50 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:49.245 05:04:50 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:49.245 05:04:50 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:49.245 05:04:50 -- target/referrals.sh@37 -- # nvmftestinit 00:08:49.245 05:04:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:49.245 05:04:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:49.245 05:04:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:49.245 05:04:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:49.245 05:04:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:49.245 05:04:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:49.245 05:04:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:49.245 05:04:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:49.245 05:04:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:49.245 05:04:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:49.245 05:04:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:49.245 05:04:50 -- common/autotest_common.sh@10 -- # set +x 00:08:51.777 05:04:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:51.777 05:04:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:51.777 05:04:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:51.777 05:04:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:51.777 05:04:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:51.777 05:04:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:51.777 05:04:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:51.777 05:04:52 -- nvmf/common.sh@294 -- # net_devs=() 00:08:51.777 05:04:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:51.777 05:04:52 -- nvmf/common.sh@295 -- # e810=() 00:08:51.777 05:04:52 -- nvmf/common.sh@295 -- # local -ga e810 00:08:51.777 05:04:52 -- nvmf/common.sh@296 -- # x722=() 00:08:51.777 05:04:52 -- nvmf/common.sh@296 -- # local -ga x722 00:08:51.778 05:04:52 -- nvmf/common.sh@297 -- # mlx=() 00:08:51.778 05:04:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:51.778 05:04:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:51.778 05:04:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:51.778 05:04:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:51.778 05:04:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:51.778 05:04:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:51.778 05:04:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:51.778 05:04:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:51.778 05:04:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:51.778 05:04:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:51.778 05:04:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:51.778 05:04:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:51.778 05:04:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:51.778 05:04:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:51.778 05:04:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:51.778 05:04:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:51.778 05:04:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:51.778 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:51.778 05:04:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:51.778 05:04:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:51.778 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:51.778 05:04:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:51.778 05:04:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:51.778 05:04:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:51.778 05:04:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:51.778 05:04:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:51.778 05:04:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:51.778 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:51.778 05:04:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:51.778 05:04:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:51.778 05:04:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:51.778 05:04:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:51.778 05:04:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:51.778 05:04:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:51.778 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:51.778 05:04:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:51.778 05:04:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:51.778 05:04:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:51.778 05:04:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:51.778 05:04:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:51.778 05:04:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:51.778 05:04:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:51.778 05:04:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:51.778 05:04:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:51.778 05:04:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:51.778 05:04:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:51.778 05:04:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:51.778 05:04:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:51.778 05:04:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:51.778 05:04:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:51.778 05:04:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:51.778 05:04:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:51.778 05:04:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:51.778 05:04:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:51.778 05:04:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:51.778 05:04:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:51.778 05:04:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:51.778 05:04:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:51.778 05:04:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:51.778 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:51.778 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:08:51.778 00:08:51.778 --- 10.0.0.2 ping statistics --- 00:08:51.778 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:51.778 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:08:51.778 05:04:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:51.778 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:51.778 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.085 ms 00:08:51.778 00:08:51.778 --- 10.0.0.1 ping statistics --- 00:08:51.778 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:51.778 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:08:51.778 05:04:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:51.778 05:04:53 -- nvmf/common.sh@410 -- # return 0 00:08:51.778 05:04:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:51.778 05:04:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:51.778 05:04:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:51.778 05:04:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:51.778 05:04:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:51.778 05:04:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:51.778 05:04:53 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:51.778 05:04:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:51.778 05:04:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:51.778 05:04:53 -- common/autotest_common.sh@10 -- # set +x 00:08:51.778 05:04:53 -- nvmf/common.sh@469 -- # nvmfpid=3205169 00:08:51.778 05:04:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:51.778 05:04:53 -- nvmf/common.sh@470 -- # waitforlisten 3205169 00:08:51.778 05:04:53 -- common/autotest_common.sh@829 -- # '[' -z 3205169 ']' 00:08:51.778 05:04:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:51.778 05:04:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:51.778 05:04:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:51.778 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:51.778 05:04:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:51.778 05:04:53 -- common/autotest_common.sh@10 -- # set +x 00:08:51.778 [2024-11-26 05:04:53.322620] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:51.778 [2024-11-26 05:04:53.322713] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:51.778 EAL: No free 2048 kB hugepages reported on node 1 00:08:51.778 [2024-11-26 05:04:53.391745] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:51.778 [2024-11-26 05:04:53.486654] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:51.778 [2024-11-26 05:04:53.486844] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:51.778 [2024-11-26 05:04:53.486872] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:51.778 [2024-11-26 05:04:53.486887] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:51.778 [2024-11-26 05:04:53.486946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:51.778 [2024-11-26 05:04:53.487006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:51.778 [2024-11-26 05:04:53.487066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:51.778 [2024-11-26 05:04:53.487069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:52.713 05:04:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:52.713 05:04:54 -- common/autotest_common.sh@862 -- # return 0 00:08:52.713 05:04:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:52.713 05:04:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:52.713 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:08:52.713 05:04:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:52.713 05:04:54 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:52.713 05:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:52.713 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:08:52.713 [2024-11-26 05:04:54.404634] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:52.713 05:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:52.713 05:04:54 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:08:52.713 05:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:52.713 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:08:52.713 [2024-11-26 05:04:54.416870] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:08:52.713 05:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:52.713 05:04:54 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:08:52.713 05:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:52.713 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:08:52.713 05:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:52.713 05:04:54 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:08:52.713 05:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:52.713 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:08:52.713 05:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:52.713 05:04:54 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:08:52.713 05:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:52.713 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:08:52.713 05:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:52.713 05:04:54 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:52.713 05:04:54 -- target/referrals.sh@48 -- # jq length 00:08:52.713 05:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:52.713 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:08:52.713 05:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:52.971 05:04:54 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:52.971 05:04:54 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:52.971 05:04:54 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:52.971 05:04:54 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:52.971 05:04:54 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:52.971 05:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:52.971 05:04:54 -- target/referrals.sh@21 -- # sort 00:08:52.971 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:08:52.971 05:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:52.971 05:04:54 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:52.971 05:04:54 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:52.971 05:04:54 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:52.971 05:04:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:52.971 05:04:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:52.971 05:04:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:52.971 05:04:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:52.971 05:04:54 -- target/referrals.sh@26 -- # sort 00:08:52.971 05:04:54 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:53.230 05:04:54 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:53.230 05:04:54 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:08:53.230 05:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.230 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:08:53.230 05:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.230 05:04:54 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:08:53.230 05:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.230 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:08:53.230 05:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.230 05:04:54 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:08:53.230 05:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.230 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:08:53.230 05:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.230 05:04:54 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:53.230 05:04:54 -- target/referrals.sh@56 -- # jq length 00:08:53.230 05:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.230 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:08:53.230 05:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.230 05:04:54 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:53.230 05:04:54 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:53.230 05:04:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:53.230 05:04:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:53.230 05:04:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:53.230 05:04:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:53.230 05:04:54 -- target/referrals.sh@26 -- # sort 00:08:53.488 05:04:55 -- target/referrals.sh@26 -- # echo 00:08:53.488 05:04:55 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:53.488 05:04:55 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:08:53.488 05:04:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.488 05:04:55 -- common/autotest_common.sh@10 -- # set +x 00:08:53.488 05:04:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.488 05:04:55 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:53.488 05:04:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.488 05:04:55 -- common/autotest_common.sh@10 -- # set +x 00:08:53.488 05:04:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.488 05:04:55 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:53.488 05:04:55 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:53.488 05:04:55 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:53.488 05:04:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.488 05:04:55 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:53.488 05:04:55 -- common/autotest_common.sh@10 -- # set +x 00:08:53.488 05:04:55 -- target/referrals.sh@21 -- # sort 00:08:53.488 05:04:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.488 05:04:55 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:53.488 05:04:55 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:53.488 05:04:55 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:53.488 05:04:55 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:53.489 05:04:55 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:53.489 05:04:55 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:53.489 05:04:55 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:53.489 05:04:55 -- target/referrals.sh@26 -- # sort 00:08:53.489 05:04:55 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:53.489 05:04:55 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:53.489 05:04:55 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:53.489 05:04:55 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:53.489 05:04:55 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:53.489 05:04:55 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:53.489 05:04:55 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:53.746 05:04:55 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:53.746 05:04:55 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:53.746 05:04:55 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:53.746 05:04:55 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:53.746 05:04:55 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:53.746 05:04:55 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:54.005 05:04:55 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:54.005 05:04:55 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:54.005 05:04:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.005 05:04:55 -- common/autotest_common.sh@10 -- # set +x 00:08:54.005 05:04:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.005 05:04:55 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:54.005 05:04:55 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:54.005 05:04:55 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:54.005 05:04:55 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:54.005 05:04:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.005 05:04:55 -- common/autotest_common.sh@10 -- # set +x 00:08:54.005 05:04:55 -- target/referrals.sh@21 -- # sort 00:08:54.005 05:04:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.005 05:04:55 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:54.005 05:04:55 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:54.005 05:04:55 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:54.005 05:04:55 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:54.005 05:04:55 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:54.005 05:04:55 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:54.005 05:04:55 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:54.005 05:04:55 -- target/referrals.sh@26 -- # sort 00:08:54.263 05:04:55 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:54.263 05:04:55 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:54.263 05:04:55 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:54.263 05:04:55 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:54.263 05:04:55 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:54.263 05:04:55 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:54.263 05:04:55 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:54.521 05:04:56 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:54.521 05:04:56 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:54.521 05:04:56 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:54.521 05:04:56 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:54.521 05:04:56 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:54.521 05:04:56 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:54.521 05:04:56 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:54.521 05:04:56 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:54.521 05:04:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.521 05:04:56 -- common/autotest_common.sh@10 -- # set +x 00:08:54.521 05:04:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.521 05:04:56 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:54.521 05:04:56 -- target/referrals.sh@82 -- # jq length 00:08:54.521 05:04:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.521 05:04:56 -- common/autotest_common.sh@10 -- # set +x 00:08:54.521 05:04:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.521 05:04:56 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:54.521 05:04:56 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:54.521 05:04:56 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:54.521 05:04:56 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:54.521 05:04:56 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:54.521 05:04:56 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:54.521 05:04:56 -- target/referrals.sh@26 -- # sort 00:08:54.781 05:04:56 -- target/referrals.sh@26 -- # echo 00:08:54.781 05:04:56 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:54.781 05:04:56 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:54.781 05:04:56 -- target/referrals.sh@86 -- # nvmftestfini 00:08:54.781 05:04:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:54.781 05:04:56 -- nvmf/common.sh@116 -- # sync 00:08:54.781 05:04:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:54.781 05:04:56 -- nvmf/common.sh@119 -- # set +e 00:08:54.781 05:04:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:54.781 05:04:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:54.781 rmmod nvme_tcp 00:08:54.781 rmmod nvme_fabrics 00:08:54.781 rmmod nvme_keyring 00:08:54.781 05:04:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:54.781 05:04:56 -- nvmf/common.sh@123 -- # set -e 00:08:54.781 05:04:56 -- nvmf/common.sh@124 -- # return 0 00:08:54.781 05:04:56 -- nvmf/common.sh@477 -- # '[' -n 3205169 ']' 00:08:54.781 05:04:56 -- nvmf/common.sh@478 -- # killprocess 3205169 00:08:54.781 05:04:56 -- common/autotest_common.sh@936 -- # '[' -z 3205169 ']' 00:08:54.781 05:04:56 -- common/autotest_common.sh@940 -- # kill -0 3205169 00:08:54.781 05:04:56 -- common/autotest_common.sh@941 -- # uname 00:08:54.781 05:04:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:54.781 05:04:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3205169 00:08:54.781 05:04:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:54.781 05:04:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:54.781 05:04:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3205169' 00:08:54.781 killing process with pid 3205169 00:08:54.781 05:04:56 -- common/autotest_common.sh@955 -- # kill 3205169 00:08:54.781 05:04:56 -- common/autotest_common.sh@960 -- # wait 3205169 00:08:55.040 05:04:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:55.040 05:04:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:55.040 05:04:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:55.040 05:04:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:55.040 05:04:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:55.040 05:04:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:55.040 05:04:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:55.040 05:04:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:57.580 05:04:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:57.580 00:08:57.580 real 0m8.068s 00:08:57.580 user 0m14.735s 00:08:57.580 sys 0m2.359s 00:08:57.580 05:04:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:57.580 05:04:58 -- common/autotest_common.sh@10 -- # set +x 00:08:57.580 ************************************ 00:08:57.580 END TEST nvmf_referrals 00:08:57.580 ************************************ 00:08:57.580 05:04:58 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:57.580 05:04:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:57.580 05:04:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:57.580 05:04:58 -- common/autotest_common.sh@10 -- # set +x 00:08:57.580 ************************************ 00:08:57.580 START TEST nvmf_connect_disconnect 00:08:57.580 ************************************ 00:08:57.580 05:04:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:57.580 * Looking for test storage... 00:08:57.580 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:57.580 05:04:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:57.580 05:04:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:57.580 05:04:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:57.580 05:04:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:57.580 05:04:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:57.580 05:04:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:57.580 05:04:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:57.580 05:04:58 -- scripts/common.sh@335 -- # IFS=.-: 00:08:57.580 05:04:58 -- scripts/common.sh@335 -- # read -ra ver1 00:08:57.580 05:04:58 -- scripts/common.sh@336 -- # IFS=.-: 00:08:57.580 05:04:58 -- scripts/common.sh@336 -- # read -ra ver2 00:08:57.580 05:04:58 -- scripts/common.sh@337 -- # local 'op=<' 00:08:57.580 05:04:58 -- scripts/common.sh@339 -- # ver1_l=2 00:08:57.580 05:04:58 -- scripts/common.sh@340 -- # ver2_l=1 00:08:57.580 05:04:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:57.580 05:04:58 -- scripts/common.sh@343 -- # case "$op" in 00:08:57.580 05:04:58 -- scripts/common.sh@344 -- # : 1 00:08:57.580 05:04:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:57.580 05:04:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:57.580 05:04:58 -- scripts/common.sh@364 -- # decimal 1 00:08:57.580 05:04:58 -- scripts/common.sh@352 -- # local d=1 00:08:57.580 05:04:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:57.580 05:04:58 -- scripts/common.sh@354 -- # echo 1 00:08:57.580 05:04:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:57.580 05:04:58 -- scripts/common.sh@365 -- # decimal 2 00:08:57.580 05:04:58 -- scripts/common.sh@352 -- # local d=2 00:08:57.580 05:04:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:57.580 05:04:58 -- scripts/common.sh@354 -- # echo 2 00:08:57.580 05:04:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:57.580 05:04:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:57.580 05:04:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:57.580 05:04:58 -- scripts/common.sh@367 -- # return 0 00:08:57.580 05:04:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:57.580 05:04:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:57.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.580 --rc genhtml_branch_coverage=1 00:08:57.580 --rc genhtml_function_coverage=1 00:08:57.580 --rc genhtml_legend=1 00:08:57.580 --rc geninfo_all_blocks=1 00:08:57.580 --rc geninfo_unexecuted_blocks=1 00:08:57.580 00:08:57.580 ' 00:08:57.580 05:04:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:57.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.580 --rc genhtml_branch_coverage=1 00:08:57.580 --rc genhtml_function_coverage=1 00:08:57.580 --rc genhtml_legend=1 00:08:57.580 --rc geninfo_all_blocks=1 00:08:57.580 --rc geninfo_unexecuted_blocks=1 00:08:57.580 00:08:57.580 ' 00:08:57.580 05:04:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:57.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.580 --rc genhtml_branch_coverage=1 00:08:57.580 --rc genhtml_function_coverage=1 00:08:57.580 --rc genhtml_legend=1 00:08:57.580 --rc geninfo_all_blocks=1 00:08:57.580 --rc geninfo_unexecuted_blocks=1 00:08:57.580 00:08:57.580 ' 00:08:57.580 05:04:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:57.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.580 --rc genhtml_branch_coverage=1 00:08:57.580 --rc genhtml_function_coverage=1 00:08:57.580 --rc genhtml_legend=1 00:08:57.580 --rc geninfo_all_blocks=1 00:08:57.580 --rc geninfo_unexecuted_blocks=1 00:08:57.580 00:08:57.580 ' 00:08:57.580 05:04:59 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:57.580 05:04:59 -- nvmf/common.sh@7 -- # uname -s 00:08:57.580 05:04:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:57.580 05:04:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:57.580 05:04:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:57.580 05:04:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:57.580 05:04:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:57.580 05:04:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:57.580 05:04:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:57.580 05:04:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:57.580 05:04:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:57.580 05:04:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:57.580 05:04:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:57.580 05:04:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:57.580 05:04:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:57.580 05:04:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:57.580 05:04:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:57.580 05:04:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:57.580 05:04:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:57.580 05:04:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:57.580 05:04:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:57.580 05:04:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.580 05:04:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.580 05:04:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.580 05:04:59 -- paths/export.sh@5 -- # export PATH 00:08:57.580 05:04:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.580 05:04:59 -- nvmf/common.sh@46 -- # : 0 00:08:57.580 05:04:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:57.580 05:04:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:57.580 05:04:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:57.580 05:04:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:57.580 05:04:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:57.580 05:04:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:57.580 05:04:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:57.580 05:04:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:57.580 05:04:59 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:57.580 05:04:59 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:57.580 05:04:59 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:57.580 05:04:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:57.580 05:04:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:57.580 05:04:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:57.580 05:04:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:57.581 05:04:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:57.581 05:04:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:57.581 05:04:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:57.581 05:04:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:57.581 05:04:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:57.581 05:04:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:57.581 05:04:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:57.581 05:04:59 -- common/autotest_common.sh@10 -- # set +x 00:08:59.485 05:05:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:59.485 05:05:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:59.485 05:05:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:59.485 05:05:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:59.485 05:05:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:59.485 05:05:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:59.485 05:05:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:59.485 05:05:01 -- nvmf/common.sh@294 -- # net_devs=() 00:08:59.485 05:05:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:59.485 05:05:01 -- nvmf/common.sh@295 -- # e810=() 00:08:59.485 05:05:01 -- nvmf/common.sh@295 -- # local -ga e810 00:08:59.485 05:05:01 -- nvmf/common.sh@296 -- # x722=() 00:08:59.485 05:05:01 -- nvmf/common.sh@296 -- # local -ga x722 00:08:59.485 05:05:01 -- nvmf/common.sh@297 -- # mlx=() 00:08:59.485 05:05:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:59.485 05:05:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:59.485 05:05:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:59.485 05:05:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:59.485 05:05:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:59.485 05:05:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:59.485 05:05:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:59.485 05:05:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:59.485 05:05:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:59.486 05:05:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:59.486 05:05:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:59.486 05:05:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:59.486 05:05:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:59.486 05:05:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:59.486 05:05:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:59.486 05:05:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:59.486 05:05:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:59.486 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:59.486 05:05:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:59.486 05:05:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:59.486 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:59.486 05:05:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:59.486 05:05:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:59.486 05:05:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:59.486 05:05:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:59.486 05:05:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:59.486 05:05:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:59.486 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:59.486 05:05:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:59.486 05:05:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:59.486 05:05:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:59.486 05:05:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:59.486 05:05:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:59.486 05:05:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:59.486 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:59.486 05:05:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:59.486 05:05:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:59.486 05:05:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:59.486 05:05:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:59.486 05:05:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:59.486 05:05:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:59.486 05:05:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:59.486 05:05:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:59.486 05:05:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:59.486 05:05:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:59.486 05:05:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:59.486 05:05:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:59.486 05:05:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:59.486 05:05:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:59.486 05:05:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:59.486 05:05:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:59.486 05:05:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:59.486 05:05:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:59.486 05:05:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:59.486 05:05:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:59.486 05:05:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:59.486 05:05:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:59.775 05:05:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:59.775 05:05:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:59.775 05:05:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:59.775 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:59.775 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.301 ms 00:08:59.775 00:08:59.775 --- 10.0.0.2 ping statistics --- 00:08:59.775 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:59.775 rtt min/avg/max/mdev = 0.301/0.301/0.301/0.000 ms 00:08:59.775 05:05:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:59.775 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:59.775 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.158 ms 00:08:59.775 00:08:59.775 --- 10.0.0.1 ping statistics --- 00:08:59.775 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:59.775 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:08:59.775 05:05:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:59.775 05:05:01 -- nvmf/common.sh@410 -- # return 0 00:08:59.775 05:05:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:59.775 05:05:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:59.775 05:05:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:59.775 05:05:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:59.775 05:05:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:59.775 05:05:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:59.775 05:05:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:59.775 05:05:01 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:59.775 05:05:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:59.775 05:05:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:59.775 05:05:01 -- common/autotest_common.sh@10 -- # set +x 00:08:59.775 05:05:01 -- nvmf/common.sh@469 -- # nvmfpid=3207627 00:08:59.775 05:05:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:59.775 05:05:01 -- nvmf/common.sh@470 -- # waitforlisten 3207627 00:08:59.775 05:05:01 -- common/autotest_common.sh@829 -- # '[' -z 3207627 ']' 00:08:59.775 05:05:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:59.775 05:05:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:59.775 05:05:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:59.775 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:59.775 05:05:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:59.775 05:05:01 -- common/autotest_common.sh@10 -- # set +x 00:08:59.775 [2024-11-26 05:05:01.369353] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:59.775 [2024-11-26 05:05:01.369456] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:59.775 EAL: No free 2048 kB hugepages reported on node 1 00:08:59.775 [2024-11-26 05:05:01.435642] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:59.775 [2024-11-26 05:05:01.522971] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:59.775 [2024-11-26 05:05:01.523137] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:59.775 [2024-11-26 05:05:01.523155] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:59.775 [2024-11-26 05:05:01.523167] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:59.775 [2024-11-26 05:05:01.523229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:59.775 [2024-11-26 05:05:01.523305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:59.775 [2024-11-26 05:05:01.523357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:59.775 [2024-11-26 05:05:01.523354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:00.711 05:05:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:00.712 05:05:02 -- common/autotest_common.sh@862 -- # return 0 00:09:00.712 05:05:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:00.712 05:05:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:00.712 05:05:02 -- common/autotest_common.sh@10 -- # set +x 00:09:00.712 05:05:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:00.712 05:05:02 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:00.712 05:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.712 05:05:02 -- common/autotest_common.sh@10 -- # set +x 00:09:00.712 [2024-11-26 05:05:02.419536] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:00.712 05:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:00.712 05:05:02 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:00.712 05:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.712 05:05:02 -- common/autotest_common.sh@10 -- # set +x 00:09:00.712 05:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:00.712 05:05:02 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:00.712 05:05:02 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:00.712 05:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.712 05:05:02 -- common/autotest_common.sh@10 -- # set +x 00:09:00.712 05:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:00.712 05:05:02 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:00.712 05:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.712 05:05:02 -- common/autotest_common.sh@10 -- # set +x 00:09:00.712 05:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:00.712 05:05:02 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:00.712 05:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.712 05:05:02 -- common/autotest_common.sh@10 -- # set +x 00:09:00.712 [2024-11-26 05:05:02.473346] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:00.970 05:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:00.970 05:05:02 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:00.970 05:05:02 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:00.970 05:05:02 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:00.970 05:05:02 -- target/connect_disconnect.sh@34 -- # set +x 00:09:03.511 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.113 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.017 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.551 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.457 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.000 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.540 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.448 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.988 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.525 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.430 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.965 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.503 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.412 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.951 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.862 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.399 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.979 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.884 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.420 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.957 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.861 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.399 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.937 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.843 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.375 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.905 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.810 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.347 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.883 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.788 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.321 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.231 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.834 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.368 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.283 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.820 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.360 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.266 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.805 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.346 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.251 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.788 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.322 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.229 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.766 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.673 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.215 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.752 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.705 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.239 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.776 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.683 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.218 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.756 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.284 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.191 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.729 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.268 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.807 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.718 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.258 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.796 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.698 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.250 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.159 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.696 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.243 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.148 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.685 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.591 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.125 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.663 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.692 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.233 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:57.140 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.681 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.219 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.124 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.663 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.203 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.110 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.648 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.183 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.090 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:20.628 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.157 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.061 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.602 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.143 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.049 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.587 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:37.126 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.031 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:41.566 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.104 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:46.641 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.547 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:51.090 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.629 [2024-11-26 05:08:54.772494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x215b520 is same with the state(5) to be set 00:12:53.629 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.629 05:08:54 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:53.629 05:08:54 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:53.629 05:08:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:53.629 05:08:54 -- nvmf/common.sh@116 -- # sync 00:12:53.629 05:08:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:53.629 05:08:54 -- nvmf/common.sh@119 -- # set +e 00:12:53.629 05:08:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:53.629 05:08:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:53.629 rmmod nvme_tcp 00:12:53.629 rmmod nvme_fabrics 00:12:53.629 rmmod nvme_keyring 00:12:53.629 05:08:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:53.629 05:08:54 -- nvmf/common.sh@123 -- # set -e 00:12:53.629 05:08:54 -- nvmf/common.sh@124 -- # return 0 00:12:53.629 05:08:54 -- nvmf/common.sh@477 -- # '[' -n 3207627 ']' 00:12:53.629 05:08:54 -- nvmf/common.sh@478 -- # killprocess 3207627 00:12:53.629 05:08:54 -- common/autotest_common.sh@936 -- # '[' -z 3207627 ']' 00:12:53.629 05:08:54 -- common/autotest_common.sh@940 -- # kill -0 3207627 00:12:53.629 05:08:54 -- common/autotest_common.sh@941 -- # uname 00:12:53.629 05:08:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:53.629 05:08:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3207627 00:12:53.629 05:08:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:53.629 05:08:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:53.629 05:08:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3207627' 00:12:53.629 killing process with pid 3207627 00:12:53.629 05:08:54 -- common/autotest_common.sh@955 -- # kill 3207627 00:12:53.629 05:08:54 -- common/autotest_common.sh@960 -- # wait 3207627 00:12:53.629 05:08:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:53.629 05:08:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:53.629 05:08:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:53.629 05:08:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:53.629 05:08:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:53.629 05:08:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:53.629 05:08:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:53.629 05:08:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:55.538 05:08:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:55.538 00:12:55.538 real 3m58.340s 00:12:55.538 user 15m8.300s 00:12:55.538 sys 0m35.168s 00:12:55.538 05:08:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:55.538 05:08:57 -- common/autotest_common.sh@10 -- # set +x 00:12:55.538 ************************************ 00:12:55.538 END TEST nvmf_connect_disconnect 00:12:55.538 ************************************ 00:12:55.538 05:08:57 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:55.538 05:08:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:55.538 05:08:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:55.538 05:08:57 -- common/autotest_common.sh@10 -- # set +x 00:12:55.538 ************************************ 00:12:55.538 START TEST nvmf_multitarget 00:12:55.538 ************************************ 00:12:55.538 05:08:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:55.538 * Looking for test storage... 00:12:55.538 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:55.538 05:08:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:55.538 05:08:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:55.538 05:08:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:55.798 05:08:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:55.798 05:08:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:55.798 05:08:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:55.798 05:08:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:55.798 05:08:57 -- scripts/common.sh@335 -- # IFS=.-: 00:12:55.798 05:08:57 -- scripts/common.sh@335 -- # read -ra ver1 00:12:55.798 05:08:57 -- scripts/common.sh@336 -- # IFS=.-: 00:12:55.798 05:08:57 -- scripts/common.sh@336 -- # read -ra ver2 00:12:55.798 05:08:57 -- scripts/common.sh@337 -- # local 'op=<' 00:12:55.798 05:08:57 -- scripts/common.sh@339 -- # ver1_l=2 00:12:55.798 05:08:57 -- scripts/common.sh@340 -- # ver2_l=1 00:12:55.798 05:08:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:55.798 05:08:57 -- scripts/common.sh@343 -- # case "$op" in 00:12:55.798 05:08:57 -- scripts/common.sh@344 -- # : 1 00:12:55.798 05:08:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:55.798 05:08:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:55.798 05:08:57 -- scripts/common.sh@364 -- # decimal 1 00:12:55.798 05:08:57 -- scripts/common.sh@352 -- # local d=1 00:12:55.798 05:08:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:55.798 05:08:57 -- scripts/common.sh@354 -- # echo 1 00:12:55.798 05:08:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:55.798 05:08:57 -- scripts/common.sh@365 -- # decimal 2 00:12:55.798 05:08:57 -- scripts/common.sh@352 -- # local d=2 00:12:55.798 05:08:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:55.798 05:08:57 -- scripts/common.sh@354 -- # echo 2 00:12:55.798 05:08:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:55.798 05:08:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:55.798 05:08:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:55.798 05:08:57 -- scripts/common.sh@367 -- # return 0 00:12:55.798 05:08:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:55.798 05:08:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:55.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:55.798 --rc genhtml_branch_coverage=1 00:12:55.798 --rc genhtml_function_coverage=1 00:12:55.798 --rc genhtml_legend=1 00:12:55.798 --rc geninfo_all_blocks=1 00:12:55.798 --rc geninfo_unexecuted_blocks=1 00:12:55.798 00:12:55.798 ' 00:12:55.798 05:08:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:55.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:55.798 --rc genhtml_branch_coverage=1 00:12:55.798 --rc genhtml_function_coverage=1 00:12:55.798 --rc genhtml_legend=1 00:12:55.798 --rc geninfo_all_blocks=1 00:12:55.798 --rc geninfo_unexecuted_blocks=1 00:12:55.798 00:12:55.798 ' 00:12:55.798 05:08:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:55.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:55.798 --rc genhtml_branch_coverage=1 00:12:55.798 --rc genhtml_function_coverage=1 00:12:55.798 --rc genhtml_legend=1 00:12:55.798 --rc geninfo_all_blocks=1 00:12:55.798 --rc geninfo_unexecuted_blocks=1 00:12:55.798 00:12:55.798 ' 00:12:55.798 05:08:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:55.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:55.798 --rc genhtml_branch_coverage=1 00:12:55.798 --rc genhtml_function_coverage=1 00:12:55.798 --rc genhtml_legend=1 00:12:55.798 --rc geninfo_all_blocks=1 00:12:55.798 --rc geninfo_unexecuted_blocks=1 00:12:55.798 00:12:55.798 ' 00:12:55.798 05:08:57 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:55.798 05:08:57 -- nvmf/common.sh@7 -- # uname -s 00:12:55.798 05:08:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:55.798 05:08:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:55.798 05:08:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:55.798 05:08:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:55.798 05:08:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:55.798 05:08:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:55.798 05:08:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:55.798 05:08:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:55.798 05:08:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:55.798 05:08:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:55.798 05:08:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:55.798 05:08:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:55.798 05:08:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:55.798 05:08:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:55.798 05:08:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:55.798 05:08:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:55.798 05:08:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:55.798 05:08:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:55.798 05:08:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:55.798 05:08:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:55.798 05:08:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:55.798 05:08:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:55.798 05:08:57 -- paths/export.sh@5 -- # export PATH 00:12:55.798 05:08:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:55.798 05:08:57 -- nvmf/common.sh@46 -- # : 0 00:12:55.798 05:08:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:55.798 05:08:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:55.798 05:08:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:55.798 05:08:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:55.798 05:08:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:55.798 05:08:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:55.798 05:08:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:55.798 05:08:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:55.798 05:08:57 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:55.798 05:08:57 -- target/multitarget.sh@15 -- # nvmftestinit 00:12:55.798 05:08:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:55.798 05:08:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:55.798 05:08:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:55.798 05:08:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:55.798 05:08:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:55.798 05:08:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:55.798 05:08:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:55.798 05:08:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:55.798 05:08:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:55.798 05:08:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:55.798 05:08:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:55.798 05:08:57 -- common/autotest_common.sh@10 -- # set +x 00:12:57.774 05:08:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:57.774 05:08:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:57.774 05:08:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:57.774 05:08:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:57.774 05:08:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:57.774 05:08:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:57.774 05:08:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:57.774 05:08:59 -- nvmf/common.sh@294 -- # net_devs=() 00:12:57.774 05:08:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:57.774 05:08:59 -- nvmf/common.sh@295 -- # e810=() 00:12:57.774 05:08:59 -- nvmf/common.sh@295 -- # local -ga e810 00:12:57.774 05:08:59 -- nvmf/common.sh@296 -- # x722=() 00:12:57.774 05:08:59 -- nvmf/common.sh@296 -- # local -ga x722 00:12:57.774 05:08:59 -- nvmf/common.sh@297 -- # mlx=() 00:12:57.774 05:08:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:57.774 05:08:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:57.774 05:08:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:57.774 05:08:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:57.774 05:08:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:57.774 05:08:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:57.774 05:08:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:57.774 05:08:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:57.774 05:08:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:57.774 05:08:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:57.774 05:08:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:57.774 05:08:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:57.774 05:08:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:57.774 05:08:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:57.774 05:08:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:57.774 05:08:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:57.774 05:08:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:57.774 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:57.774 05:08:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:57.774 05:08:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:57.774 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:57.774 05:08:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:57.774 05:08:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:57.774 05:08:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:57.774 05:08:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:57.774 05:08:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:57.774 05:08:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:57.774 05:08:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:57.774 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:57.774 05:08:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:57.774 05:08:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:57.774 05:08:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:57.774 05:08:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:57.774 05:08:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:57.774 05:08:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:57.774 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:57.774 05:08:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:57.775 05:08:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:57.775 05:08:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:57.775 05:08:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:57.775 05:08:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:57.775 05:08:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:57.775 05:08:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:57.775 05:08:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:57.775 05:08:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:57.775 05:08:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:57.775 05:08:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:57.775 05:08:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:57.775 05:08:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:57.775 05:08:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:57.775 05:08:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:57.775 05:08:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:57.775 05:08:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:57.775 05:08:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:57.775 05:08:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:57.775 05:08:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:57.775 05:08:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:57.775 05:08:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:57.775 05:08:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:58.032 05:08:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:58.032 05:08:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:58.032 05:08:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:58.032 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:58.033 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.313 ms 00:12:58.033 00:12:58.033 --- 10.0.0.2 ping statistics --- 00:12:58.033 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:58.033 rtt min/avg/max/mdev = 0.313/0.313/0.313/0.000 ms 00:12:58.033 05:08:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:58.033 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:58.033 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.179 ms 00:12:58.033 00:12:58.033 --- 10.0.0.1 ping statistics --- 00:12:58.033 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:58.033 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:12:58.033 05:08:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:58.033 05:08:59 -- nvmf/common.sh@410 -- # return 0 00:12:58.033 05:08:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:58.033 05:08:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:58.033 05:08:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:58.033 05:08:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:58.033 05:08:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:58.033 05:08:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:58.033 05:08:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:58.033 05:08:59 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:12:58.033 05:08:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:58.033 05:08:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:58.033 05:08:59 -- common/autotest_common.sh@10 -- # set +x 00:12:58.033 05:08:59 -- nvmf/common.sh@469 -- # nvmfpid=3239905 00:12:58.033 05:08:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:58.033 05:08:59 -- nvmf/common.sh@470 -- # waitforlisten 3239905 00:12:58.033 05:08:59 -- common/autotest_common.sh@829 -- # '[' -z 3239905 ']' 00:12:58.033 05:08:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:58.033 05:08:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:58.033 05:08:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:58.033 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:58.033 05:08:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:58.033 05:08:59 -- common/autotest_common.sh@10 -- # set +x 00:12:58.033 [2024-11-26 05:08:59.631924] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:58.033 [2024-11-26 05:08:59.632010] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:58.033 EAL: No free 2048 kB hugepages reported on node 1 00:12:58.033 [2024-11-26 05:08:59.698813] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:58.033 [2024-11-26 05:08:59.781677] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:58.033 [2024-11-26 05:08:59.781840] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:58.033 [2024-11-26 05:08:59.781873] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:58.033 [2024-11-26 05:08:59.781896] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:58.033 [2024-11-26 05:08:59.781968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:58.033 [2024-11-26 05:08:59.781994] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:58.033 [2024-11-26 05:08:59.782055] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:58.033 [2024-11-26 05:08:59.782058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:58.964 05:09:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:58.964 05:09:00 -- common/autotest_common.sh@862 -- # return 0 00:12:58.964 05:09:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:58.964 05:09:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:58.964 05:09:00 -- common/autotest_common.sh@10 -- # set +x 00:12:58.964 05:09:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:58.964 05:09:00 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:58.964 05:09:00 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:58.964 05:09:00 -- target/multitarget.sh@21 -- # jq length 00:12:59.223 05:09:00 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:12:59.223 05:09:00 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:12:59.223 "nvmf_tgt_1" 00:12:59.223 05:09:00 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:12:59.223 "nvmf_tgt_2" 00:12:59.223 05:09:00 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:59.223 05:09:00 -- target/multitarget.sh@28 -- # jq length 00:12:59.480 05:09:01 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:12:59.480 05:09:01 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:12:59.480 true 00:12:59.480 05:09:01 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:12:59.738 true 00:12:59.738 05:09:01 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:59.738 05:09:01 -- target/multitarget.sh@35 -- # jq length 00:12:59.738 05:09:01 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:12:59.738 05:09:01 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:12:59.738 05:09:01 -- target/multitarget.sh@41 -- # nvmftestfini 00:12:59.738 05:09:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:59.738 05:09:01 -- nvmf/common.sh@116 -- # sync 00:12:59.738 05:09:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:59.738 05:09:01 -- nvmf/common.sh@119 -- # set +e 00:12:59.738 05:09:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:59.738 05:09:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:59.738 rmmod nvme_tcp 00:12:59.738 rmmod nvme_fabrics 00:12:59.738 rmmod nvme_keyring 00:12:59.996 05:09:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:59.996 05:09:01 -- nvmf/common.sh@123 -- # set -e 00:12:59.996 05:09:01 -- nvmf/common.sh@124 -- # return 0 00:12:59.996 05:09:01 -- nvmf/common.sh@477 -- # '[' -n 3239905 ']' 00:12:59.996 05:09:01 -- nvmf/common.sh@478 -- # killprocess 3239905 00:12:59.996 05:09:01 -- common/autotest_common.sh@936 -- # '[' -z 3239905 ']' 00:12:59.996 05:09:01 -- common/autotest_common.sh@940 -- # kill -0 3239905 00:12:59.996 05:09:01 -- common/autotest_common.sh@941 -- # uname 00:12:59.996 05:09:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:59.996 05:09:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3239905 00:12:59.996 05:09:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:59.996 05:09:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:59.996 05:09:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3239905' 00:12:59.996 killing process with pid 3239905 00:12:59.996 05:09:01 -- common/autotest_common.sh@955 -- # kill 3239905 00:12:59.996 05:09:01 -- common/autotest_common.sh@960 -- # wait 3239905 00:13:00.257 05:09:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:00.257 05:09:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:00.257 05:09:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:00.257 05:09:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:00.257 05:09:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:00.257 05:09:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:00.257 05:09:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:00.257 05:09:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:02.160 05:09:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:02.160 00:13:02.160 real 0m6.602s 00:13:02.160 user 0m9.734s 00:13:02.160 sys 0m2.013s 00:13:02.160 05:09:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:02.160 05:09:03 -- common/autotest_common.sh@10 -- # set +x 00:13:02.160 ************************************ 00:13:02.160 END TEST nvmf_multitarget 00:13:02.160 ************************************ 00:13:02.160 05:09:03 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:02.160 05:09:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:02.160 05:09:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:02.160 05:09:03 -- common/autotest_common.sh@10 -- # set +x 00:13:02.160 ************************************ 00:13:02.160 START TEST nvmf_rpc 00:13:02.160 ************************************ 00:13:02.160 05:09:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:02.160 * Looking for test storage... 00:13:02.160 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:02.160 05:09:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:02.160 05:09:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:02.160 05:09:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:02.419 05:09:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:02.420 05:09:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:02.420 05:09:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:02.420 05:09:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:02.420 05:09:03 -- scripts/common.sh@335 -- # IFS=.-: 00:13:02.420 05:09:03 -- scripts/common.sh@335 -- # read -ra ver1 00:13:02.420 05:09:03 -- scripts/common.sh@336 -- # IFS=.-: 00:13:02.420 05:09:03 -- scripts/common.sh@336 -- # read -ra ver2 00:13:02.420 05:09:03 -- scripts/common.sh@337 -- # local 'op=<' 00:13:02.420 05:09:03 -- scripts/common.sh@339 -- # ver1_l=2 00:13:02.420 05:09:03 -- scripts/common.sh@340 -- # ver2_l=1 00:13:02.420 05:09:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:02.420 05:09:03 -- scripts/common.sh@343 -- # case "$op" in 00:13:02.420 05:09:03 -- scripts/common.sh@344 -- # : 1 00:13:02.420 05:09:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:02.420 05:09:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:02.420 05:09:03 -- scripts/common.sh@364 -- # decimal 1 00:13:02.420 05:09:03 -- scripts/common.sh@352 -- # local d=1 00:13:02.420 05:09:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:02.420 05:09:03 -- scripts/common.sh@354 -- # echo 1 00:13:02.420 05:09:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:02.420 05:09:03 -- scripts/common.sh@365 -- # decimal 2 00:13:02.420 05:09:03 -- scripts/common.sh@352 -- # local d=2 00:13:02.420 05:09:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:02.420 05:09:03 -- scripts/common.sh@354 -- # echo 2 00:13:02.420 05:09:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:02.420 05:09:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:02.420 05:09:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:02.420 05:09:03 -- scripts/common.sh@367 -- # return 0 00:13:02.420 05:09:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:02.420 05:09:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:02.420 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:02.420 --rc genhtml_branch_coverage=1 00:13:02.420 --rc genhtml_function_coverage=1 00:13:02.420 --rc genhtml_legend=1 00:13:02.420 --rc geninfo_all_blocks=1 00:13:02.420 --rc geninfo_unexecuted_blocks=1 00:13:02.420 00:13:02.420 ' 00:13:02.420 05:09:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:02.420 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:02.420 --rc genhtml_branch_coverage=1 00:13:02.420 --rc genhtml_function_coverage=1 00:13:02.420 --rc genhtml_legend=1 00:13:02.420 --rc geninfo_all_blocks=1 00:13:02.420 --rc geninfo_unexecuted_blocks=1 00:13:02.420 00:13:02.420 ' 00:13:02.420 05:09:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:02.420 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:02.420 --rc genhtml_branch_coverage=1 00:13:02.420 --rc genhtml_function_coverage=1 00:13:02.420 --rc genhtml_legend=1 00:13:02.420 --rc geninfo_all_blocks=1 00:13:02.420 --rc geninfo_unexecuted_blocks=1 00:13:02.420 00:13:02.420 ' 00:13:02.420 05:09:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:02.420 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:02.420 --rc genhtml_branch_coverage=1 00:13:02.420 --rc genhtml_function_coverage=1 00:13:02.420 --rc genhtml_legend=1 00:13:02.420 --rc geninfo_all_blocks=1 00:13:02.420 --rc geninfo_unexecuted_blocks=1 00:13:02.420 00:13:02.420 ' 00:13:02.420 05:09:03 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:02.420 05:09:03 -- nvmf/common.sh@7 -- # uname -s 00:13:02.420 05:09:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:02.420 05:09:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:02.420 05:09:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:02.420 05:09:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:02.420 05:09:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:02.420 05:09:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:02.420 05:09:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:02.420 05:09:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:02.420 05:09:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:02.420 05:09:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:02.420 05:09:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:02.420 05:09:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:02.420 05:09:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:02.420 05:09:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:02.420 05:09:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:02.420 05:09:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:02.420 05:09:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:02.420 05:09:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:02.420 05:09:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:02.420 05:09:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:02.420 05:09:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:02.420 05:09:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:02.420 05:09:03 -- paths/export.sh@5 -- # export PATH 00:13:02.420 05:09:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:02.420 05:09:03 -- nvmf/common.sh@46 -- # : 0 00:13:02.420 05:09:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:02.420 05:09:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:02.420 05:09:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:02.420 05:09:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:02.420 05:09:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:02.420 05:09:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:02.420 05:09:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:02.420 05:09:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:02.420 05:09:03 -- target/rpc.sh@11 -- # loops=5 00:13:02.420 05:09:03 -- target/rpc.sh@23 -- # nvmftestinit 00:13:02.420 05:09:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:02.420 05:09:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:02.420 05:09:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:02.420 05:09:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:02.420 05:09:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:02.420 05:09:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:02.420 05:09:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:02.420 05:09:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:02.420 05:09:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:02.420 05:09:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:02.420 05:09:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:02.420 05:09:03 -- common/autotest_common.sh@10 -- # set +x 00:13:04.322 05:09:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:04.322 05:09:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:04.322 05:09:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:04.322 05:09:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:04.322 05:09:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:04.322 05:09:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:04.322 05:09:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:04.322 05:09:06 -- nvmf/common.sh@294 -- # net_devs=() 00:13:04.322 05:09:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:04.322 05:09:06 -- nvmf/common.sh@295 -- # e810=() 00:13:04.322 05:09:06 -- nvmf/common.sh@295 -- # local -ga e810 00:13:04.322 05:09:06 -- nvmf/common.sh@296 -- # x722=() 00:13:04.322 05:09:06 -- nvmf/common.sh@296 -- # local -ga x722 00:13:04.322 05:09:06 -- nvmf/common.sh@297 -- # mlx=() 00:13:04.322 05:09:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:04.322 05:09:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:04.322 05:09:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:04.322 05:09:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:04.322 05:09:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:04.322 05:09:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:04.322 05:09:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:04.322 05:09:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:04.322 05:09:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:04.322 05:09:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:04.322 05:09:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:04.322 05:09:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:04.322 05:09:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:04.322 05:09:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:04.322 05:09:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:04.322 05:09:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:04.322 05:09:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:04.322 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:04.322 05:09:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:04.322 05:09:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:04.322 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:04.322 05:09:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:04.322 05:09:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:04.322 05:09:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:04.322 05:09:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:04.322 05:09:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:04.322 05:09:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:04.322 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:04.322 05:09:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:04.322 05:09:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:04.322 05:09:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:04.322 05:09:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:04.322 05:09:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:04.322 05:09:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:04.322 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:04.322 05:09:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:04.322 05:09:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:04.322 05:09:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:04.322 05:09:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:04.322 05:09:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:04.322 05:09:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:04.322 05:09:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:04.322 05:09:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:04.322 05:09:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:04.322 05:09:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:04.322 05:09:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:04.322 05:09:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:04.322 05:09:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:04.322 05:09:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:04.322 05:09:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:04.322 05:09:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:04.322 05:09:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:04.322 05:09:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:04.581 05:09:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:04.581 05:09:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:04.581 05:09:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:04.581 05:09:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:04.581 05:09:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:04.581 05:09:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:04.581 05:09:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:04.581 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:04.581 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.311 ms 00:13:04.581 00:13:04.581 --- 10.0.0.2 ping statistics --- 00:13:04.581 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:04.581 rtt min/avg/max/mdev = 0.311/0.311/0.311/0.000 ms 00:13:04.581 05:09:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:04.581 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:04.581 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:13:04.581 00:13:04.581 --- 10.0.0.1 ping statistics --- 00:13:04.581 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:04.581 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:13:04.581 05:09:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:04.581 05:09:06 -- nvmf/common.sh@410 -- # return 0 00:13:04.581 05:09:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:04.581 05:09:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:04.582 05:09:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:04.582 05:09:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:04.582 05:09:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:04.582 05:09:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:04.582 05:09:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:04.582 05:09:06 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:04.582 05:09:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:04.582 05:09:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:04.582 05:09:06 -- common/autotest_common.sh@10 -- # set +x 00:13:04.582 05:09:06 -- nvmf/common.sh@469 -- # nvmfpid=3242262 00:13:04.582 05:09:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:04.582 05:09:06 -- nvmf/common.sh@470 -- # waitforlisten 3242262 00:13:04.582 05:09:06 -- common/autotest_common.sh@829 -- # '[' -z 3242262 ']' 00:13:04.582 05:09:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:04.582 05:09:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:04.582 05:09:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:04.582 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:04.582 05:09:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:04.582 05:09:06 -- common/autotest_common.sh@10 -- # set +x 00:13:04.582 [2024-11-26 05:09:06.334183] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:04.582 [2024-11-26 05:09:06.334263] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:04.840 EAL: No free 2048 kB hugepages reported on node 1 00:13:04.840 [2024-11-26 05:09:06.406835] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:04.840 [2024-11-26 05:09:06.501133] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:04.840 [2024-11-26 05:09:06.501303] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:04.840 [2024-11-26 05:09:06.501324] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:04.840 [2024-11-26 05:09:06.501339] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:04.840 [2024-11-26 05:09:06.501441] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:04.840 [2024-11-26 05:09:06.501505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:04.840 [2024-11-26 05:09:06.501559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:04.840 [2024-11-26 05:09:06.501562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:05.774 05:09:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:05.774 05:09:07 -- common/autotest_common.sh@862 -- # return 0 00:13:05.774 05:09:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:05.774 05:09:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:05.774 05:09:07 -- common/autotest_common.sh@10 -- # set +x 00:13:05.774 05:09:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:05.774 05:09:07 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:05.774 05:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.774 05:09:07 -- common/autotest_common.sh@10 -- # set +x 00:13:05.774 05:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.774 05:09:07 -- target/rpc.sh@26 -- # stats='{ 00:13:05.774 "tick_rate": 2700000000, 00:13:05.774 "poll_groups": [ 00:13:05.774 { 00:13:05.774 "name": "nvmf_tgt_poll_group_0", 00:13:05.774 "admin_qpairs": 0, 00:13:05.774 "io_qpairs": 0, 00:13:05.774 "current_admin_qpairs": 0, 00:13:05.774 "current_io_qpairs": 0, 00:13:05.774 "pending_bdev_io": 0, 00:13:05.774 "completed_nvme_io": 0, 00:13:05.774 "transports": [] 00:13:05.774 }, 00:13:05.774 { 00:13:05.774 "name": "nvmf_tgt_poll_group_1", 00:13:05.774 "admin_qpairs": 0, 00:13:05.774 "io_qpairs": 0, 00:13:05.774 "current_admin_qpairs": 0, 00:13:05.774 "current_io_qpairs": 0, 00:13:05.774 "pending_bdev_io": 0, 00:13:05.774 "completed_nvme_io": 0, 00:13:05.774 "transports": [] 00:13:05.774 }, 00:13:05.774 { 00:13:05.774 "name": "nvmf_tgt_poll_group_2", 00:13:05.774 "admin_qpairs": 0, 00:13:05.774 "io_qpairs": 0, 00:13:05.774 "current_admin_qpairs": 0, 00:13:05.774 "current_io_qpairs": 0, 00:13:05.774 "pending_bdev_io": 0, 00:13:05.774 "completed_nvme_io": 0, 00:13:05.774 "transports": [] 00:13:05.774 }, 00:13:05.774 { 00:13:05.774 "name": "nvmf_tgt_poll_group_3", 00:13:05.774 "admin_qpairs": 0, 00:13:05.774 "io_qpairs": 0, 00:13:05.774 "current_admin_qpairs": 0, 00:13:05.774 "current_io_qpairs": 0, 00:13:05.774 "pending_bdev_io": 0, 00:13:05.774 "completed_nvme_io": 0, 00:13:05.774 "transports": [] 00:13:05.774 } 00:13:05.774 ] 00:13:05.774 }' 00:13:05.774 05:09:07 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:05.774 05:09:07 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:05.774 05:09:07 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:05.774 05:09:07 -- target/rpc.sh@15 -- # wc -l 00:13:05.774 05:09:07 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:05.774 05:09:07 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:05.774 05:09:07 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:05.774 05:09:07 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:05.774 05:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.774 05:09:07 -- common/autotest_common.sh@10 -- # set +x 00:13:05.774 [2024-11-26 05:09:07.448744] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:05.774 05:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.774 05:09:07 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:05.774 05:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.774 05:09:07 -- common/autotest_common.sh@10 -- # set +x 00:13:05.774 05:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.774 05:09:07 -- target/rpc.sh@33 -- # stats='{ 00:13:05.774 "tick_rate": 2700000000, 00:13:05.774 "poll_groups": [ 00:13:05.774 { 00:13:05.774 "name": "nvmf_tgt_poll_group_0", 00:13:05.774 "admin_qpairs": 0, 00:13:05.774 "io_qpairs": 0, 00:13:05.774 "current_admin_qpairs": 0, 00:13:05.774 "current_io_qpairs": 0, 00:13:05.774 "pending_bdev_io": 0, 00:13:05.774 "completed_nvme_io": 0, 00:13:05.774 "transports": [ 00:13:05.774 { 00:13:05.774 "trtype": "TCP" 00:13:05.774 } 00:13:05.774 ] 00:13:05.774 }, 00:13:05.774 { 00:13:05.774 "name": "nvmf_tgt_poll_group_1", 00:13:05.774 "admin_qpairs": 0, 00:13:05.774 "io_qpairs": 0, 00:13:05.774 "current_admin_qpairs": 0, 00:13:05.774 "current_io_qpairs": 0, 00:13:05.774 "pending_bdev_io": 0, 00:13:05.774 "completed_nvme_io": 0, 00:13:05.774 "transports": [ 00:13:05.774 { 00:13:05.774 "trtype": "TCP" 00:13:05.774 } 00:13:05.774 ] 00:13:05.774 }, 00:13:05.774 { 00:13:05.774 "name": "nvmf_tgt_poll_group_2", 00:13:05.774 "admin_qpairs": 0, 00:13:05.774 "io_qpairs": 0, 00:13:05.774 "current_admin_qpairs": 0, 00:13:05.774 "current_io_qpairs": 0, 00:13:05.774 "pending_bdev_io": 0, 00:13:05.774 "completed_nvme_io": 0, 00:13:05.774 "transports": [ 00:13:05.774 { 00:13:05.774 "trtype": "TCP" 00:13:05.774 } 00:13:05.774 ] 00:13:05.774 }, 00:13:05.774 { 00:13:05.774 "name": "nvmf_tgt_poll_group_3", 00:13:05.774 "admin_qpairs": 0, 00:13:05.774 "io_qpairs": 0, 00:13:05.774 "current_admin_qpairs": 0, 00:13:05.774 "current_io_qpairs": 0, 00:13:05.774 "pending_bdev_io": 0, 00:13:05.774 "completed_nvme_io": 0, 00:13:05.774 "transports": [ 00:13:05.774 { 00:13:05.774 "trtype": "TCP" 00:13:05.774 } 00:13:05.774 ] 00:13:05.774 } 00:13:05.774 ] 00:13:05.774 }' 00:13:05.774 05:09:07 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:05.774 05:09:07 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:05.774 05:09:07 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:05.774 05:09:07 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:05.774 05:09:07 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:05.774 05:09:07 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:05.774 05:09:07 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:05.774 05:09:07 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:05.774 05:09:07 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:06.033 05:09:07 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:06.033 05:09:07 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:06.033 05:09:07 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:06.033 05:09:07 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:06.033 05:09:07 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:06.033 05:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.033 05:09:07 -- common/autotest_common.sh@10 -- # set +x 00:13:06.033 Malloc1 00:13:06.033 05:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.033 05:09:07 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:06.033 05:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.033 05:09:07 -- common/autotest_common.sh@10 -- # set +x 00:13:06.033 05:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.033 05:09:07 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:06.033 05:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.033 05:09:07 -- common/autotest_common.sh@10 -- # set +x 00:13:06.033 05:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.033 05:09:07 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:06.033 05:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.033 05:09:07 -- common/autotest_common.sh@10 -- # set +x 00:13:06.033 05:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.033 05:09:07 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:06.033 05:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.033 05:09:07 -- common/autotest_common.sh@10 -- # set +x 00:13:06.033 [2024-11-26 05:09:07.597987] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:06.033 05:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.033 05:09:07 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:06.033 05:09:07 -- common/autotest_common.sh@650 -- # local es=0 00:13:06.033 05:09:07 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:06.033 05:09:07 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:06.033 05:09:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:06.033 05:09:07 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:06.033 05:09:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:06.033 05:09:07 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:06.033 05:09:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:06.033 05:09:07 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:06.033 05:09:07 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:06.033 05:09:07 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:06.033 [2024-11-26 05:09:07.620418] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:06.033 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:06.033 could not add new controller: failed to write to nvme-fabrics device 00:13:06.033 05:09:07 -- common/autotest_common.sh@653 -- # es=1 00:13:06.033 05:09:07 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:06.033 05:09:07 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:06.033 05:09:07 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:06.033 05:09:07 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:06.033 05:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.033 05:09:07 -- common/autotest_common.sh@10 -- # set +x 00:13:06.033 05:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.033 05:09:07 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:06.601 05:09:08 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:06.601 05:09:08 -- common/autotest_common.sh@1187 -- # local i=0 00:13:06.601 05:09:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:06.601 05:09:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:06.601 05:09:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:09.157 05:09:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:09.157 05:09:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:09.157 05:09:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:09.157 05:09:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:09.157 05:09:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:09.157 05:09:10 -- common/autotest_common.sh@1197 -- # return 0 00:13:09.157 05:09:10 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:09.157 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:09.157 05:09:10 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:09.157 05:09:10 -- common/autotest_common.sh@1208 -- # local i=0 00:13:09.157 05:09:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:09.157 05:09:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:09.157 05:09:10 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:09.157 05:09:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:09.157 05:09:10 -- common/autotest_common.sh@1220 -- # return 0 00:13:09.157 05:09:10 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:09.157 05:09:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:09.157 05:09:10 -- common/autotest_common.sh@10 -- # set +x 00:13:09.157 05:09:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:09.157 05:09:10 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:09.157 05:09:10 -- common/autotest_common.sh@650 -- # local es=0 00:13:09.157 05:09:10 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:09.157 05:09:10 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:09.157 05:09:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:09.157 05:09:10 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:09.157 05:09:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:09.157 05:09:10 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:09.157 05:09:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:09.157 05:09:10 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:09.157 05:09:10 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:09.157 05:09:10 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:09.157 [2024-11-26 05:09:10.461463] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:09.157 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:09.157 could not add new controller: failed to write to nvme-fabrics device 00:13:09.157 05:09:10 -- common/autotest_common.sh@653 -- # es=1 00:13:09.157 05:09:10 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:09.157 05:09:10 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:09.157 05:09:10 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:09.157 05:09:10 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:09.157 05:09:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:09.157 05:09:10 -- common/autotest_common.sh@10 -- # set +x 00:13:09.157 05:09:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:09.157 05:09:10 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:09.726 05:09:11 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:09.726 05:09:11 -- common/autotest_common.sh@1187 -- # local i=0 00:13:09.726 05:09:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:09.726 05:09:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:09.726 05:09:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:11.630 05:09:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:11.630 05:09:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:11.630 05:09:13 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:11.630 05:09:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:11.630 05:09:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:11.630 05:09:13 -- common/autotest_common.sh@1197 -- # return 0 00:13:11.630 05:09:13 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:11.630 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:11.630 05:09:13 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:11.630 05:09:13 -- common/autotest_common.sh@1208 -- # local i=0 00:13:11.630 05:09:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:11.630 05:09:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:11.630 05:09:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:11.630 05:09:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:11.630 05:09:13 -- common/autotest_common.sh@1220 -- # return 0 00:13:11.630 05:09:13 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:11.630 05:09:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.630 05:09:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.630 05:09:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.630 05:09:13 -- target/rpc.sh@81 -- # seq 1 5 00:13:11.630 05:09:13 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:11.630 05:09:13 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:11.630 05:09:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.630 05:09:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.630 05:09:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.630 05:09:13 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:11.630 05:09:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.630 05:09:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.630 [2024-11-26 05:09:13.333862] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:11.630 05:09:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.630 05:09:13 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:11.630 05:09:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.630 05:09:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.630 05:09:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.630 05:09:13 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:11.630 05:09:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.630 05:09:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.630 05:09:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.630 05:09:13 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:12.570 05:09:14 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:12.570 05:09:14 -- common/autotest_common.sh@1187 -- # local i=0 00:13:12.570 05:09:14 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:12.570 05:09:14 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:12.570 05:09:14 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:14.475 05:09:16 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:14.475 05:09:16 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:14.475 05:09:16 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:14.475 05:09:16 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:14.475 05:09:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:14.475 05:09:16 -- common/autotest_common.sh@1197 -- # return 0 00:13:14.475 05:09:16 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:14.475 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:14.475 05:09:16 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:14.475 05:09:16 -- common/autotest_common.sh@1208 -- # local i=0 00:13:14.475 05:09:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:14.475 05:09:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:14.475 05:09:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:14.475 05:09:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:14.475 05:09:16 -- common/autotest_common.sh@1220 -- # return 0 00:13:14.475 05:09:16 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:14.475 05:09:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.475 05:09:16 -- common/autotest_common.sh@10 -- # set +x 00:13:14.475 05:09:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.475 05:09:16 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:14.475 05:09:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.475 05:09:16 -- common/autotest_common.sh@10 -- # set +x 00:13:14.475 05:09:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.475 05:09:16 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:14.475 05:09:16 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:14.475 05:09:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.475 05:09:16 -- common/autotest_common.sh@10 -- # set +x 00:13:14.475 05:09:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.475 05:09:16 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:14.475 05:09:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.475 05:09:16 -- common/autotest_common.sh@10 -- # set +x 00:13:14.475 [2024-11-26 05:09:16.164388] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:14.475 05:09:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.475 05:09:16 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:14.475 05:09:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.475 05:09:16 -- common/autotest_common.sh@10 -- # set +x 00:13:14.475 05:09:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.475 05:09:16 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:14.475 05:09:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.475 05:09:16 -- common/autotest_common.sh@10 -- # set +x 00:13:14.475 05:09:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.475 05:09:16 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:15.043 05:09:16 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:15.043 05:09:16 -- common/autotest_common.sh@1187 -- # local i=0 00:13:15.043 05:09:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:15.043 05:09:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:15.043 05:09:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:17.584 05:09:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:17.584 05:09:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:17.584 05:09:18 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:17.584 05:09:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:17.584 05:09:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:17.584 05:09:18 -- common/autotest_common.sh@1197 -- # return 0 00:13:17.584 05:09:18 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:17.584 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:17.584 05:09:18 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:17.584 05:09:18 -- common/autotest_common.sh@1208 -- # local i=0 00:13:17.584 05:09:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:17.584 05:09:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:17.584 05:09:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:17.584 05:09:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:17.584 05:09:18 -- common/autotest_common.sh@1220 -- # return 0 00:13:17.584 05:09:18 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:17.584 05:09:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.584 05:09:18 -- common/autotest_common.sh@10 -- # set +x 00:13:17.584 05:09:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.584 05:09:18 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:17.584 05:09:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.584 05:09:18 -- common/autotest_common.sh@10 -- # set +x 00:13:17.584 05:09:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.584 05:09:18 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:17.584 05:09:18 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:17.584 05:09:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.584 05:09:18 -- common/autotest_common.sh@10 -- # set +x 00:13:17.584 05:09:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.584 05:09:18 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:17.584 05:09:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.584 05:09:18 -- common/autotest_common.sh@10 -- # set +x 00:13:17.584 [2024-11-26 05:09:18.900501] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:17.584 05:09:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.584 05:09:18 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:17.584 05:09:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.584 05:09:18 -- common/autotest_common.sh@10 -- # set +x 00:13:17.584 05:09:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.584 05:09:18 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:17.584 05:09:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.584 05:09:18 -- common/autotest_common.sh@10 -- # set +x 00:13:17.584 05:09:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.584 05:09:18 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:17.844 05:09:19 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:17.844 05:09:19 -- common/autotest_common.sh@1187 -- # local i=0 00:13:17.844 05:09:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:17.844 05:09:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:17.844 05:09:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:19.752 05:09:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:20.012 05:09:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:20.012 05:09:21 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:20.012 05:09:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:20.012 05:09:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:20.012 05:09:21 -- common/autotest_common.sh@1197 -- # return 0 00:13:20.012 05:09:21 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:20.012 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:20.012 05:09:21 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:20.012 05:09:21 -- common/autotest_common.sh@1208 -- # local i=0 00:13:20.012 05:09:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:20.012 05:09:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:20.012 05:09:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:20.012 05:09:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:20.012 05:09:21 -- common/autotest_common.sh@1220 -- # return 0 00:13:20.012 05:09:21 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:20.012 05:09:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.012 05:09:21 -- common/autotest_common.sh@10 -- # set +x 00:13:20.012 05:09:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.012 05:09:21 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:20.012 05:09:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.012 05:09:21 -- common/autotest_common.sh@10 -- # set +x 00:13:20.012 05:09:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.012 05:09:21 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:20.012 05:09:21 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:20.012 05:09:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.012 05:09:21 -- common/autotest_common.sh@10 -- # set +x 00:13:20.012 05:09:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.012 05:09:21 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:20.012 05:09:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.012 05:09:21 -- common/autotest_common.sh@10 -- # set +x 00:13:20.012 [2024-11-26 05:09:21.661743] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:20.012 05:09:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.012 05:09:21 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:20.012 05:09:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.012 05:09:21 -- common/autotest_common.sh@10 -- # set +x 00:13:20.012 05:09:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.012 05:09:21 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:20.012 05:09:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.012 05:09:21 -- common/autotest_common.sh@10 -- # set +x 00:13:20.012 05:09:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.012 05:09:21 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:20.582 05:09:22 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:20.582 05:09:22 -- common/autotest_common.sh@1187 -- # local i=0 00:13:20.582 05:09:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:20.582 05:09:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:20.582 05:09:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:23.116 05:09:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:23.116 05:09:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:23.116 05:09:24 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:23.116 05:09:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:23.116 05:09:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:23.116 05:09:24 -- common/autotest_common.sh@1197 -- # return 0 00:13:23.116 05:09:24 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:23.116 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:23.116 05:09:24 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:23.116 05:09:24 -- common/autotest_common.sh@1208 -- # local i=0 00:13:23.116 05:09:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:23.116 05:09:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:23.116 05:09:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:23.116 05:09:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:23.116 05:09:24 -- common/autotest_common.sh@1220 -- # return 0 00:13:23.116 05:09:24 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.116 05:09:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.116 05:09:24 -- common/autotest_common.sh@10 -- # set +x 00:13:23.116 05:09:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.116 05:09:24 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:23.116 05:09:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.116 05:09:24 -- common/autotest_common.sh@10 -- # set +x 00:13:23.116 05:09:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.116 05:09:24 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:23.116 05:09:24 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:23.116 05:09:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.116 05:09:24 -- common/autotest_common.sh@10 -- # set +x 00:13:23.116 05:09:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.116 05:09:24 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:23.116 05:09:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.116 05:09:24 -- common/autotest_common.sh@10 -- # set +x 00:13:23.116 [2024-11-26 05:09:24.422632] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:23.116 05:09:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.116 05:09:24 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:23.116 05:09:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.116 05:09:24 -- common/autotest_common.sh@10 -- # set +x 00:13:23.116 05:09:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.116 05:09:24 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:23.116 05:09:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.116 05:09:24 -- common/autotest_common.sh@10 -- # set +x 00:13:23.116 05:09:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.116 05:09:24 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:23.377 05:09:25 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:23.377 05:09:25 -- common/autotest_common.sh@1187 -- # local i=0 00:13:23.377 05:09:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:23.377 05:09:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:23.377 05:09:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:25.285 05:09:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:25.285 05:09:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:25.285 05:09:27 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:25.285 05:09:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:25.285 05:09:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:25.285 05:09:27 -- common/autotest_common.sh@1197 -- # return 0 00:13:25.285 05:09:27 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:25.545 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:25.545 05:09:27 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:25.545 05:09:27 -- common/autotest_common.sh@1208 -- # local i=0 00:13:25.545 05:09:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:25.545 05:09:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:25.545 05:09:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:25.545 05:09:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:25.545 05:09:27 -- common/autotest_common.sh@1220 -- # return 0 00:13:25.545 05:09:27 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:25.545 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.545 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.545 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.545 05:09:27 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:25.545 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.545 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.545 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.545 05:09:27 -- target/rpc.sh@99 -- # seq 1 5 00:13:25.545 05:09:27 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:25.545 05:09:27 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:25.545 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.545 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.545 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.545 05:09:27 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:25.545 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.545 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.545 [2024-11-26 05:09:27.186634] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:25.545 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.545 05:09:27 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:25.545 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.545 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.545 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.545 05:09:27 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:25.545 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.545 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.545 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.545 05:09:27 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.545 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.545 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.545 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.545 05:09:27 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:25.545 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.545 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.545 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.545 05:09:27 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:25.545 05:09:27 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:25.545 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.545 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.545 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.545 05:09:27 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:25.545 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.545 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.545 [2024-11-26 05:09:27.234730] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:25.545 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.545 05:09:27 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:25.545 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.545 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.546 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.546 05:09:27 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:25.546 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.546 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.546 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.546 05:09:27 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.546 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.546 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.546 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.546 05:09:27 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:25.546 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.546 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.546 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.546 05:09:27 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:25.546 05:09:27 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:25.546 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.546 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.546 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.546 05:09:27 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:25.546 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.546 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.546 [2024-11-26 05:09:27.282888] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:25.546 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.546 05:09:27 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:25.546 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.546 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.546 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.546 05:09:27 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:25.546 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.546 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.546 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.546 05:09:27 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.546 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.546 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:25.806 05:09:27 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 [2024-11-26 05:09:27.331057] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:25.806 05:09:27 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 [2024-11-26 05:09:27.379213] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:25.806 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.806 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.806 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.806 05:09:27 -- target/rpc.sh@110 -- # stats='{ 00:13:25.806 "tick_rate": 2700000000, 00:13:25.806 "poll_groups": [ 00:13:25.806 { 00:13:25.806 "name": "nvmf_tgt_poll_group_0", 00:13:25.806 "admin_qpairs": 2, 00:13:25.806 "io_qpairs": 84, 00:13:25.806 "current_admin_qpairs": 0, 00:13:25.806 "current_io_qpairs": 0, 00:13:25.806 "pending_bdev_io": 0, 00:13:25.806 "completed_nvme_io": 136, 00:13:25.806 "transports": [ 00:13:25.806 { 00:13:25.806 "trtype": "TCP" 00:13:25.806 } 00:13:25.806 ] 00:13:25.806 }, 00:13:25.806 { 00:13:25.806 "name": "nvmf_tgt_poll_group_1", 00:13:25.806 "admin_qpairs": 2, 00:13:25.806 "io_qpairs": 84, 00:13:25.806 "current_admin_qpairs": 0, 00:13:25.806 "current_io_qpairs": 0, 00:13:25.806 "pending_bdev_io": 0, 00:13:25.806 "completed_nvme_io": 231, 00:13:25.806 "transports": [ 00:13:25.806 { 00:13:25.806 "trtype": "TCP" 00:13:25.806 } 00:13:25.806 ] 00:13:25.806 }, 00:13:25.806 { 00:13:25.806 "name": "nvmf_tgt_poll_group_2", 00:13:25.806 "admin_qpairs": 1, 00:13:25.806 "io_qpairs": 84, 00:13:25.806 "current_admin_qpairs": 0, 00:13:25.806 "current_io_qpairs": 0, 00:13:25.806 "pending_bdev_io": 0, 00:13:25.807 "completed_nvme_io": 185, 00:13:25.807 "transports": [ 00:13:25.807 { 00:13:25.807 "trtype": "TCP" 00:13:25.807 } 00:13:25.807 ] 00:13:25.807 }, 00:13:25.807 { 00:13:25.807 "name": "nvmf_tgt_poll_group_3", 00:13:25.807 "admin_qpairs": 2, 00:13:25.807 "io_qpairs": 84, 00:13:25.807 "current_admin_qpairs": 0, 00:13:25.807 "current_io_qpairs": 0, 00:13:25.807 "pending_bdev_io": 0, 00:13:25.807 "completed_nvme_io": 134, 00:13:25.807 "transports": [ 00:13:25.807 { 00:13:25.807 "trtype": "TCP" 00:13:25.807 } 00:13:25.807 ] 00:13:25.807 } 00:13:25.807 ] 00:13:25.807 }' 00:13:25.807 05:09:27 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:25.807 05:09:27 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:25.807 05:09:27 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:25.807 05:09:27 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:25.807 05:09:27 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:25.807 05:09:27 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:25.807 05:09:27 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:25.807 05:09:27 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:25.807 05:09:27 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:25.807 05:09:27 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:25.807 05:09:27 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:25.807 05:09:27 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:25.807 05:09:27 -- target/rpc.sh@123 -- # nvmftestfini 00:13:25.807 05:09:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:25.807 05:09:27 -- nvmf/common.sh@116 -- # sync 00:13:25.807 05:09:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:25.807 05:09:27 -- nvmf/common.sh@119 -- # set +e 00:13:25.807 05:09:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:25.807 05:09:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:25.807 rmmod nvme_tcp 00:13:25.807 rmmod nvme_fabrics 00:13:25.807 rmmod nvme_keyring 00:13:25.807 05:09:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:25.807 05:09:27 -- nvmf/common.sh@123 -- # set -e 00:13:25.807 05:09:27 -- nvmf/common.sh@124 -- # return 0 00:13:25.807 05:09:27 -- nvmf/common.sh@477 -- # '[' -n 3242262 ']' 00:13:25.807 05:09:27 -- nvmf/common.sh@478 -- # killprocess 3242262 00:13:25.807 05:09:27 -- common/autotest_common.sh@936 -- # '[' -z 3242262 ']' 00:13:25.807 05:09:27 -- common/autotest_common.sh@940 -- # kill -0 3242262 00:13:25.807 05:09:27 -- common/autotest_common.sh@941 -- # uname 00:13:25.807 05:09:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:25.807 05:09:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3242262 00:13:26.067 05:09:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:26.067 05:09:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:26.067 05:09:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3242262' 00:13:26.067 killing process with pid 3242262 00:13:26.067 05:09:27 -- common/autotest_common.sh@955 -- # kill 3242262 00:13:26.067 05:09:27 -- common/autotest_common.sh@960 -- # wait 3242262 00:13:26.332 05:09:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:26.332 05:09:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:26.332 05:09:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:26.332 05:09:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:26.332 05:09:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:26.332 05:09:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:26.332 05:09:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:26.332 05:09:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:28.294 05:09:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:28.294 00:13:28.294 real 0m26.075s 00:13:28.294 user 1m24.807s 00:13:28.294 sys 0m4.300s 00:13:28.294 05:09:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:28.294 05:09:29 -- common/autotest_common.sh@10 -- # set +x 00:13:28.294 ************************************ 00:13:28.294 END TEST nvmf_rpc 00:13:28.294 ************************************ 00:13:28.294 05:09:29 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:28.294 05:09:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:28.294 05:09:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:28.294 05:09:29 -- common/autotest_common.sh@10 -- # set +x 00:13:28.294 ************************************ 00:13:28.294 START TEST nvmf_invalid 00:13:28.294 ************************************ 00:13:28.294 05:09:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:28.294 * Looking for test storage... 00:13:28.294 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:28.294 05:09:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:28.294 05:09:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:28.294 05:09:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:28.553 05:09:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:28.553 05:09:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:28.553 05:09:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:28.553 05:09:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:28.553 05:09:30 -- scripts/common.sh@335 -- # IFS=.-: 00:13:28.553 05:09:30 -- scripts/common.sh@335 -- # read -ra ver1 00:13:28.553 05:09:30 -- scripts/common.sh@336 -- # IFS=.-: 00:13:28.553 05:09:30 -- scripts/common.sh@336 -- # read -ra ver2 00:13:28.553 05:09:30 -- scripts/common.sh@337 -- # local 'op=<' 00:13:28.553 05:09:30 -- scripts/common.sh@339 -- # ver1_l=2 00:13:28.553 05:09:30 -- scripts/common.sh@340 -- # ver2_l=1 00:13:28.553 05:09:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:28.553 05:09:30 -- scripts/common.sh@343 -- # case "$op" in 00:13:28.553 05:09:30 -- scripts/common.sh@344 -- # : 1 00:13:28.553 05:09:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:28.553 05:09:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:28.553 05:09:30 -- scripts/common.sh@364 -- # decimal 1 00:13:28.553 05:09:30 -- scripts/common.sh@352 -- # local d=1 00:13:28.553 05:09:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:28.553 05:09:30 -- scripts/common.sh@354 -- # echo 1 00:13:28.553 05:09:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:28.553 05:09:30 -- scripts/common.sh@365 -- # decimal 2 00:13:28.553 05:09:30 -- scripts/common.sh@352 -- # local d=2 00:13:28.553 05:09:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:28.553 05:09:30 -- scripts/common.sh@354 -- # echo 2 00:13:28.553 05:09:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:28.553 05:09:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:28.553 05:09:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:28.553 05:09:30 -- scripts/common.sh@367 -- # return 0 00:13:28.553 05:09:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:28.553 05:09:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:28.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:28.553 --rc genhtml_branch_coverage=1 00:13:28.553 --rc genhtml_function_coverage=1 00:13:28.553 --rc genhtml_legend=1 00:13:28.553 --rc geninfo_all_blocks=1 00:13:28.553 --rc geninfo_unexecuted_blocks=1 00:13:28.553 00:13:28.553 ' 00:13:28.553 05:09:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:28.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:28.553 --rc genhtml_branch_coverage=1 00:13:28.553 --rc genhtml_function_coverage=1 00:13:28.553 --rc genhtml_legend=1 00:13:28.553 --rc geninfo_all_blocks=1 00:13:28.553 --rc geninfo_unexecuted_blocks=1 00:13:28.553 00:13:28.553 ' 00:13:28.553 05:09:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:28.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:28.553 --rc genhtml_branch_coverage=1 00:13:28.553 --rc genhtml_function_coverage=1 00:13:28.553 --rc genhtml_legend=1 00:13:28.553 --rc geninfo_all_blocks=1 00:13:28.553 --rc geninfo_unexecuted_blocks=1 00:13:28.553 00:13:28.553 ' 00:13:28.553 05:09:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:28.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:28.553 --rc genhtml_branch_coverage=1 00:13:28.553 --rc genhtml_function_coverage=1 00:13:28.553 --rc genhtml_legend=1 00:13:28.553 --rc geninfo_all_blocks=1 00:13:28.553 --rc geninfo_unexecuted_blocks=1 00:13:28.553 00:13:28.553 ' 00:13:28.553 05:09:30 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:28.553 05:09:30 -- nvmf/common.sh@7 -- # uname -s 00:13:28.553 05:09:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:28.553 05:09:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:28.553 05:09:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:28.553 05:09:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:28.553 05:09:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:28.553 05:09:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:28.553 05:09:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:28.553 05:09:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:28.553 05:09:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:28.553 05:09:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:28.553 05:09:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:28.553 05:09:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:28.553 05:09:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:28.553 05:09:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:28.553 05:09:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:28.553 05:09:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:28.553 05:09:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:28.553 05:09:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:28.553 05:09:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:28.553 05:09:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.553 05:09:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.554 05:09:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.554 05:09:30 -- paths/export.sh@5 -- # export PATH 00:13:28.554 05:09:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.554 05:09:30 -- nvmf/common.sh@46 -- # : 0 00:13:28.554 05:09:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:28.554 05:09:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:28.554 05:09:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:28.554 05:09:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:28.554 05:09:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:28.554 05:09:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:28.554 05:09:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:28.554 05:09:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:28.554 05:09:30 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:28.554 05:09:30 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:28.554 05:09:30 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:28.554 05:09:30 -- target/invalid.sh@14 -- # target=foobar 00:13:28.554 05:09:30 -- target/invalid.sh@16 -- # RANDOM=0 00:13:28.554 05:09:30 -- target/invalid.sh@34 -- # nvmftestinit 00:13:28.554 05:09:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:28.554 05:09:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:28.554 05:09:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:28.554 05:09:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:28.554 05:09:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:28.554 05:09:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:28.554 05:09:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:28.554 05:09:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:28.554 05:09:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:28.554 05:09:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:28.554 05:09:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:28.554 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:13:30.457 05:09:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:30.457 05:09:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:30.457 05:09:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:30.457 05:09:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:30.457 05:09:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:30.457 05:09:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:30.457 05:09:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:30.457 05:09:32 -- nvmf/common.sh@294 -- # net_devs=() 00:13:30.457 05:09:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:30.457 05:09:32 -- nvmf/common.sh@295 -- # e810=() 00:13:30.457 05:09:32 -- nvmf/common.sh@295 -- # local -ga e810 00:13:30.457 05:09:32 -- nvmf/common.sh@296 -- # x722=() 00:13:30.457 05:09:32 -- nvmf/common.sh@296 -- # local -ga x722 00:13:30.457 05:09:32 -- nvmf/common.sh@297 -- # mlx=() 00:13:30.457 05:09:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:30.457 05:09:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:30.457 05:09:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:30.457 05:09:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:30.457 05:09:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:30.457 05:09:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:30.457 05:09:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:30.457 05:09:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:30.457 05:09:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:30.457 05:09:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:30.457 05:09:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:30.457 05:09:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:30.457 05:09:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:30.457 05:09:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:30.457 05:09:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:30.457 05:09:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:30.457 05:09:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:30.457 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:30.457 05:09:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:30.457 05:09:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:30.457 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:30.457 05:09:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:30.457 05:09:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:30.457 05:09:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.457 05:09:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:30.457 05:09:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.457 05:09:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:30.457 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:30.457 05:09:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.457 05:09:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:30.457 05:09:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.457 05:09:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:30.457 05:09:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.457 05:09:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:30.457 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:30.457 05:09:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.457 05:09:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:30.457 05:09:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:30.457 05:09:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:30.457 05:09:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:30.457 05:09:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:30.457 05:09:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:30.457 05:09:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:30.457 05:09:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:30.457 05:09:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:30.457 05:09:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:30.457 05:09:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:30.457 05:09:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:30.457 05:09:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:30.457 05:09:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:30.457 05:09:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:30.457 05:09:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:30.457 05:09:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:30.716 05:09:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:30.716 05:09:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:30.716 05:09:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:30.716 05:09:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:30.716 05:09:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:30.716 05:09:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:30.716 05:09:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:30.716 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:30.716 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:13:30.716 00:13:30.716 --- 10.0.0.2 ping statistics --- 00:13:30.716 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:30.716 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:13:30.716 05:09:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:30.716 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:30.716 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:13:30.716 00:13:30.716 --- 10.0.0.1 ping statistics --- 00:13:30.716 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:30.716 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:13:30.716 05:09:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:30.716 05:09:32 -- nvmf/common.sh@410 -- # return 0 00:13:30.716 05:09:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:30.716 05:09:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:30.716 05:09:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:30.716 05:09:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:30.716 05:09:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:30.716 05:09:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:30.716 05:09:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:30.716 05:09:32 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:30.716 05:09:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:30.716 05:09:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:30.716 05:09:32 -- common/autotest_common.sh@10 -- # set +x 00:13:30.716 05:09:32 -- nvmf/common.sh@469 -- # nvmfpid=3247374 00:13:30.716 05:09:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:30.716 05:09:32 -- nvmf/common.sh@470 -- # waitforlisten 3247374 00:13:30.716 05:09:32 -- common/autotest_common.sh@829 -- # '[' -z 3247374 ']' 00:13:30.716 05:09:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:30.716 05:09:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:30.716 05:09:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:30.716 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:30.716 05:09:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:30.716 05:09:32 -- common/autotest_common.sh@10 -- # set +x 00:13:30.717 [2024-11-26 05:09:32.377639] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:30.717 [2024-11-26 05:09:32.377708] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:30.717 EAL: No free 2048 kB hugepages reported on node 1 00:13:30.717 [2024-11-26 05:09:32.454175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:30.974 [2024-11-26 05:09:32.550664] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:30.974 [2024-11-26 05:09:32.550832] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:30.974 [2024-11-26 05:09:32.550853] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:30.974 [2024-11-26 05:09:32.550868] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:30.974 [2024-11-26 05:09:32.553713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:30.974 [2024-11-26 05:09:32.553741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:30.974 [2024-11-26 05:09:32.553762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:30.974 [2024-11-26 05:09:32.553766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:31.911 05:09:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:31.911 05:09:33 -- common/autotest_common.sh@862 -- # return 0 00:13:31.911 05:09:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:31.911 05:09:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:31.911 05:09:33 -- common/autotest_common.sh@10 -- # set +x 00:13:31.911 05:09:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:31.911 05:09:33 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:31.911 05:09:33 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode7481 00:13:32.168 [2024-11-26 05:09:33.740493] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:32.168 05:09:33 -- target/invalid.sh@40 -- # out='request: 00:13:32.168 { 00:13:32.168 "nqn": "nqn.2016-06.io.spdk:cnode7481", 00:13:32.168 "tgt_name": "foobar", 00:13:32.168 "method": "nvmf_create_subsystem", 00:13:32.168 "req_id": 1 00:13:32.168 } 00:13:32.168 Got JSON-RPC error response 00:13:32.168 response: 00:13:32.168 { 00:13:32.168 "code": -32603, 00:13:32.168 "message": "Unable to find target foobar" 00:13:32.168 }' 00:13:32.168 05:09:33 -- target/invalid.sh@41 -- # [[ request: 00:13:32.168 { 00:13:32.168 "nqn": "nqn.2016-06.io.spdk:cnode7481", 00:13:32.168 "tgt_name": "foobar", 00:13:32.168 "method": "nvmf_create_subsystem", 00:13:32.168 "req_id": 1 00:13:32.168 } 00:13:32.168 Got JSON-RPC error response 00:13:32.168 response: 00:13:32.168 { 00:13:32.168 "code": -32603, 00:13:32.168 "message": "Unable to find target foobar" 00:13:32.168 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:32.168 05:09:33 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:32.168 05:09:33 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode778 00:13:32.426 [2024-11-26 05:09:34.005383] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode778: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:32.426 05:09:34 -- target/invalid.sh@45 -- # out='request: 00:13:32.426 { 00:13:32.426 "nqn": "nqn.2016-06.io.spdk:cnode778", 00:13:32.426 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:32.426 "method": "nvmf_create_subsystem", 00:13:32.426 "req_id": 1 00:13:32.426 } 00:13:32.426 Got JSON-RPC error response 00:13:32.426 response: 00:13:32.426 { 00:13:32.426 "code": -32602, 00:13:32.426 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:32.426 }' 00:13:32.426 05:09:34 -- target/invalid.sh@46 -- # [[ request: 00:13:32.426 { 00:13:32.426 "nqn": "nqn.2016-06.io.spdk:cnode778", 00:13:32.426 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:32.426 "method": "nvmf_create_subsystem", 00:13:32.426 "req_id": 1 00:13:32.426 } 00:13:32.426 Got JSON-RPC error response 00:13:32.426 response: 00:13:32.426 { 00:13:32.426 "code": -32602, 00:13:32.426 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:32.426 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:32.426 05:09:34 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:32.426 05:09:34 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode13260 00:13:32.685 [2024-11-26 05:09:34.262213] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode13260: invalid model number 'SPDK_Controller' 00:13:32.685 05:09:34 -- target/invalid.sh@50 -- # out='request: 00:13:32.685 { 00:13:32.685 "nqn": "nqn.2016-06.io.spdk:cnode13260", 00:13:32.685 "model_number": "SPDK_Controller\u001f", 00:13:32.685 "method": "nvmf_create_subsystem", 00:13:32.685 "req_id": 1 00:13:32.685 } 00:13:32.685 Got JSON-RPC error response 00:13:32.685 response: 00:13:32.685 { 00:13:32.685 "code": -32602, 00:13:32.685 "message": "Invalid MN SPDK_Controller\u001f" 00:13:32.685 }' 00:13:32.685 05:09:34 -- target/invalid.sh@51 -- # [[ request: 00:13:32.685 { 00:13:32.685 "nqn": "nqn.2016-06.io.spdk:cnode13260", 00:13:32.685 "model_number": "SPDK_Controller\u001f", 00:13:32.685 "method": "nvmf_create_subsystem", 00:13:32.685 "req_id": 1 00:13:32.685 } 00:13:32.685 Got JSON-RPC error response 00:13:32.685 response: 00:13:32.685 { 00:13:32.685 "code": -32602, 00:13:32.685 "message": "Invalid MN SPDK_Controller\u001f" 00:13:32.685 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:32.685 05:09:34 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:32.685 05:09:34 -- target/invalid.sh@19 -- # local length=21 ll 00:13:32.685 05:09:34 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:32.685 05:09:34 -- target/invalid.sh@21 -- # local chars 00:13:32.685 05:09:34 -- target/invalid.sh@22 -- # local string 00:13:32.685 05:09:34 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:32.685 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.685 05:09:34 -- target/invalid.sh@25 -- # printf %x 105 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=i 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 70 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=F 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 105 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=i 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 100 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x64' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=d 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 122 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=z 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 118 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x76' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=v 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 100 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x64' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=d 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 46 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=. 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 120 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x78' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=x 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 34 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x22' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+='"' 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 49 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x31' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=1 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 63 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+='?' 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 79 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=O 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 63 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+='?' 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 115 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=s 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 90 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=Z 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 53 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=5 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 52 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x34' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=4 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 63 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+='?' 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 86 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x56' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=V 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # printf %x 97 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:32.686 05:09:34 -- target/invalid.sh@25 -- # string+=a 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.686 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.686 05:09:34 -- target/invalid.sh@28 -- # [[ i == \- ]] 00:13:32.686 05:09:34 -- target/invalid.sh@31 -- # echo 'iFidzvd.x"1?O?sZ54?Va' 00:13:32.686 05:09:34 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'iFidzvd.x"1?O?sZ54?Va' nqn.2016-06.io.spdk:cnode849 00:13:32.945 [2024-11-26 05:09:34.591307] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode849: invalid serial number 'iFidzvd.x"1?O?sZ54?Va' 00:13:32.945 05:09:34 -- target/invalid.sh@54 -- # out='request: 00:13:32.945 { 00:13:32.945 "nqn": "nqn.2016-06.io.spdk:cnode849", 00:13:32.945 "serial_number": "iFidzvd.x\"1?O?sZ54?Va", 00:13:32.946 "method": "nvmf_create_subsystem", 00:13:32.946 "req_id": 1 00:13:32.946 } 00:13:32.946 Got JSON-RPC error response 00:13:32.946 response: 00:13:32.946 { 00:13:32.946 "code": -32602, 00:13:32.946 "message": "Invalid SN iFidzvd.x\"1?O?sZ54?Va" 00:13:32.946 }' 00:13:32.946 05:09:34 -- target/invalid.sh@55 -- # [[ request: 00:13:32.946 { 00:13:32.946 "nqn": "nqn.2016-06.io.spdk:cnode849", 00:13:32.946 "serial_number": "iFidzvd.x\"1?O?sZ54?Va", 00:13:32.946 "method": "nvmf_create_subsystem", 00:13:32.946 "req_id": 1 00:13:32.946 } 00:13:32.946 Got JSON-RPC error response 00:13:32.946 response: 00:13:32.946 { 00:13:32.946 "code": -32602, 00:13:32.946 "message": "Invalid SN iFidzvd.x\"1?O?sZ54?Va" 00:13:32.946 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:32.946 05:09:34 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:32.946 05:09:34 -- target/invalid.sh@19 -- # local length=41 ll 00:13:32.946 05:09:34 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:32.946 05:09:34 -- target/invalid.sh@21 -- # local chars 00:13:32.946 05:09:34 -- target/invalid.sh@22 -- # local string 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 70 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=F 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 76 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=L 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 74 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=J 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 54 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=6 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 103 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=g 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 87 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x57' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=W 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 48 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x30' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=0 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 59 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=';' 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 125 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+='}' 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 60 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+='<' 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 115 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=s 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 103 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=g 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 32 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x20' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=' ' 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 72 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x48' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=H 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 105 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=i 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 84 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x54' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=T 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 99 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x63' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=c 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 43 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=+ 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 53 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=5 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 81 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x51' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=Q 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 80 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=P 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 66 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x42' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=B 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 54 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=6 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 111 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=o 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 88 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x58' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=X 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # printf %x 97 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:32.946 05:09:34 -- target/invalid.sh@25 -- # string+=a 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:32.946 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 94 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+='^' 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 64 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+=@ 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 115 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+=s 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 103 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+=g 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 123 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+='{' 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 59 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+=';' 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 47 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+=/ 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 91 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+='[' 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 93 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+=']' 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 122 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+=z 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 125 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+='}' 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 121 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x79' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+=y 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 124 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+='|' 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 51 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x33' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+=3 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # printf %x 71 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:33.205 05:09:34 -- target/invalid.sh@25 -- # string+=G 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:33.205 05:09:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:33.205 05:09:34 -- target/invalid.sh@28 -- # [[ F == \- ]] 00:13:33.205 05:09:34 -- target/invalid.sh@31 -- # echo 'FLJ6gW0;} /dev/null' 00:13:35.789 05:09:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:38.323 05:09:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:38.323 00:13:38.323 real 0m9.638s 00:13:38.323 user 0m24.039s 00:13:38.323 sys 0m2.480s 00:13:38.323 05:09:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:38.323 05:09:39 -- common/autotest_common.sh@10 -- # set +x 00:13:38.323 ************************************ 00:13:38.323 END TEST nvmf_invalid 00:13:38.323 ************************************ 00:13:38.323 05:09:39 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:38.323 05:09:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:38.323 05:09:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:38.323 05:09:39 -- common/autotest_common.sh@10 -- # set +x 00:13:38.323 ************************************ 00:13:38.323 START TEST nvmf_abort 00:13:38.323 ************************************ 00:13:38.323 05:09:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:38.323 * Looking for test storage... 00:13:38.323 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:38.323 05:09:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:38.323 05:09:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:38.323 05:09:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:38.323 05:09:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:38.323 05:09:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:38.323 05:09:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:38.323 05:09:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:38.323 05:09:39 -- scripts/common.sh@335 -- # IFS=.-: 00:13:38.323 05:09:39 -- scripts/common.sh@335 -- # read -ra ver1 00:13:38.323 05:09:39 -- scripts/common.sh@336 -- # IFS=.-: 00:13:38.323 05:09:39 -- scripts/common.sh@336 -- # read -ra ver2 00:13:38.323 05:09:39 -- scripts/common.sh@337 -- # local 'op=<' 00:13:38.323 05:09:39 -- scripts/common.sh@339 -- # ver1_l=2 00:13:38.323 05:09:39 -- scripts/common.sh@340 -- # ver2_l=1 00:13:38.323 05:09:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:38.323 05:09:39 -- scripts/common.sh@343 -- # case "$op" in 00:13:38.323 05:09:39 -- scripts/common.sh@344 -- # : 1 00:13:38.323 05:09:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:38.323 05:09:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:38.323 05:09:39 -- scripts/common.sh@364 -- # decimal 1 00:13:38.323 05:09:39 -- scripts/common.sh@352 -- # local d=1 00:13:38.324 05:09:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:38.324 05:09:39 -- scripts/common.sh@354 -- # echo 1 00:13:38.324 05:09:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:38.324 05:09:39 -- scripts/common.sh@365 -- # decimal 2 00:13:38.324 05:09:39 -- scripts/common.sh@352 -- # local d=2 00:13:38.324 05:09:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:38.324 05:09:39 -- scripts/common.sh@354 -- # echo 2 00:13:38.324 05:09:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:38.324 05:09:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:38.324 05:09:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:38.324 05:09:39 -- scripts/common.sh@367 -- # return 0 00:13:38.324 05:09:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:38.324 05:09:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:38.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:38.324 --rc genhtml_branch_coverage=1 00:13:38.324 --rc genhtml_function_coverage=1 00:13:38.324 --rc genhtml_legend=1 00:13:38.324 --rc geninfo_all_blocks=1 00:13:38.324 --rc geninfo_unexecuted_blocks=1 00:13:38.324 00:13:38.324 ' 00:13:38.324 05:09:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:38.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:38.324 --rc genhtml_branch_coverage=1 00:13:38.324 --rc genhtml_function_coverage=1 00:13:38.324 --rc genhtml_legend=1 00:13:38.324 --rc geninfo_all_blocks=1 00:13:38.324 --rc geninfo_unexecuted_blocks=1 00:13:38.324 00:13:38.324 ' 00:13:38.324 05:09:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:38.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:38.324 --rc genhtml_branch_coverage=1 00:13:38.324 --rc genhtml_function_coverage=1 00:13:38.324 --rc genhtml_legend=1 00:13:38.324 --rc geninfo_all_blocks=1 00:13:38.324 --rc geninfo_unexecuted_blocks=1 00:13:38.324 00:13:38.324 ' 00:13:38.324 05:09:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:38.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:38.324 --rc genhtml_branch_coverage=1 00:13:38.324 --rc genhtml_function_coverage=1 00:13:38.324 --rc genhtml_legend=1 00:13:38.324 --rc geninfo_all_blocks=1 00:13:38.324 --rc geninfo_unexecuted_blocks=1 00:13:38.324 00:13:38.324 ' 00:13:38.324 05:09:39 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:38.324 05:09:39 -- nvmf/common.sh@7 -- # uname -s 00:13:38.324 05:09:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:38.324 05:09:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:38.324 05:09:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:38.324 05:09:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:38.324 05:09:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:38.324 05:09:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:38.324 05:09:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:38.324 05:09:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:38.324 05:09:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:38.324 05:09:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:38.324 05:09:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:38.324 05:09:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:38.324 05:09:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:38.324 05:09:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:38.324 05:09:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:38.324 05:09:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:38.324 05:09:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:38.324 05:09:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:38.324 05:09:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:38.324 05:09:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:38.324 05:09:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:38.324 05:09:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:38.324 05:09:39 -- paths/export.sh@5 -- # export PATH 00:13:38.324 05:09:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:38.324 05:09:39 -- nvmf/common.sh@46 -- # : 0 00:13:38.324 05:09:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:38.324 05:09:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:38.324 05:09:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:38.324 05:09:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:38.324 05:09:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:38.324 05:09:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:38.324 05:09:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:38.324 05:09:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:38.324 05:09:39 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:38.324 05:09:39 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:38.324 05:09:39 -- target/abort.sh@14 -- # nvmftestinit 00:13:38.324 05:09:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:38.324 05:09:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:38.324 05:09:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:38.324 05:09:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:38.324 05:09:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:38.324 05:09:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:38.324 05:09:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:38.324 05:09:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:38.324 05:09:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:38.324 05:09:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:38.324 05:09:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:38.324 05:09:39 -- common/autotest_common.sh@10 -- # set +x 00:13:40.231 05:09:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:40.231 05:09:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:40.231 05:09:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:40.231 05:09:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:40.231 05:09:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:40.231 05:09:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:40.231 05:09:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:40.231 05:09:41 -- nvmf/common.sh@294 -- # net_devs=() 00:13:40.231 05:09:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:40.231 05:09:41 -- nvmf/common.sh@295 -- # e810=() 00:13:40.231 05:09:41 -- nvmf/common.sh@295 -- # local -ga e810 00:13:40.231 05:09:41 -- nvmf/common.sh@296 -- # x722=() 00:13:40.231 05:09:41 -- nvmf/common.sh@296 -- # local -ga x722 00:13:40.231 05:09:41 -- nvmf/common.sh@297 -- # mlx=() 00:13:40.231 05:09:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:40.231 05:09:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:40.231 05:09:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:40.231 05:09:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:40.231 05:09:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:40.231 05:09:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:40.231 05:09:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:40.231 05:09:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:40.231 05:09:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:40.231 05:09:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:40.231 05:09:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:40.231 05:09:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:40.231 05:09:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:40.231 05:09:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:40.231 05:09:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:40.231 05:09:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:40.231 05:09:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:40.231 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:40.231 05:09:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:40.231 05:09:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:40.231 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:40.231 05:09:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:40.231 05:09:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:40.231 05:09:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:40.231 05:09:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:40.231 05:09:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:40.231 05:09:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:40.231 05:09:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:40.231 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:40.231 05:09:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:40.231 05:09:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:40.231 05:09:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:40.231 05:09:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:40.231 05:09:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:40.231 05:09:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:40.231 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:40.232 05:09:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:40.232 05:09:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:40.232 05:09:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:40.232 05:09:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:40.232 05:09:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:40.232 05:09:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:40.232 05:09:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:40.232 05:09:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:40.232 05:09:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:40.232 05:09:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:40.232 05:09:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:40.232 05:09:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:40.232 05:09:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:40.232 05:09:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:40.232 05:09:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:40.232 05:09:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:40.232 05:09:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:40.232 05:09:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:40.232 05:09:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:40.232 05:09:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:40.232 05:09:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:40.232 05:09:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:40.232 05:09:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:40.232 05:09:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:40.490 05:09:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:40.490 05:09:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:40.490 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:40.490 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:13:40.490 00:13:40.490 --- 10.0.0.2 ping statistics --- 00:13:40.490 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:40.490 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:13:40.490 05:09:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:40.490 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:40.490 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:13:40.490 00:13:40.490 --- 10.0.0.1 ping statistics --- 00:13:40.490 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:40.490 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:13:40.490 05:09:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:40.490 05:09:42 -- nvmf/common.sh@410 -- # return 0 00:13:40.490 05:09:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:40.490 05:09:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:40.490 05:09:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:40.490 05:09:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:40.490 05:09:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:40.490 05:09:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:40.490 05:09:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:40.490 05:09:42 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:40.490 05:09:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:40.490 05:09:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:40.490 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:13:40.490 05:09:42 -- nvmf/common.sh@469 -- # nvmfpid=3250180 00:13:40.490 05:09:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:40.490 05:09:42 -- nvmf/common.sh@470 -- # waitforlisten 3250180 00:13:40.490 05:09:42 -- common/autotest_common.sh@829 -- # '[' -z 3250180 ']' 00:13:40.490 05:09:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:40.490 05:09:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:40.490 05:09:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:40.490 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:40.490 05:09:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:40.490 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:13:40.490 [2024-11-26 05:09:42.080988] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:40.490 [2024-11-26 05:09:42.081081] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:40.490 EAL: No free 2048 kB hugepages reported on node 1 00:13:40.490 [2024-11-26 05:09:42.158237] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:40.490 [2024-11-26 05:09:42.246139] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:40.490 [2024-11-26 05:09:42.246338] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:40.490 [2024-11-26 05:09:42.246382] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:40.490 [2024-11-26 05:09:42.246405] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:40.490 [2024-11-26 05:09:42.246562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:40.490 [2024-11-26 05:09:42.246597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:40.490 [2024-11-26 05:09:42.246604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:41.427 05:09:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:41.427 05:09:43 -- common/autotest_common.sh@862 -- # return 0 00:13:41.427 05:09:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:41.427 05:09:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:41.427 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:13:41.427 05:09:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:41.427 05:09:43 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:41.427 05:09:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.427 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:13:41.427 [2024-11-26 05:09:43.108794] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:41.427 05:09:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.427 05:09:43 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:41.427 05:09:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.427 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:13:41.427 Malloc0 00:13:41.427 05:09:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.427 05:09:43 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:41.427 05:09:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.427 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:13:41.427 Delay0 00:13:41.427 05:09:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.427 05:09:43 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:41.427 05:09:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.427 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:13:41.427 05:09:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.427 05:09:43 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:41.427 05:09:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.427 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:13:41.427 05:09:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.427 05:09:43 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:41.427 05:09:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.427 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:13:41.427 [2024-11-26 05:09:43.176878] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:41.427 05:09:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.427 05:09:43 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:41.427 05:09:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.427 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:13:41.427 05:09:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.427 05:09:43 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:41.687 EAL: No free 2048 kB hugepages reported on node 1 00:13:41.687 [2024-11-26 05:09:43.323772] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:44.223 Initializing NVMe Controllers 00:13:44.223 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:44.223 controller IO queue size 128 less than required 00:13:44.223 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:44.223 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:44.223 Initialization complete. Launching workers. 00:13:44.223 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 127, failed: 29306 00:13:44.223 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 29371, failed to submit 62 00:13:44.223 success 29306, unsuccess 65, failed 0 00:13:44.223 05:09:45 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:44.223 05:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.223 05:09:45 -- common/autotest_common.sh@10 -- # set +x 00:13:44.223 05:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.223 05:09:45 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:44.223 05:09:45 -- target/abort.sh@38 -- # nvmftestfini 00:13:44.223 05:09:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:44.223 05:09:45 -- nvmf/common.sh@116 -- # sync 00:13:44.223 05:09:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:44.223 05:09:45 -- nvmf/common.sh@119 -- # set +e 00:13:44.223 05:09:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:44.223 05:09:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:44.223 rmmod nvme_tcp 00:13:44.223 rmmod nvme_fabrics 00:13:44.223 rmmod nvme_keyring 00:13:44.223 05:09:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:44.223 05:09:45 -- nvmf/common.sh@123 -- # set -e 00:13:44.223 05:09:45 -- nvmf/common.sh@124 -- # return 0 00:13:44.223 05:09:45 -- nvmf/common.sh@477 -- # '[' -n 3250180 ']' 00:13:44.223 05:09:45 -- nvmf/common.sh@478 -- # killprocess 3250180 00:13:44.223 05:09:45 -- common/autotest_common.sh@936 -- # '[' -z 3250180 ']' 00:13:44.223 05:09:45 -- common/autotest_common.sh@940 -- # kill -0 3250180 00:13:44.223 05:09:45 -- common/autotest_common.sh@941 -- # uname 00:13:44.223 05:09:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:44.223 05:09:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3250180 00:13:44.223 05:09:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:44.223 05:09:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:44.223 05:09:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3250180' 00:13:44.223 killing process with pid 3250180 00:13:44.223 05:09:45 -- common/autotest_common.sh@955 -- # kill 3250180 00:13:44.223 05:09:45 -- common/autotest_common.sh@960 -- # wait 3250180 00:13:44.223 05:09:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:44.223 05:09:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:44.223 05:09:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:44.223 05:09:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:44.223 05:09:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:44.223 05:09:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:44.223 05:09:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:44.223 05:09:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:46.130 05:09:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:46.130 00:13:46.130 real 0m8.211s 00:13:46.130 user 0m13.042s 00:13:46.130 sys 0m2.717s 00:13:46.130 05:09:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:46.130 05:09:47 -- common/autotest_common.sh@10 -- # set +x 00:13:46.130 ************************************ 00:13:46.130 END TEST nvmf_abort 00:13:46.130 ************************************ 00:13:46.130 05:09:47 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:46.130 05:09:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:46.130 05:09:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:46.130 05:09:47 -- common/autotest_common.sh@10 -- # set +x 00:13:46.130 ************************************ 00:13:46.130 START TEST nvmf_ns_hotplug_stress 00:13:46.130 ************************************ 00:13:46.130 05:09:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:46.130 * Looking for test storage... 00:13:46.389 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:46.389 05:09:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:46.389 05:09:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:46.389 05:09:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:46.389 05:09:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:46.389 05:09:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:46.389 05:09:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:46.389 05:09:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:46.389 05:09:47 -- scripts/common.sh@335 -- # IFS=.-: 00:13:46.389 05:09:47 -- scripts/common.sh@335 -- # read -ra ver1 00:13:46.389 05:09:47 -- scripts/common.sh@336 -- # IFS=.-: 00:13:46.389 05:09:47 -- scripts/common.sh@336 -- # read -ra ver2 00:13:46.389 05:09:47 -- scripts/common.sh@337 -- # local 'op=<' 00:13:46.389 05:09:47 -- scripts/common.sh@339 -- # ver1_l=2 00:13:46.389 05:09:47 -- scripts/common.sh@340 -- # ver2_l=1 00:13:46.389 05:09:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:46.389 05:09:47 -- scripts/common.sh@343 -- # case "$op" in 00:13:46.389 05:09:47 -- scripts/common.sh@344 -- # : 1 00:13:46.389 05:09:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:46.389 05:09:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:46.389 05:09:47 -- scripts/common.sh@364 -- # decimal 1 00:13:46.389 05:09:47 -- scripts/common.sh@352 -- # local d=1 00:13:46.389 05:09:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:46.389 05:09:47 -- scripts/common.sh@354 -- # echo 1 00:13:46.389 05:09:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:46.389 05:09:47 -- scripts/common.sh@365 -- # decimal 2 00:13:46.389 05:09:47 -- scripts/common.sh@352 -- # local d=2 00:13:46.389 05:09:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:46.389 05:09:47 -- scripts/common.sh@354 -- # echo 2 00:13:46.389 05:09:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:46.389 05:09:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:46.389 05:09:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:46.389 05:09:47 -- scripts/common.sh@367 -- # return 0 00:13:46.389 05:09:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:46.389 05:09:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:46.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.389 --rc genhtml_branch_coverage=1 00:13:46.389 --rc genhtml_function_coverage=1 00:13:46.389 --rc genhtml_legend=1 00:13:46.389 --rc geninfo_all_blocks=1 00:13:46.389 --rc geninfo_unexecuted_blocks=1 00:13:46.389 00:13:46.389 ' 00:13:46.389 05:09:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:46.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.389 --rc genhtml_branch_coverage=1 00:13:46.389 --rc genhtml_function_coverage=1 00:13:46.389 --rc genhtml_legend=1 00:13:46.389 --rc geninfo_all_blocks=1 00:13:46.389 --rc geninfo_unexecuted_blocks=1 00:13:46.389 00:13:46.389 ' 00:13:46.389 05:09:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:46.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.389 --rc genhtml_branch_coverage=1 00:13:46.389 --rc genhtml_function_coverage=1 00:13:46.389 --rc genhtml_legend=1 00:13:46.389 --rc geninfo_all_blocks=1 00:13:46.389 --rc geninfo_unexecuted_blocks=1 00:13:46.389 00:13:46.389 ' 00:13:46.389 05:09:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:46.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.389 --rc genhtml_branch_coverage=1 00:13:46.389 --rc genhtml_function_coverage=1 00:13:46.389 --rc genhtml_legend=1 00:13:46.389 --rc geninfo_all_blocks=1 00:13:46.389 --rc geninfo_unexecuted_blocks=1 00:13:46.389 00:13:46.389 ' 00:13:46.389 05:09:48 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:46.389 05:09:48 -- nvmf/common.sh@7 -- # uname -s 00:13:46.390 05:09:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:46.390 05:09:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:46.390 05:09:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:46.390 05:09:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:46.390 05:09:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:46.390 05:09:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:46.390 05:09:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:46.390 05:09:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:46.390 05:09:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:46.390 05:09:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:46.390 05:09:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:46.390 05:09:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:46.390 05:09:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:46.390 05:09:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:46.390 05:09:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:46.390 05:09:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:46.390 05:09:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:46.390 05:09:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:46.390 05:09:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:46.390 05:09:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.390 05:09:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.390 05:09:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.390 05:09:48 -- paths/export.sh@5 -- # export PATH 00:13:46.390 05:09:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.390 05:09:48 -- nvmf/common.sh@46 -- # : 0 00:13:46.390 05:09:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:46.390 05:09:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:46.390 05:09:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:46.390 05:09:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:46.390 05:09:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:46.390 05:09:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:46.390 05:09:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:46.390 05:09:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:46.390 05:09:48 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:46.390 05:09:48 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:46.390 05:09:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:46.390 05:09:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:46.390 05:09:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:46.390 05:09:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:46.390 05:09:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:46.390 05:09:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:46.390 05:09:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:46.390 05:09:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:46.390 05:09:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:46.390 05:09:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:46.390 05:09:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:46.390 05:09:48 -- common/autotest_common.sh@10 -- # set +x 00:13:48.922 05:09:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:48.922 05:09:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:48.922 05:09:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:48.922 05:09:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:48.922 05:09:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:48.922 05:09:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:48.922 05:09:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:48.922 05:09:50 -- nvmf/common.sh@294 -- # net_devs=() 00:13:48.922 05:09:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:48.922 05:09:50 -- nvmf/common.sh@295 -- # e810=() 00:13:48.922 05:09:50 -- nvmf/common.sh@295 -- # local -ga e810 00:13:48.922 05:09:50 -- nvmf/common.sh@296 -- # x722=() 00:13:48.922 05:09:50 -- nvmf/common.sh@296 -- # local -ga x722 00:13:48.922 05:09:50 -- nvmf/common.sh@297 -- # mlx=() 00:13:48.922 05:09:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:48.922 05:09:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:48.922 05:09:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:48.922 05:09:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:48.922 05:09:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:48.922 05:09:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:48.922 05:09:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:48.922 05:09:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:48.922 05:09:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:48.922 05:09:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:48.922 05:09:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:48.922 05:09:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:48.922 05:09:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:48.922 05:09:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:48.922 05:09:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:48.922 05:09:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.922 05:09:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:48.922 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:48.922 05:09:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.922 05:09:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:48.922 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:48.922 05:09:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:48.922 05:09:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:48.922 05:09:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:48.923 05:09:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.923 05:09:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.923 05:09:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.923 05:09:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.923 05:09:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:48.923 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:48.923 05:09:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.923 05:09:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.923 05:09:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.923 05:09:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.923 05:09:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.923 05:09:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:48.923 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:48.923 05:09:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.923 05:09:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:48.923 05:09:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:48.923 05:09:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:48.923 05:09:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:48.923 05:09:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:48.923 05:09:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:48.923 05:09:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:48.923 05:09:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:48.923 05:09:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:48.923 05:09:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:48.923 05:09:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:48.923 05:09:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:48.923 05:09:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:48.923 05:09:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:48.923 05:09:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:48.923 05:09:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:48.923 05:09:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:48.923 05:09:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:48.923 05:09:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:48.923 05:09:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:48.923 05:09:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:48.923 05:09:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:48.923 05:09:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:48.923 05:09:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:48.923 05:09:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:48.923 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:48.923 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.301 ms 00:13:48.923 00:13:48.923 --- 10.0.0.2 ping statistics --- 00:13:48.923 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.923 rtt min/avg/max/mdev = 0.301/0.301/0.301/0.000 ms 00:13:48.923 05:09:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:48.923 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:48.923 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:13:48.923 00:13:48.923 --- 10.0.0.1 ping statistics --- 00:13:48.923 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.923 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:13:48.923 05:09:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:48.923 05:09:50 -- nvmf/common.sh@410 -- # return 0 00:13:48.923 05:09:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:48.923 05:09:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:48.923 05:09:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:48.923 05:09:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:48.923 05:09:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:48.923 05:09:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:48.923 05:09:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:48.923 05:09:50 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:48.923 05:09:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:48.923 05:09:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:48.923 05:09:50 -- common/autotest_common.sh@10 -- # set +x 00:13:48.923 05:09:50 -- nvmf/common.sh@469 -- # nvmfpid=3252559 00:13:48.923 05:09:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:48.923 05:09:50 -- nvmf/common.sh@470 -- # waitforlisten 3252559 00:13:48.923 05:09:50 -- common/autotest_common.sh@829 -- # '[' -z 3252559 ']' 00:13:48.923 05:09:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:48.923 05:09:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:48.923 05:09:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:48.923 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:48.923 05:09:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:48.923 05:09:50 -- common/autotest_common.sh@10 -- # set +x 00:13:48.923 [2024-11-26 05:09:50.411920] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:48.923 [2024-11-26 05:09:50.411996] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:48.923 EAL: No free 2048 kB hugepages reported on node 1 00:13:48.923 [2024-11-26 05:09:50.485061] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:48.923 [2024-11-26 05:09:50.581509] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:48.923 [2024-11-26 05:09:50.581661] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:48.923 [2024-11-26 05:09:50.581706] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:48.923 [2024-11-26 05:09:50.581724] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:48.923 [2024-11-26 05:09:50.581820] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:48.923 [2024-11-26 05:09:50.581891] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:48.923 [2024-11-26 05:09:50.581895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:49.857 05:09:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:49.857 05:09:51 -- common/autotest_common.sh@862 -- # return 0 00:13:49.857 05:09:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:49.857 05:09:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:49.857 05:09:51 -- common/autotest_common.sh@10 -- # set +x 00:13:49.857 05:09:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:49.857 05:09:51 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:49.857 05:09:51 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:50.114 [2024-11-26 05:09:51.656058] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:50.114 05:09:51 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:50.371 05:09:51 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:50.628 [2024-11-26 05:09:52.211255] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:50.628 05:09:52 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:50.885 05:09:52 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:51.143 Malloc0 00:13:51.143 05:09:52 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:51.401 Delay0 00:13:51.401 05:09:53 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:51.658 05:09:53 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:51.915 NULL1 00:13:51.915 05:09:53 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:52.173 05:09:53 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=3252999 00:13:52.173 05:09:53 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:52.173 05:09:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:13:52.173 05:09:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:52.173 EAL: No free 2048 kB hugepages reported on node 1 00:13:53.544 Read completed with error (sct=0, sc=11) 00:13:53.544 05:09:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:53.544 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:53.544 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:53.544 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:53.544 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:53.544 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:53.544 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:53.544 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:53.544 05:09:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:13:53.544 05:09:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:53.801 true 00:13:53.801 05:09:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:13:53.801 05:09:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:54.739 05:09:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:54.739 05:09:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:13:54.739 05:09:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:13:54.997 true 00:13:54.997 05:09:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:13:54.997 05:09:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:55.254 05:09:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:55.510 05:09:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:13:55.510 05:09:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:13:55.767 true 00:13:55.767 05:09:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:13:55.767 05:09:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.026 05:09:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:56.284 05:09:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:13:56.285 05:09:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:13:56.543 true 00:13:56.543 05:09:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:13:56.543 05:09:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:57.475 05:09:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:57.475 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:57.732 05:09:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:13:57.732 05:09:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:13:57.989 true 00:13:57.989 05:09:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:13:57.989 05:09:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:58.246 05:09:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:58.503 05:10:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:13:58.503 05:10:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:13:58.760 true 00:13:58.760 05:10:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:13:58.760 05:10:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:59.690 05:10:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:59.947 05:10:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:13:59.947 05:10:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:00.205 true 00:14:00.205 05:10:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:00.205 05:10:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:00.463 05:10:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.720 05:10:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:14:00.720 05:10:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:00.978 true 00:14:00.978 05:10:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:00.978 05:10:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:01.236 05:10:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:01.494 05:10:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:14:01.494 05:10:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:01.752 true 00:14:01.752 05:10:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:01.752 05:10:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:02.714 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.714 05:10:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:02.997 05:10:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:14:02.997 05:10:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:03.256 true 00:14:03.256 05:10:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:03.256 05:10:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.515 05:10:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.773 05:10:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:14:03.773 05:10:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:04.031 true 00:14:04.031 05:10:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:04.032 05:10:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:04.964 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:04.964 05:10:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:05.222 05:10:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:14:05.222 05:10:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:05.480 true 00:14:05.480 05:10:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:05.480 05:10:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.737 05:10:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:05.995 05:10:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:14:05.995 05:10:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:06.252 true 00:14:06.252 05:10:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:06.252 05:10:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.183 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:07.183 05:10:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.183 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:07.183 05:10:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:14:07.183 05:10:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:07.440 true 00:14:07.440 05:10:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:07.440 05:10:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.708 05:10:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.966 05:10:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:14:07.966 05:10:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:08.224 true 00:14:08.224 05:10:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:08.224 05:10:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.156 05:10:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:09.414 05:10:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:09.414 05:10:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:09.671 true 00:14:09.671 05:10:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:09.671 05:10:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.929 05:10:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:10.187 05:10:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:10.187 05:10:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:10.445 true 00:14:10.445 05:10:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:10.445 05:10:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.703 05:10:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:10.966 05:10:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:10.966 05:10:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:11.224 true 00:14:11.224 05:10:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:11.224 05:10:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.157 05:10:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:12.414 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.414 05:10:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:12.414 05:10:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:12.672 true 00:14:12.672 05:10:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:12.672 05:10:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.930 05:10:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.188 05:10:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:13.188 05:10:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:13.446 true 00:14:13.446 05:10:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:13.446 05:10:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.377 05:10:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:14.377 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:14.377 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:14.377 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:14.377 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:14.635 05:10:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:14.635 05:10:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:14.892 true 00:14:14.892 05:10:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:14.892 05:10:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.150 05:10:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:15.407 05:10:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:15.407 05:10:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:15.665 true 00:14:15.665 05:10:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:15.665 05:10:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.598 05:10:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:16.855 05:10:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:16.855 05:10:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:17.114 true 00:14:17.114 05:10:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:17.114 05:10:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.372 05:10:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:17.631 05:10:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:17.631 05:10:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:17.890 true 00:14:17.890 05:10:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:17.890 05:10:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.148 05:10:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:18.406 05:10:20 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:18.406 05:10:20 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:18.664 true 00:14:18.664 05:10:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:18.664 05:10:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:19.597 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.597 05:10:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:19.597 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.597 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.855 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.855 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.855 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.855 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.855 05:10:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:19.855 05:10:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:20.113 true 00:14:20.113 05:10:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:20.113 05:10:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.047 05:10:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:21.047 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:21.305 05:10:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:21.305 05:10:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:21.562 true 00:14:21.562 05:10:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:21.562 05:10:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.820 05:10:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:22.078 05:10:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:22.078 05:10:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:22.078 true 00:14:22.336 05:10:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:22.336 05:10:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:22.902 Initializing NVMe Controllers 00:14:22.902 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:22.902 Controller IO queue size 128, less than required. 00:14:22.902 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:22.902 Controller IO queue size 128, less than required. 00:14:22.902 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:22.902 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:22.902 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:22.902 Initialization complete. Launching workers. 00:14:22.902 ======================================================== 00:14:22.902 Latency(us) 00:14:22.903 Device Information : IOPS MiB/s Average min max 00:14:22.903 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 910.16 0.44 73365.33 2285.73 1034504.67 00:14:22.903 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11528.54 5.63 11102.83 1749.02 363159.38 00:14:22.903 ======================================================== 00:14:22.903 Total : 12438.70 6.07 15658.69 1749.02 1034504.67 00:14:22.903 00:14:23.161 05:10:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:23.161 05:10:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:14:23.161 05:10:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:14:23.419 true 00:14:23.419 05:10:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3252999 00:14:23.419 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (3252999) - No such process 00:14:23.419 05:10:25 -- target/ns_hotplug_stress.sh@53 -- # wait 3252999 00:14:23.419 05:10:25 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.676 05:10:25 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:23.933 05:10:25 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:23.933 05:10:25 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:23.933 05:10:25 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:23.933 05:10:25 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:23.933 05:10:25 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:24.191 null0 00:14:24.191 05:10:25 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:24.191 05:10:25 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:24.191 05:10:25 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:24.449 null1 00:14:24.449 05:10:26 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:24.449 05:10:26 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:24.449 05:10:26 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:24.707 null2 00:14:24.707 05:10:26 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:24.707 05:10:26 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:24.707 05:10:26 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:24.964 null3 00:14:24.964 05:10:26 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:24.964 05:10:26 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:24.964 05:10:26 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:25.222 null4 00:14:25.222 05:10:26 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:25.222 05:10:26 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:25.222 05:10:26 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:25.479 null5 00:14:25.479 05:10:27 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:25.479 05:10:27 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:25.479 05:10:27 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:25.737 null6 00:14:25.737 05:10:27 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:25.737 05:10:27 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:25.737 05:10:27 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:25.994 null7 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:25.994 05:10:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:25.995 05:10:27 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:25.995 05:10:27 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:25.995 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:25.995 05:10:27 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:25.995 05:10:27 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:25.995 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:25.995 05:10:27 -- target/ns_hotplug_stress.sh@66 -- # wait 3257293 3257294 3257296 3257298 3257300 3257302 3257304 3257306 00:14:25.995 05:10:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:25.995 05:10:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:26.252 05:10:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:26.252 05:10:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:26.252 05:10:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:26.252 05:10:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:26.252 05:10:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:26.252 05:10:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:26.252 05:10:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:26.252 05:10:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:26.509 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:26.509 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:26.509 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:26.509 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:26.510 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:26.768 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:26.768 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:26.768 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:27.026 05:10:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:27.026 05:10:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:27.026 05:10:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:27.026 05:10:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:27.026 05:10:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:27.026 05:10:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:27.026 05:10:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:27.026 05:10:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.284 05:10:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:27.543 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:27.543 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:27.543 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:27.543 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:27.543 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:27.543 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:27.543 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:27.543 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:27.801 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:28.059 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:28.059 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:28.059 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:28.059 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:28.059 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:28.059 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:28.059 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:28.059 05:10:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.317 05:10:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:28.575 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:28.575 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:28.575 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:28.575 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:28.575 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:28.575 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:28.575 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:28.575 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:28.833 05:10:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:29.092 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:29.092 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:29.092 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:29.092 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:29.092 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:29.092 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:29.092 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:29.092 05:10:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.350 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:29.608 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:29.608 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:29.608 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:29.608 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:29.608 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:29.608 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:29.608 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:29.608 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:29.866 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.866 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.866 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.866 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.866 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:29.866 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:29.866 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.866 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.866 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.131 05:10:31 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:30.440 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:30.440 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.440 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:30.440 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:30.440 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:30.440 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:30.440 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:30.440 05:10:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:30.722 05:10:32 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:30.980 05:10:32 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.239 05:10:32 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:31.497 05:10:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.497 05:10:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:31.497 05:10:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:31.497 05:10:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:31.497 05:10:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:31.497 05:10:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:31.497 05:10:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:31.497 05:10:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:31.756 05:10:33 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:31.756 05:10:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:31.756 05:10:33 -- nvmf/common.sh@116 -- # sync 00:14:31.756 05:10:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:31.756 05:10:33 -- nvmf/common.sh@119 -- # set +e 00:14:31.756 05:10:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:31.756 05:10:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:31.756 rmmod nvme_tcp 00:14:31.756 rmmod nvme_fabrics 00:14:31.756 rmmod nvme_keyring 00:14:31.756 05:10:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:31.756 05:10:33 -- nvmf/common.sh@123 -- # set -e 00:14:31.756 05:10:33 -- nvmf/common.sh@124 -- # return 0 00:14:31.756 05:10:33 -- nvmf/common.sh@477 -- # '[' -n 3252559 ']' 00:14:31.756 05:10:33 -- nvmf/common.sh@478 -- # killprocess 3252559 00:14:31.756 05:10:33 -- common/autotest_common.sh@936 -- # '[' -z 3252559 ']' 00:14:31.756 05:10:33 -- common/autotest_common.sh@940 -- # kill -0 3252559 00:14:31.756 05:10:33 -- common/autotest_common.sh@941 -- # uname 00:14:31.756 05:10:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:31.756 05:10:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3252559 00:14:31.756 05:10:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:31.756 05:10:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:31.756 05:10:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3252559' 00:14:31.756 killing process with pid 3252559 00:14:31.756 05:10:33 -- common/autotest_common.sh@955 -- # kill 3252559 00:14:31.756 05:10:33 -- common/autotest_common.sh@960 -- # wait 3252559 00:14:32.015 05:10:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:32.015 05:10:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:32.015 05:10:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:32.015 05:10:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:32.015 05:10:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:32.015 05:10:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:32.015 05:10:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:32.015 05:10:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:34.547 05:10:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:34.547 00:14:34.547 real 0m47.893s 00:14:34.547 user 3m37.816s 00:14:34.547 sys 0m15.568s 00:14:34.547 05:10:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:34.547 05:10:35 -- common/autotest_common.sh@10 -- # set +x 00:14:34.547 ************************************ 00:14:34.547 END TEST nvmf_ns_hotplug_stress 00:14:34.547 ************************************ 00:14:34.547 05:10:35 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:34.547 05:10:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:34.547 05:10:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:34.547 05:10:35 -- common/autotest_common.sh@10 -- # set +x 00:14:34.547 ************************************ 00:14:34.547 START TEST nvmf_connect_stress 00:14:34.547 ************************************ 00:14:34.547 05:10:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:34.547 * Looking for test storage... 00:14:34.547 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:34.547 05:10:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:34.547 05:10:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:34.547 05:10:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:34.547 05:10:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:34.547 05:10:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:34.547 05:10:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:34.547 05:10:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:34.547 05:10:35 -- scripts/common.sh@335 -- # IFS=.-: 00:14:34.547 05:10:35 -- scripts/common.sh@335 -- # read -ra ver1 00:14:34.547 05:10:35 -- scripts/common.sh@336 -- # IFS=.-: 00:14:34.547 05:10:35 -- scripts/common.sh@336 -- # read -ra ver2 00:14:34.547 05:10:35 -- scripts/common.sh@337 -- # local 'op=<' 00:14:34.547 05:10:35 -- scripts/common.sh@339 -- # ver1_l=2 00:14:34.547 05:10:35 -- scripts/common.sh@340 -- # ver2_l=1 00:14:34.547 05:10:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:34.547 05:10:35 -- scripts/common.sh@343 -- # case "$op" in 00:14:34.547 05:10:35 -- scripts/common.sh@344 -- # : 1 00:14:34.547 05:10:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:34.548 05:10:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:34.548 05:10:35 -- scripts/common.sh@364 -- # decimal 1 00:14:34.548 05:10:35 -- scripts/common.sh@352 -- # local d=1 00:14:34.548 05:10:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:34.548 05:10:35 -- scripts/common.sh@354 -- # echo 1 00:14:34.548 05:10:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:34.548 05:10:35 -- scripts/common.sh@365 -- # decimal 2 00:14:34.548 05:10:35 -- scripts/common.sh@352 -- # local d=2 00:14:34.548 05:10:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:34.548 05:10:35 -- scripts/common.sh@354 -- # echo 2 00:14:34.548 05:10:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:34.548 05:10:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:34.548 05:10:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:34.548 05:10:35 -- scripts/common.sh@367 -- # return 0 00:14:34.548 05:10:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:34.548 05:10:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:34.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:34.548 --rc genhtml_branch_coverage=1 00:14:34.548 --rc genhtml_function_coverage=1 00:14:34.548 --rc genhtml_legend=1 00:14:34.548 --rc geninfo_all_blocks=1 00:14:34.548 --rc geninfo_unexecuted_blocks=1 00:14:34.548 00:14:34.548 ' 00:14:34.548 05:10:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:34.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:34.548 --rc genhtml_branch_coverage=1 00:14:34.548 --rc genhtml_function_coverage=1 00:14:34.548 --rc genhtml_legend=1 00:14:34.548 --rc geninfo_all_blocks=1 00:14:34.548 --rc geninfo_unexecuted_blocks=1 00:14:34.548 00:14:34.548 ' 00:14:34.548 05:10:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:34.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:34.548 --rc genhtml_branch_coverage=1 00:14:34.548 --rc genhtml_function_coverage=1 00:14:34.548 --rc genhtml_legend=1 00:14:34.548 --rc geninfo_all_blocks=1 00:14:34.548 --rc geninfo_unexecuted_blocks=1 00:14:34.548 00:14:34.548 ' 00:14:34.548 05:10:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:34.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:34.548 --rc genhtml_branch_coverage=1 00:14:34.548 --rc genhtml_function_coverage=1 00:14:34.548 --rc genhtml_legend=1 00:14:34.548 --rc geninfo_all_blocks=1 00:14:34.548 --rc geninfo_unexecuted_blocks=1 00:14:34.548 00:14:34.548 ' 00:14:34.548 05:10:35 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:34.548 05:10:35 -- nvmf/common.sh@7 -- # uname -s 00:14:34.548 05:10:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:34.548 05:10:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:34.548 05:10:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:34.548 05:10:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:34.548 05:10:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:34.548 05:10:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:34.548 05:10:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:34.548 05:10:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:34.548 05:10:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:34.548 05:10:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:34.548 05:10:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:34.548 05:10:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:34.548 05:10:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:34.548 05:10:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:34.548 05:10:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:34.548 05:10:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:34.548 05:10:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:34.548 05:10:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:34.548 05:10:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:34.548 05:10:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:34.548 05:10:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:34.548 05:10:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:34.548 05:10:35 -- paths/export.sh@5 -- # export PATH 00:14:34.548 05:10:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:34.548 05:10:35 -- nvmf/common.sh@46 -- # : 0 00:14:34.548 05:10:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:34.548 05:10:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:34.548 05:10:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:34.548 05:10:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:34.548 05:10:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:34.548 05:10:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:34.548 05:10:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:34.548 05:10:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:34.548 05:10:35 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:34.548 05:10:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:34.548 05:10:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:34.548 05:10:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:34.548 05:10:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:34.548 05:10:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:34.548 05:10:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:34.548 05:10:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:34.548 05:10:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:34.548 05:10:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:34.548 05:10:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:34.548 05:10:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:34.548 05:10:35 -- common/autotest_common.sh@10 -- # set +x 00:14:36.445 05:10:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:36.445 05:10:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:36.445 05:10:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:36.445 05:10:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:36.445 05:10:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:36.445 05:10:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:36.445 05:10:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:36.445 05:10:37 -- nvmf/common.sh@294 -- # net_devs=() 00:14:36.445 05:10:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:36.445 05:10:37 -- nvmf/common.sh@295 -- # e810=() 00:14:36.445 05:10:37 -- nvmf/common.sh@295 -- # local -ga e810 00:14:36.445 05:10:37 -- nvmf/common.sh@296 -- # x722=() 00:14:36.445 05:10:37 -- nvmf/common.sh@296 -- # local -ga x722 00:14:36.445 05:10:37 -- nvmf/common.sh@297 -- # mlx=() 00:14:36.445 05:10:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:36.445 05:10:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:36.445 05:10:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:36.445 05:10:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:36.445 05:10:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:36.445 05:10:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:36.445 05:10:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:36.445 05:10:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:36.445 05:10:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:36.445 05:10:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:36.445 05:10:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:36.445 05:10:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:36.445 05:10:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:36.445 05:10:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:36.445 05:10:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:36.445 05:10:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:36.445 05:10:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:36.445 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:36.445 05:10:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:36.445 05:10:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:36.445 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:36.445 05:10:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:36.445 05:10:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:36.445 05:10:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:36.445 05:10:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:36.445 05:10:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:36.445 05:10:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:36.445 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:36.445 05:10:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:36.445 05:10:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:36.445 05:10:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:36.445 05:10:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:36.445 05:10:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:36.445 05:10:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:36.445 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:36.445 05:10:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:36.445 05:10:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:36.445 05:10:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:36.445 05:10:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:36.445 05:10:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:36.445 05:10:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:36.445 05:10:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:36.445 05:10:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:36.445 05:10:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:36.446 05:10:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:36.446 05:10:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:36.446 05:10:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:36.446 05:10:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:36.446 05:10:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:36.446 05:10:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:36.446 05:10:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:36.446 05:10:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:36.446 05:10:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:36.446 05:10:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:36.446 05:10:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:36.446 05:10:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:36.446 05:10:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:36.446 05:10:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:36.446 05:10:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:36.446 05:10:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:36.446 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:36.446 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:14:36.446 00:14:36.446 --- 10.0.0.2 ping statistics --- 00:14:36.446 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:36.446 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:14:36.446 05:10:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:36.446 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:36.446 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.171 ms 00:14:36.446 00:14:36.446 --- 10.0.0.1 ping statistics --- 00:14:36.446 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:36.446 rtt min/avg/max/mdev = 0.171/0.171/0.171/0.000 ms 00:14:36.446 05:10:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:36.446 05:10:37 -- nvmf/common.sh@410 -- # return 0 00:14:36.446 05:10:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:36.446 05:10:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:36.446 05:10:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:36.446 05:10:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:36.446 05:10:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:36.446 05:10:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:36.446 05:10:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:36.446 05:10:37 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:36.446 05:10:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:36.446 05:10:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:36.446 05:10:37 -- common/autotest_common.sh@10 -- # set +x 00:14:36.446 05:10:37 -- nvmf/common.sh@469 -- # nvmfpid=3260093 00:14:36.446 05:10:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:36.446 05:10:37 -- nvmf/common.sh@470 -- # waitforlisten 3260093 00:14:36.446 05:10:37 -- common/autotest_common.sh@829 -- # '[' -z 3260093 ']' 00:14:36.446 05:10:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:36.446 05:10:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:36.446 05:10:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:36.446 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:36.446 05:10:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:36.446 05:10:37 -- common/autotest_common.sh@10 -- # set +x 00:14:36.446 [2024-11-26 05:10:38.004307] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:36.446 [2024-11-26 05:10:38.004394] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:36.446 EAL: No free 2048 kB hugepages reported on node 1 00:14:36.446 [2024-11-26 05:10:38.068952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:36.446 [2024-11-26 05:10:38.156567] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:36.446 [2024-11-26 05:10:38.156734] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:36.446 [2024-11-26 05:10:38.156754] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:36.446 [2024-11-26 05:10:38.156767] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:36.446 [2024-11-26 05:10:38.156859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:36.446 [2024-11-26 05:10:38.156923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:36.446 [2024-11-26 05:10:38.156926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:37.382 05:10:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:37.382 05:10:38 -- common/autotest_common.sh@862 -- # return 0 00:14:37.382 05:10:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:37.382 05:10:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:37.382 05:10:38 -- common/autotest_common.sh@10 -- # set +x 00:14:37.382 05:10:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:37.382 05:10:38 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:37.382 05:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.382 05:10:38 -- common/autotest_common.sh@10 -- # set +x 00:14:37.382 [2024-11-26 05:10:38.989331] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:37.382 05:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.382 05:10:38 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:37.382 05:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.382 05:10:38 -- common/autotest_common.sh@10 -- # set +x 00:14:37.382 05:10:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.382 05:10:39 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:37.382 05:10:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.382 05:10:39 -- common/autotest_common.sh@10 -- # set +x 00:14:37.382 [2024-11-26 05:10:39.014867] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:37.382 05:10:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.382 05:10:39 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:37.382 05:10:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.382 05:10:39 -- common/autotest_common.sh@10 -- # set +x 00:14:37.382 NULL1 00:14:37.382 05:10:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.382 05:10:39 -- target/connect_stress.sh@21 -- # PERF_PID=3260250 00:14:37.382 05:10:39 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:37.382 05:10:39 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:37.382 05:10:39 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 EAL: No free 2048 kB hugepages reported on node 1 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:37.382 05:10:39 -- target/connect_stress.sh@28 -- # cat 00:14:37.382 05:10:39 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:37.382 05:10:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:37.382 05:10:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.382 05:10:39 -- common/autotest_common.sh@10 -- # set +x 00:14:37.643 05:10:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.643 05:10:39 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:37.643 05:10:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:37.643 05:10:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.643 05:10:39 -- common/autotest_common.sh@10 -- # set +x 00:14:38.208 05:10:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.208 05:10:39 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:38.208 05:10:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:38.208 05:10:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:38.208 05:10:39 -- common/autotest_common.sh@10 -- # set +x 00:14:38.466 05:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.466 05:10:40 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:38.466 05:10:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:38.466 05:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:38.466 05:10:40 -- common/autotest_common.sh@10 -- # set +x 00:14:38.724 05:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.724 05:10:40 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:38.724 05:10:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:38.724 05:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:38.724 05:10:40 -- common/autotest_common.sh@10 -- # set +x 00:14:38.982 05:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.982 05:10:40 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:38.982 05:10:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:38.982 05:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:38.982 05:10:40 -- common/autotest_common.sh@10 -- # set +x 00:14:39.240 05:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.240 05:10:40 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:39.240 05:10:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:39.240 05:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.240 05:10:40 -- common/autotest_common.sh@10 -- # set +x 00:14:39.805 05:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.805 05:10:41 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:39.805 05:10:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:39.805 05:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.805 05:10:41 -- common/autotest_common.sh@10 -- # set +x 00:14:40.062 05:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.062 05:10:41 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:40.062 05:10:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:40.062 05:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.062 05:10:41 -- common/autotest_common.sh@10 -- # set +x 00:14:40.321 05:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.321 05:10:41 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:40.321 05:10:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:40.321 05:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.321 05:10:41 -- common/autotest_common.sh@10 -- # set +x 00:14:40.579 05:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.579 05:10:42 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:40.579 05:10:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:40.579 05:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.579 05:10:42 -- common/autotest_common.sh@10 -- # set +x 00:14:41.144 05:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.144 05:10:42 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:41.144 05:10:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:41.144 05:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.144 05:10:42 -- common/autotest_common.sh@10 -- # set +x 00:14:41.401 05:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.401 05:10:42 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:41.401 05:10:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:41.401 05:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.401 05:10:42 -- common/autotest_common.sh@10 -- # set +x 00:14:41.659 05:10:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.659 05:10:43 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:41.659 05:10:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:41.659 05:10:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.659 05:10:43 -- common/autotest_common.sh@10 -- # set +x 00:14:41.917 05:10:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.917 05:10:43 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:41.917 05:10:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:41.917 05:10:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.917 05:10:43 -- common/autotest_common.sh@10 -- # set +x 00:14:42.175 05:10:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.175 05:10:43 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:42.175 05:10:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:42.175 05:10:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.175 05:10:43 -- common/autotest_common.sh@10 -- # set +x 00:14:42.741 05:10:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.741 05:10:44 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:42.741 05:10:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:42.741 05:10:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.741 05:10:44 -- common/autotest_common.sh@10 -- # set +x 00:14:42.999 05:10:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.999 05:10:44 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:42.999 05:10:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:42.999 05:10:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.999 05:10:44 -- common/autotest_common.sh@10 -- # set +x 00:14:43.257 05:10:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.257 05:10:44 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:43.257 05:10:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:43.257 05:10:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.257 05:10:44 -- common/autotest_common.sh@10 -- # set +x 00:14:43.514 05:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.514 05:10:45 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:43.514 05:10:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:43.514 05:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.514 05:10:45 -- common/autotest_common.sh@10 -- # set +x 00:14:43.771 05:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.771 05:10:45 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:43.771 05:10:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:43.771 05:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.771 05:10:45 -- common/autotest_common.sh@10 -- # set +x 00:14:44.336 05:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.336 05:10:45 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:44.336 05:10:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:44.336 05:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.336 05:10:45 -- common/autotest_common.sh@10 -- # set +x 00:14:44.594 05:10:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.594 05:10:46 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:44.594 05:10:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:44.594 05:10:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.594 05:10:46 -- common/autotest_common.sh@10 -- # set +x 00:14:44.852 05:10:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.852 05:10:46 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:44.852 05:10:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:44.852 05:10:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.852 05:10:46 -- common/autotest_common.sh@10 -- # set +x 00:14:45.109 05:10:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.109 05:10:46 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:45.109 05:10:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.109 05:10:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.109 05:10:46 -- common/autotest_common.sh@10 -- # set +x 00:14:45.368 05:10:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.368 05:10:47 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:45.368 05:10:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.368 05:10:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.368 05:10:47 -- common/autotest_common.sh@10 -- # set +x 00:14:45.933 05:10:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.933 05:10:47 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:45.933 05:10:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.933 05:10:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.933 05:10:47 -- common/autotest_common.sh@10 -- # set +x 00:14:46.190 05:10:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.190 05:10:47 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:46.190 05:10:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.190 05:10:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.190 05:10:47 -- common/autotest_common.sh@10 -- # set +x 00:14:46.448 05:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.448 05:10:48 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:46.448 05:10:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.448 05:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.448 05:10:48 -- common/autotest_common.sh@10 -- # set +x 00:14:46.705 05:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.705 05:10:48 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:46.705 05:10:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.705 05:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.705 05:10:48 -- common/autotest_common.sh@10 -- # set +x 00:14:46.963 05:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.963 05:10:48 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:46.963 05:10:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.963 05:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.963 05:10:48 -- common/autotest_common.sh@10 -- # set +x 00:14:47.528 05:10:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.528 05:10:49 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:47.528 05:10:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.528 05:10:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.528 05:10:49 -- common/autotest_common.sh@10 -- # set +x 00:14:47.528 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:47.786 05:10:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.786 05:10:49 -- target/connect_stress.sh@34 -- # kill -0 3260250 00:14:47.786 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3260250) - No such process 00:14:47.786 05:10:49 -- target/connect_stress.sh@38 -- # wait 3260250 00:14:47.786 05:10:49 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:47.786 05:10:49 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:47.786 05:10:49 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:47.786 05:10:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:47.786 05:10:49 -- nvmf/common.sh@116 -- # sync 00:14:47.786 05:10:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:47.786 05:10:49 -- nvmf/common.sh@119 -- # set +e 00:14:47.786 05:10:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:47.786 05:10:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:47.786 rmmod nvme_tcp 00:14:47.786 rmmod nvme_fabrics 00:14:47.786 rmmod nvme_keyring 00:14:47.786 05:10:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:47.786 05:10:49 -- nvmf/common.sh@123 -- # set -e 00:14:47.786 05:10:49 -- nvmf/common.sh@124 -- # return 0 00:14:47.786 05:10:49 -- nvmf/common.sh@477 -- # '[' -n 3260093 ']' 00:14:47.786 05:10:49 -- nvmf/common.sh@478 -- # killprocess 3260093 00:14:47.786 05:10:49 -- common/autotest_common.sh@936 -- # '[' -z 3260093 ']' 00:14:47.786 05:10:49 -- common/autotest_common.sh@940 -- # kill -0 3260093 00:14:47.786 05:10:49 -- common/autotest_common.sh@941 -- # uname 00:14:47.786 05:10:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:47.786 05:10:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3260093 00:14:47.786 05:10:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:47.786 05:10:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:47.786 05:10:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3260093' 00:14:47.786 killing process with pid 3260093 00:14:47.786 05:10:49 -- common/autotest_common.sh@955 -- # kill 3260093 00:14:47.786 05:10:49 -- common/autotest_common.sh@960 -- # wait 3260093 00:14:48.045 05:10:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:48.045 05:10:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:48.045 05:10:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:48.045 05:10:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:48.045 05:10:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:48.045 05:10:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:48.045 05:10:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:48.045 05:10:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:49.951 05:10:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:49.951 00:14:49.951 real 0m15.942s 00:14:49.951 user 0m40.667s 00:14:49.951 sys 0m5.717s 00:14:49.951 05:10:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:49.951 05:10:51 -- common/autotest_common.sh@10 -- # set +x 00:14:49.951 ************************************ 00:14:49.951 END TEST nvmf_connect_stress 00:14:49.951 ************************************ 00:14:50.210 05:10:51 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:50.210 05:10:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:50.210 05:10:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:50.210 05:10:51 -- common/autotest_common.sh@10 -- # set +x 00:14:50.210 ************************************ 00:14:50.210 START TEST nvmf_fused_ordering 00:14:50.210 ************************************ 00:14:50.210 05:10:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:50.210 * Looking for test storage... 00:14:50.210 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:50.210 05:10:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:50.210 05:10:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:50.210 05:10:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:50.210 05:10:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:50.210 05:10:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:50.210 05:10:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:50.210 05:10:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:50.210 05:10:51 -- scripts/common.sh@335 -- # IFS=.-: 00:14:50.210 05:10:51 -- scripts/common.sh@335 -- # read -ra ver1 00:14:50.210 05:10:51 -- scripts/common.sh@336 -- # IFS=.-: 00:14:50.210 05:10:51 -- scripts/common.sh@336 -- # read -ra ver2 00:14:50.210 05:10:51 -- scripts/common.sh@337 -- # local 'op=<' 00:14:50.210 05:10:51 -- scripts/common.sh@339 -- # ver1_l=2 00:14:50.210 05:10:51 -- scripts/common.sh@340 -- # ver2_l=1 00:14:50.210 05:10:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:50.210 05:10:51 -- scripts/common.sh@343 -- # case "$op" in 00:14:50.210 05:10:51 -- scripts/common.sh@344 -- # : 1 00:14:50.210 05:10:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:50.211 05:10:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:50.211 05:10:51 -- scripts/common.sh@364 -- # decimal 1 00:14:50.211 05:10:51 -- scripts/common.sh@352 -- # local d=1 00:14:50.211 05:10:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:50.211 05:10:51 -- scripts/common.sh@354 -- # echo 1 00:14:50.211 05:10:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:50.211 05:10:51 -- scripts/common.sh@365 -- # decimal 2 00:14:50.211 05:10:51 -- scripts/common.sh@352 -- # local d=2 00:14:50.211 05:10:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:50.211 05:10:51 -- scripts/common.sh@354 -- # echo 2 00:14:50.211 05:10:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:50.211 05:10:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:50.211 05:10:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:50.211 05:10:51 -- scripts/common.sh@367 -- # return 0 00:14:50.211 05:10:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:50.211 05:10:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:50.211 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:50.211 --rc genhtml_branch_coverage=1 00:14:50.211 --rc genhtml_function_coverage=1 00:14:50.211 --rc genhtml_legend=1 00:14:50.211 --rc geninfo_all_blocks=1 00:14:50.211 --rc geninfo_unexecuted_blocks=1 00:14:50.211 00:14:50.211 ' 00:14:50.211 05:10:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:50.211 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:50.211 --rc genhtml_branch_coverage=1 00:14:50.211 --rc genhtml_function_coverage=1 00:14:50.211 --rc genhtml_legend=1 00:14:50.211 --rc geninfo_all_blocks=1 00:14:50.211 --rc geninfo_unexecuted_blocks=1 00:14:50.211 00:14:50.211 ' 00:14:50.211 05:10:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:50.211 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:50.211 --rc genhtml_branch_coverage=1 00:14:50.211 --rc genhtml_function_coverage=1 00:14:50.211 --rc genhtml_legend=1 00:14:50.211 --rc geninfo_all_blocks=1 00:14:50.211 --rc geninfo_unexecuted_blocks=1 00:14:50.211 00:14:50.211 ' 00:14:50.211 05:10:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:50.211 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:50.211 --rc genhtml_branch_coverage=1 00:14:50.211 --rc genhtml_function_coverage=1 00:14:50.211 --rc genhtml_legend=1 00:14:50.211 --rc geninfo_all_blocks=1 00:14:50.211 --rc geninfo_unexecuted_blocks=1 00:14:50.211 00:14:50.211 ' 00:14:50.211 05:10:51 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:50.211 05:10:51 -- nvmf/common.sh@7 -- # uname -s 00:14:50.211 05:10:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:50.211 05:10:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:50.211 05:10:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:50.211 05:10:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:50.211 05:10:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:50.211 05:10:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:50.211 05:10:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:50.211 05:10:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:50.211 05:10:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:50.211 05:10:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:50.211 05:10:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:50.211 05:10:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:50.211 05:10:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:50.211 05:10:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:50.211 05:10:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:50.211 05:10:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:50.211 05:10:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:50.211 05:10:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:50.211 05:10:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:50.211 05:10:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:50.211 05:10:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:50.211 05:10:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:50.211 05:10:51 -- paths/export.sh@5 -- # export PATH 00:14:50.211 05:10:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:50.211 05:10:51 -- nvmf/common.sh@46 -- # : 0 00:14:50.211 05:10:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:50.211 05:10:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:50.211 05:10:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:50.211 05:10:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:50.211 05:10:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:50.211 05:10:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:50.211 05:10:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:50.211 05:10:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:50.211 05:10:51 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:50.211 05:10:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:50.211 05:10:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:50.211 05:10:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:50.211 05:10:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:50.211 05:10:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:50.211 05:10:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:50.211 05:10:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:50.211 05:10:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:50.211 05:10:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:50.211 05:10:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:50.211 05:10:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:50.211 05:10:51 -- common/autotest_common.sh@10 -- # set +x 00:14:52.116 05:10:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:52.116 05:10:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:52.116 05:10:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:52.116 05:10:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:52.116 05:10:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:52.116 05:10:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:52.116 05:10:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:52.116 05:10:53 -- nvmf/common.sh@294 -- # net_devs=() 00:14:52.116 05:10:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:52.376 05:10:53 -- nvmf/common.sh@295 -- # e810=() 00:14:52.376 05:10:53 -- nvmf/common.sh@295 -- # local -ga e810 00:14:52.376 05:10:53 -- nvmf/common.sh@296 -- # x722=() 00:14:52.376 05:10:53 -- nvmf/common.sh@296 -- # local -ga x722 00:14:52.376 05:10:53 -- nvmf/common.sh@297 -- # mlx=() 00:14:52.376 05:10:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:52.376 05:10:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:52.376 05:10:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:52.376 05:10:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:52.376 05:10:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:52.376 05:10:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:52.376 05:10:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:52.376 05:10:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:52.376 05:10:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:52.376 05:10:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:52.376 05:10:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:52.376 05:10:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:52.376 05:10:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:52.376 05:10:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:52.376 05:10:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:52.376 05:10:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:52.376 05:10:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:52.376 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:52.376 05:10:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:52.376 05:10:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:52.376 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:52.376 05:10:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:52.376 05:10:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:52.376 05:10:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:52.376 05:10:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:52.376 05:10:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:52.376 05:10:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:52.376 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:52.376 05:10:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:52.376 05:10:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:52.376 05:10:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:52.376 05:10:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:52.376 05:10:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:52.376 05:10:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:52.376 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:52.376 05:10:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:52.376 05:10:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:52.376 05:10:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:52.376 05:10:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:52.376 05:10:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:52.376 05:10:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:52.376 05:10:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:52.376 05:10:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:52.376 05:10:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:52.376 05:10:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:52.376 05:10:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:52.376 05:10:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:52.376 05:10:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:52.376 05:10:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:52.376 05:10:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:52.376 05:10:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:52.376 05:10:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:52.376 05:10:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:52.376 05:10:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:52.376 05:10:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:52.376 05:10:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:52.376 05:10:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:52.376 05:10:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:52.376 05:10:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:52.376 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:52.376 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.354 ms 00:14:52.376 00:14:52.376 --- 10.0.0.2 ping statistics --- 00:14:52.376 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:52.376 rtt min/avg/max/mdev = 0.354/0.354/0.354/0.000 ms 00:14:52.376 05:10:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:52.376 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:52.376 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.183 ms 00:14:52.376 00:14:52.376 --- 10.0.0.1 ping statistics --- 00:14:52.376 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:52.376 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:14:52.376 05:10:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:52.376 05:10:53 -- nvmf/common.sh@410 -- # return 0 00:14:52.376 05:10:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:52.376 05:10:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:52.376 05:10:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:52.376 05:10:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:52.376 05:10:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:52.376 05:10:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:52.376 05:10:54 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:52.376 05:10:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:52.376 05:10:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:52.376 05:10:54 -- common/autotest_common.sh@10 -- # set +x 00:14:52.376 05:10:54 -- nvmf/common.sh@469 -- # nvmfpid=3263454 00:14:52.376 05:10:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:52.376 05:10:54 -- nvmf/common.sh@470 -- # waitforlisten 3263454 00:14:52.376 05:10:54 -- common/autotest_common.sh@829 -- # '[' -z 3263454 ']' 00:14:52.376 05:10:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:52.376 05:10:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:52.376 05:10:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:52.376 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:52.377 05:10:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:52.377 05:10:54 -- common/autotest_common.sh@10 -- # set +x 00:14:52.377 [2024-11-26 05:10:54.067070] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:52.377 [2024-11-26 05:10:54.067146] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:52.377 EAL: No free 2048 kB hugepages reported on node 1 00:14:52.377 [2024-11-26 05:10:54.132373] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:52.635 [2024-11-26 05:10:54.214166] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:52.635 [2024-11-26 05:10:54.214323] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:52.635 [2024-11-26 05:10:54.214339] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:52.635 [2024-11-26 05:10:54.214351] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:52.636 [2024-11-26 05:10:54.214384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:53.571 05:10:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:53.571 05:10:55 -- common/autotest_common.sh@862 -- # return 0 00:14:53.571 05:10:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:53.571 05:10:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:53.571 05:10:55 -- common/autotest_common.sh@10 -- # set +x 00:14:53.571 05:10:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:53.571 05:10:55 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:53.571 05:10:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.571 05:10:55 -- common/autotest_common.sh@10 -- # set +x 00:14:53.571 [2024-11-26 05:10:55.067908] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:53.571 05:10:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.571 05:10:55 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:53.571 05:10:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.571 05:10:55 -- common/autotest_common.sh@10 -- # set +x 00:14:53.571 05:10:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.571 05:10:55 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:53.571 05:10:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.571 05:10:55 -- common/autotest_common.sh@10 -- # set +x 00:14:53.571 [2024-11-26 05:10:55.084151] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:53.571 05:10:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.571 05:10:55 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:53.571 05:10:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.571 05:10:55 -- common/autotest_common.sh@10 -- # set +x 00:14:53.571 NULL1 00:14:53.571 05:10:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.571 05:10:55 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:14:53.571 05:10:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.571 05:10:55 -- common/autotest_common.sh@10 -- # set +x 00:14:53.571 05:10:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.571 05:10:55 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:53.571 05:10:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.571 05:10:55 -- common/autotest_common.sh@10 -- # set +x 00:14:53.571 05:10:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.571 05:10:55 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:53.571 [2024-11-26 05:10:55.128758] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:53.571 [2024-11-26 05:10:55.128797] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3263606 ] 00:14:53.571 EAL: No free 2048 kB hugepages reported on node 1 00:14:53.829 Attached to nqn.2016-06.io.spdk:cnode1 00:14:53.829 Namespace ID: 1 size: 1GB 00:14:53.829 fused_ordering(0) 00:14:53.829 fused_ordering(1) 00:14:53.829 fused_ordering(2) 00:14:53.829 fused_ordering(3) 00:14:53.829 fused_ordering(4) 00:14:53.829 fused_ordering(5) 00:14:53.829 fused_ordering(6) 00:14:53.829 fused_ordering(7) 00:14:53.829 fused_ordering(8) 00:14:53.829 fused_ordering(9) 00:14:53.829 fused_ordering(10) 00:14:53.829 fused_ordering(11) 00:14:53.829 fused_ordering(12) 00:14:53.829 fused_ordering(13) 00:14:53.829 fused_ordering(14) 00:14:53.829 fused_ordering(15) 00:14:53.829 fused_ordering(16) 00:14:53.830 fused_ordering(17) 00:14:53.830 fused_ordering(18) 00:14:53.830 fused_ordering(19) 00:14:53.830 fused_ordering(20) 00:14:53.830 fused_ordering(21) 00:14:53.830 fused_ordering(22) 00:14:53.830 fused_ordering(23) 00:14:53.830 fused_ordering(24) 00:14:53.830 fused_ordering(25) 00:14:53.830 fused_ordering(26) 00:14:53.830 fused_ordering(27) 00:14:53.830 fused_ordering(28) 00:14:53.830 fused_ordering(29) 00:14:53.830 fused_ordering(30) 00:14:53.830 fused_ordering(31) 00:14:53.830 fused_ordering(32) 00:14:53.830 fused_ordering(33) 00:14:53.830 fused_ordering(34) 00:14:53.830 fused_ordering(35) 00:14:53.830 fused_ordering(36) 00:14:53.830 fused_ordering(37) 00:14:53.830 fused_ordering(38) 00:14:53.830 fused_ordering(39) 00:14:53.830 fused_ordering(40) 00:14:53.830 fused_ordering(41) 00:14:53.830 fused_ordering(42) 00:14:53.830 fused_ordering(43) 00:14:53.830 fused_ordering(44) 00:14:53.830 fused_ordering(45) 00:14:53.830 fused_ordering(46) 00:14:53.830 fused_ordering(47) 00:14:53.830 fused_ordering(48) 00:14:53.830 fused_ordering(49) 00:14:53.830 fused_ordering(50) 00:14:53.830 fused_ordering(51) 00:14:53.830 fused_ordering(52) 00:14:53.830 fused_ordering(53) 00:14:53.830 fused_ordering(54) 00:14:53.830 fused_ordering(55) 00:14:53.830 fused_ordering(56) 00:14:53.830 fused_ordering(57) 00:14:53.830 fused_ordering(58) 00:14:53.830 fused_ordering(59) 00:14:53.830 fused_ordering(60) 00:14:53.830 fused_ordering(61) 00:14:53.830 fused_ordering(62) 00:14:53.830 fused_ordering(63) 00:14:53.830 fused_ordering(64) 00:14:53.830 fused_ordering(65) 00:14:53.830 fused_ordering(66) 00:14:53.830 fused_ordering(67) 00:14:53.830 fused_ordering(68) 00:14:53.830 fused_ordering(69) 00:14:53.830 fused_ordering(70) 00:14:53.830 fused_ordering(71) 00:14:53.830 fused_ordering(72) 00:14:53.830 fused_ordering(73) 00:14:53.830 fused_ordering(74) 00:14:53.830 fused_ordering(75) 00:14:53.830 fused_ordering(76) 00:14:53.830 fused_ordering(77) 00:14:53.830 fused_ordering(78) 00:14:53.830 fused_ordering(79) 00:14:53.830 fused_ordering(80) 00:14:53.830 fused_ordering(81) 00:14:53.830 fused_ordering(82) 00:14:53.830 fused_ordering(83) 00:14:53.830 fused_ordering(84) 00:14:53.830 fused_ordering(85) 00:14:53.830 fused_ordering(86) 00:14:53.830 fused_ordering(87) 00:14:53.830 fused_ordering(88) 00:14:53.830 fused_ordering(89) 00:14:53.830 fused_ordering(90) 00:14:53.830 fused_ordering(91) 00:14:53.830 fused_ordering(92) 00:14:53.830 fused_ordering(93) 00:14:53.830 fused_ordering(94) 00:14:53.830 fused_ordering(95) 00:14:53.830 fused_ordering(96) 00:14:53.830 fused_ordering(97) 00:14:53.830 fused_ordering(98) 00:14:53.830 fused_ordering(99) 00:14:53.830 fused_ordering(100) 00:14:53.830 fused_ordering(101) 00:14:53.830 fused_ordering(102) 00:14:53.830 fused_ordering(103) 00:14:53.830 fused_ordering(104) 00:14:53.830 fused_ordering(105) 00:14:53.830 fused_ordering(106) 00:14:53.830 fused_ordering(107) 00:14:53.830 fused_ordering(108) 00:14:53.830 fused_ordering(109) 00:14:53.830 fused_ordering(110) 00:14:53.830 fused_ordering(111) 00:14:53.830 fused_ordering(112) 00:14:53.830 fused_ordering(113) 00:14:53.830 fused_ordering(114) 00:14:53.830 fused_ordering(115) 00:14:53.830 fused_ordering(116) 00:14:53.830 fused_ordering(117) 00:14:53.830 fused_ordering(118) 00:14:53.830 fused_ordering(119) 00:14:53.830 fused_ordering(120) 00:14:53.830 fused_ordering(121) 00:14:53.830 fused_ordering(122) 00:14:53.830 fused_ordering(123) 00:14:53.830 fused_ordering(124) 00:14:53.830 fused_ordering(125) 00:14:53.830 fused_ordering(126) 00:14:53.830 fused_ordering(127) 00:14:53.830 fused_ordering(128) 00:14:53.830 fused_ordering(129) 00:14:53.830 fused_ordering(130) 00:14:53.830 fused_ordering(131) 00:14:53.830 fused_ordering(132) 00:14:53.830 fused_ordering(133) 00:14:53.830 fused_ordering(134) 00:14:53.830 fused_ordering(135) 00:14:53.830 fused_ordering(136) 00:14:53.830 fused_ordering(137) 00:14:53.830 fused_ordering(138) 00:14:53.830 fused_ordering(139) 00:14:53.830 fused_ordering(140) 00:14:53.830 fused_ordering(141) 00:14:53.830 fused_ordering(142) 00:14:53.830 fused_ordering(143) 00:14:53.830 fused_ordering(144) 00:14:53.830 fused_ordering(145) 00:14:53.830 fused_ordering(146) 00:14:53.830 fused_ordering(147) 00:14:53.830 fused_ordering(148) 00:14:53.830 fused_ordering(149) 00:14:53.830 fused_ordering(150) 00:14:53.830 fused_ordering(151) 00:14:53.830 fused_ordering(152) 00:14:53.830 fused_ordering(153) 00:14:53.830 fused_ordering(154) 00:14:53.830 fused_ordering(155) 00:14:53.830 fused_ordering(156) 00:14:53.830 fused_ordering(157) 00:14:53.830 fused_ordering(158) 00:14:53.830 fused_ordering(159) 00:14:53.830 fused_ordering(160) 00:14:53.830 fused_ordering(161) 00:14:53.830 fused_ordering(162) 00:14:53.830 fused_ordering(163) 00:14:53.830 fused_ordering(164) 00:14:53.830 fused_ordering(165) 00:14:53.830 fused_ordering(166) 00:14:53.830 fused_ordering(167) 00:14:53.830 fused_ordering(168) 00:14:53.830 fused_ordering(169) 00:14:53.830 fused_ordering(170) 00:14:53.830 fused_ordering(171) 00:14:53.830 fused_ordering(172) 00:14:53.830 fused_ordering(173) 00:14:53.830 fused_ordering(174) 00:14:53.830 fused_ordering(175) 00:14:53.830 fused_ordering(176) 00:14:53.830 fused_ordering(177) 00:14:53.830 fused_ordering(178) 00:14:53.830 fused_ordering(179) 00:14:53.830 fused_ordering(180) 00:14:53.830 fused_ordering(181) 00:14:53.830 fused_ordering(182) 00:14:53.830 fused_ordering(183) 00:14:53.830 fused_ordering(184) 00:14:53.830 fused_ordering(185) 00:14:53.830 fused_ordering(186) 00:14:53.830 fused_ordering(187) 00:14:53.830 fused_ordering(188) 00:14:53.830 fused_ordering(189) 00:14:53.830 fused_ordering(190) 00:14:53.830 fused_ordering(191) 00:14:53.830 fused_ordering(192) 00:14:53.830 fused_ordering(193) 00:14:53.830 fused_ordering(194) 00:14:53.830 fused_ordering(195) 00:14:53.830 fused_ordering(196) 00:14:53.830 fused_ordering(197) 00:14:53.830 fused_ordering(198) 00:14:53.830 fused_ordering(199) 00:14:53.830 fused_ordering(200) 00:14:53.830 fused_ordering(201) 00:14:53.830 fused_ordering(202) 00:14:53.830 fused_ordering(203) 00:14:53.830 fused_ordering(204) 00:14:53.830 fused_ordering(205) 00:14:54.089 fused_ordering(206) 00:14:54.089 fused_ordering(207) 00:14:54.089 fused_ordering(208) 00:14:54.089 fused_ordering(209) 00:14:54.089 fused_ordering(210) 00:14:54.089 fused_ordering(211) 00:14:54.089 fused_ordering(212) 00:14:54.089 fused_ordering(213) 00:14:54.089 fused_ordering(214) 00:14:54.089 fused_ordering(215) 00:14:54.089 fused_ordering(216) 00:14:54.089 fused_ordering(217) 00:14:54.089 fused_ordering(218) 00:14:54.089 fused_ordering(219) 00:14:54.089 fused_ordering(220) 00:14:54.089 fused_ordering(221) 00:14:54.089 fused_ordering(222) 00:14:54.089 fused_ordering(223) 00:14:54.089 fused_ordering(224) 00:14:54.089 fused_ordering(225) 00:14:54.089 fused_ordering(226) 00:14:54.089 fused_ordering(227) 00:14:54.089 fused_ordering(228) 00:14:54.089 fused_ordering(229) 00:14:54.089 fused_ordering(230) 00:14:54.089 fused_ordering(231) 00:14:54.089 fused_ordering(232) 00:14:54.089 fused_ordering(233) 00:14:54.089 fused_ordering(234) 00:14:54.089 fused_ordering(235) 00:14:54.089 fused_ordering(236) 00:14:54.089 fused_ordering(237) 00:14:54.089 fused_ordering(238) 00:14:54.089 fused_ordering(239) 00:14:54.089 fused_ordering(240) 00:14:54.089 fused_ordering(241) 00:14:54.089 fused_ordering(242) 00:14:54.089 fused_ordering(243) 00:14:54.089 fused_ordering(244) 00:14:54.089 fused_ordering(245) 00:14:54.089 fused_ordering(246) 00:14:54.089 fused_ordering(247) 00:14:54.089 fused_ordering(248) 00:14:54.089 fused_ordering(249) 00:14:54.089 fused_ordering(250) 00:14:54.089 fused_ordering(251) 00:14:54.089 fused_ordering(252) 00:14:54.089 fused_ordering(253) 00:14:54.089 fused_ordering(254) 00:14:54.089 fused_ordering(255) 00:14:54.089 fused_ordering(256) 00:14:54.089 fused_ordering(257) 00:14:54.089 fused_ordering(258) 00:14:54.089 fused_ordering(259) 00:14:54.089 fused_ordering(260) 00:14:54.089 fused_ordering(261) 00:14:54.089 fused_ordering(262) 00:14:54.089 fused_ordering(263) 00:14:54.089 fused_ordering(264) 00:14:54.089 fused_ordering(265) 00:14:54.089 fused_ordering(266) 00:14:54.089 fused_ordering(267) 00:14:54.089 fused_ordering(268) 00:14:54.089 fused_ordering(269) 00:14:54.089 fused_ordering(270) 00:14:54.089 fused_ordering(271) 00:14:54.089 fused_ordering(272) 00:14:54.089 fused_ordering(273) 00:14:54.089 fused_ordering(274) 00:14:54.089 fused_ordering(275) 00:14:54.089 fused_ordering(276) 00:14:54.089 fused_ordering(277) 00:14:54.089 fused_ordering(278) 00:14:54.089 fused_ordering(279) 00:14:54.089 fused_ordering(280) 00:14:54.089 fused_ordering(281) 00:14:54.089 fused_ordering(282) 00:14:54.089 fused_ordering(283) 00:14:54.089 fused_ordering(284) 00:14:54.089 fused_ordering(285) 00:14:54.089 fused_ordering(286) 00:14:54.089 fused_ordering(287) 00:14:54.089 fused_ordering(288) 00:14:54.089 fused_ordering(289) 00:14:54.089 fused_ordering(290) 00:14:54.089 fused_ordering(291) 00:14:54.089 fused_ordering(292) 00:14:54.089 fused_ordering(293) 00:14:54.089 fused_ordering(294) 00:14:54.089 fused_ordering(295) 00:14:54.089 fused_ordering(296) 00:14:54.089 fused_ordering(297) 00:14:54.089 fused_ordering(298) 00:14:54.089 fused_ordering(299) 00:14:54.089 fused_ordering(300) 00:14:54.089 fused_ordering(301) 00:14:54.089 fused_ordering(302) 00:14:54.089 fused_ordering(303) 00:14:54.089 fused_ordering(304) 00:14:54.089 fused_ordering(305) 00:14:54.089 fused_ordering(306) 00:14:54.089 fused_ordering(307) 00:14:54.089 fused_ordering(308) 00:14:54.089 fused_ordering(309) 00:14:54.089 fused_ordering(310) 00:14:54.089 fused_ordering(311) 00:14:54.089 fused_ordering(312) 00:14:54.089 fused_ordering(313) 00:14:54.089 fused_ordering(314) 00:14:54.089 fused_ordering(315) 00:14:54.089 fused_ordering(316) 00:14:54.089 fused_ordering(317) 00:14:54.089 fused_ordering(318) 00:14:54.089 fused_ordering(319) 00:14:54.089 fused_ordering(320) 00:14:54.089 fused_ordering(321) 00:14:54.089 fused_ordering(322) 00:14:54.089 fused_ordering(323) 00:14:54.089 fused_ordering(324) 00:14:54.089 fused_ordering(325) 00:14:54.089 fused_ordering(326) 00:14:54.089 fused_ordering(327) 00:14:54.089 fused_ordering(328) 00:14:54.089 fused_ordering(329) 00:14:54.089 fused_ordering(330) 00:14:54.089 fused_ordering(331) 00:14:54.089 fused_ordering(332) 00:14:54.089 fused_ordering(333) 00:14:54.089 fused_ordering(334) 00:14:54.089 fused_ordering(335) 00:14:54.089 fused_ordering(336) 00:14:54.089 fused_ordering(337) 00:14:54.089 fused_ordering(338) 00:14:54.089 fused_ordering(339) 00:14:54.089 fused_ordering(340) 00:14:54.089 fused_ordering(341) 00:14:54.089 fused_ordering(342) 00:14:54.089 fused_ordering(343) 00:14:54.089 fused_ordering(344) 00:14:54.089 fused_ordering(345) 00:14:54.089 fused_ordering(346) 00:14:54.089 fused_ordering(347) 00:14:54.089 fused_ordering(348) 00:14:54.089 fused_ordering(349) 00:14:54.089 fused_ordering(350) 00:14:54.089 fused_ordering(351) 00:14:54.089 fused_ordering(352) 00:14:54.089 fused_ordering(353) 00:14:54.089 fused_ordering(354) 00:14:54.089 fused_ordering(355) 00:14:54.089 fused_ordering(356) 00:14:54.089 fused_ordering(357) 00:14:54.089 fused_ordering(358) 00:14:54.089 fused_ordering(359) 00:14:54.089 fused_ordering(360) 00:14:54.089 fused_ordering(361) 00:14:54.089 fused_ordering(362) 00:14:54.089 fused_ordering(363) 00:14:54.089 fused_ordering(364) 00:14:54.089 fused_ordering(365) 00:14:54.089 fused_ordering(366) 00:14:54.089 fused_ordering(367) 00:14:54.090 fused_ordering(368) 00:14:54.090 fused_ordering(369) 00:14:54.090 fused_ordering(370) 00:14:54.090 fused_ordering(371) 00:14:54.090 fused_ordering(372) 00:14:54.090 fused_ordering(373) 00:14:54.090 fused_ordering(374) 00:14:54.090 fused_ordering(375) 00:14:54.090 fused_ordering(376) 00:14:54.090 fused_ordering(377) 00:14:54.090 fused_ordering(378) 00:14:54.090 fused_ordering(379) 00:14:54.090 fused_ordering(380) 00:14:54.090 fused_ordering(381) 00:14:54.090 fused_ordering(382) 00:14:54.090 fused_ordering(383) 00:14:54.090 fused_ordering(384) 00:14:54.090 fused_ordering(385) 00:14:54.090 fused_ordering(386) 00:14:54.090 fused_ordering(387) 00:14:54.090 fused_ordering(388) 00:14:54.090 fused_ordering(389) 00:14:54.090 fused_ordering(390) 00:14:54.090 fused_ordering(391) 00:14:54.090 fused_ordering(392) 00:14:54.090 fused_ordering(393) 00:14:54.090 fused_ordering(394) 00:14:54.090 fused_ordering(395) 00:14:54.090 fused_ordering(396) 00:14:54.090 fused_ordering(397) 00:14:54.090 fused_ordering(398) 00:14:54.090 fused_ordering(399) 00:14:54.090 fused_ordering(400) 00:14:54.090 fused_ordering(401) 00:14:54.090 fused_ordering(402) 00:14:54.090 fused_ordering(403) 00:14:54.090 fused_ordering(404) 00:14:54.090 fused_ordering(405) 00:14:54.090 fused_ordering(406) 00:14:54.090 fused_ordering(407) 00:14:54.090 fused_ordering(408) 00:14:54.090 fused_ordering(409) 00:14:54.090 fused_ordering(410) 00:14:54.656 fused_ordering(411) 00:14:54.656 fused_ordering(412) 00:14:54.656 fused_ordering(413) 00:14:54.656 fused_ordering(414) 00:14:54.656 fused_ordering(415) 00:14:54.656 fused_ordering(416) 00:14:54.656 fused_ordering(417) 00:14:54.656 fused_ordering(418) 00:14:54.656 fused_ordering(419) 00:14:54.656 fused_ordering(420) 00:14:54.656 fused_ordering(421) 00:14:54.656 fused_ordering(422) 00:14:54.656 fused_ordering(423) 00:14:54.656 fused_ordering(424) 00:14:54.656 fused_ordering(425) 00:14:54.656 fused_ordering(426) 00:14:54.656 fused_ordering(427) 00:14:54.656 fused_ordering(428) 00:14:54.656 fused_ordering(429) 00:14:54.656 fused_ordering(430) 00:14:54.656 fused_ordering(431) 00:14:54.656 fused_ordering(432) 00:14:54.656 fused_ordering(433) 00:14:54.656 fused_ordering(434) 00:14:54.656 fused_ordering(435) 00:14:54.656 fused_ordering(436) 00:14:54.656 fused_ordering(437) 00:14:54.656 fused_ordering(438) 00:14:54.656 fused_ordering(439) 00:14:54.656 fused_ordering(440) 00:14:54.656 fused_ordering(441) 00:14:54.656 fused_ordering(442) 00:14:54.656 fused_ordering(443) 00:14:54.656 fused_ordering(444) 00:14:54.656 fused_ordering(445) 00:14:54.656 fused_ordering(446) 00:14:54.656 fused_ordering(447) 00:14:54.656 fused_ordering(448) 00:14:54.656 fused_ordering(449) 00:14:54.656 fused_ordering(450) 00:14:54.656 fused_ordering(451) 00:14:54.656 fused_ordering(452) 00:14:54.656 fused_ordering(453) 00:14:54.656 fused_ordering(454) 00:14:54.656 fused_ordering(455) 00:14:54.656 fused_ordering(456) 00:14:54.656 fused_ordering(457) 00:14:54.656 fused_ordering(458) 00:14:54.656 fused_ordering(459) 00:14:54.656 fused_ordering(460) 00:14:54.656 fused_ordering(461) 00:14:54.656 fused_ordering(462) 00:14:54.656 fused_ordering(463) 00:14:54.656 fused_ordering(464) 00:14:54.656 fused_ordering(465) 00:14:54.657 fused_ordering(466) 00:14:54.657 fused_ordering(467) 00:14:54.657 fused_ordering(468) 00:14:54.657 fused_ordering(469) 00:14:54.657 fused_ordering(470) 00:14:54.657 fused_ordering(471) 00:14:54.657 fused_ordering(472) 00:14:54.657 fused_ordering(473) 00:14:54.657 fused_ordering(474) 00:14:54.657 fused_ordering(475) 00:14:54.657 fused_ordering(476) 00:14:54.657 fused_ordering(477) 00:14:54.657 fused_ordering(478) 00:14:54.657 fused_ordering(479) 00:14:54.657 fused_ordering(480) 00:14:54.657 fused_ordering(481) 00:14:54.657 fused_ordering(482) 00:14:54.657 fused_ordering(483) 00:14:54.657 fused_ordering(484) 00:14:54.657 fused_ordering(485) 00:14:54.657 fused_ordering(486) 00:14:54.657 fused_ordering(487) 00:14:54.657 fused_ordering(488) 00:14:54.657 fused_ordering(489) 00:14:54.657 fused_ordering(490) 00:14:54.657 fused_ordering(491) 00:14:54.657 fused_ordering(492) 00:14:54.657 fused_ordering(493) 00:14:54.657 fused_ordering(494) 00:14:54.657 fused_ordering(495) 00:14:54.657 fused_ordering(496) 00:14:54.657 fused_ordering(497) 00:14:54.657 fused_ordering(498) 00:14:54.657 fused_ordering(499) 00:14:54.657 fused_ordering(500) 00:14:54.657 fused_ordering(501) 00:14:54.657 fused_ordering(502) 00:14:54.657 fused_ordering(503) 00:14:54.657 fused_ordering(504) 00:14:54.657 fused_ordering(505) 00:14:54.657 fused_ordering(506) 00:14:54.657 fused_ordering(507) 00:14:54.657 fused_ordering(508) 00:14:54.657 fused_ordering(509) 00:14:54.657 fused_ordering(510) 00:14:54.657 fused_ordering(511) 00:14:54.657 fused_ordering(512) 00:14:54.657 fused_ordering(513) 00:14:54.657 fused_ordering(514) 00:14:54.657 fused_ordering(515) 00:14:54.657 fused_ordering(516) 00:14:54.657 fused_ordering(517) 00:14:54.657 fused_ordering(518) 00:14:54.657 fused_ordering(519) 00:14:54.657 fused_ordering(520) 00:14:54.657 fused_ordering(521) 00:14:54.657 fused_ordering(522) 00:14:54.657 fused_ordering(523) 00:14:54.657 fused_ordering(524) 00:14:54.657 fused_ordering(525) 00:14:54.657 fused_ordering(526) 00:14:54.657 fused_ordering(527) 00:14:54.657 fused_ordering(528) 00:14:54.657 fused_ordering(529) 00:14:54.657 fused_ordering(530) 00:14:54.657 fused_ordering(531) 00:14:54.657 fused_ordering(532) 00:14:54.657 fused_ordering(533) 00:14:54.657 fused_ordering(534) 00:14:54.657 fused_ordering(535) 00:14:54.657 fused_ordering(536) 00:14:54.657 fused_ordering(537) 00:14:54.657 fused_ordering(538) 00:14:54.657 fused_ordering(539) 00:14:54.657 fused_ordering(540) 00:14:54.657 fused_ordering(541) 00:14:54.657 fused_ordering(542) 00:14:54.657 fused_ordering(543) 00:14:54.657 fused_ordering(544) 00:14:54.657 fused_ordering(545) 00:14:54.657 fused_ordering(546) 00:14:54.657 fused_ordering(547) 00:14:54.657 fused_ordering(548) 00:14:54.657 fused_ordering(549) 00:14:54.657 fused_ordering(550) 00:14:54.657 fused_ordering(551) 00:14:54.657 fused_ordering(552) 00:14:54.657 fused_ordering(553) 00:14:54.657 fused_ordering(554) 00:14:54.657 fused_ordering(555) 00:14:54.657 fused_ordering(556) 00:14:54.657 fused_ordering(557) 00:14:54.657 fused_ordering(558) 00:14:54.657 fused_ordering(559) 00:14:54.657 fused_ordering(560) 00:14:54.657 fused_ordering(561) 00:14:54.657 fused_ordering(562) 00:14:54.657 fused_ordering(563) 00:14:54.657 fused_ordering(564) 00:14:54.657 fused_ordering(565) 00:14:54.657 fused_ordering(566) 00:14:54.657 fused_ordering(567) 00:14:54.657 fused_ordering(568) 00:14:54.657 fused_ordering(569) 00:14:54.657 fused_ordering(570) 00:14:54.657 fused_ordering(571) 00:14:54.657 fused_ordering(572) 00:14:54.657 fused_ordering(573) 00:14:54.657 fused_ordering(574) 00:14:54.657 fused_ordering(575) 00:14:54.657 fused_ordering(576) 00:14:54.657 fused_ordering(577) 00:14:54.657 fused_ordering(578) 00:14:54.657 fused_ordering(579) 00:14:54.657 fused_ordering(580) 00:14:54.657 fused_ordering(581) 00:14:54.657 fused_ordering(582) 00:14:54.657 fused_ordering(583) 00:14:54.657 fused_ordering(584) 00:14:54.657 fused_ordering(585) 00:14:54.657 fused_ordering(586) 00:14:54.657 fused_ordering(587) 00:14:54.657 fused_ordering(588) 00:14:54.657 fused_ordering(589) 00:14:54.657 fused_ordering(590) 00:14:54.657 fused_ordering(591) 00:14:54.657 fused_ordering(592) 00:14:54.657 fused_ordering(593) 00:14:54.657 fused_ordering(594) 00:14:54.657 fused_ordering(595) 00:14:54.657 fused_ordering(596) 00:14:54.657 fused_ordering(597) 00:14:54.657 fused_ordering(598) 00:14:54.657 fused_ordering(599) 00:14:54.657 fused_ordering(600) 00:14:54.657 fused_ordering(601) 00:14:54.657 fused_ordering(602) 00:14:54.657 fused_ordering(603) 00:14:54.657 fused_ordering(604) 00:14:54.657 fused_ordering(605) 00:14:54.657 fused_ordering(606) 00:14:54.657 fused_ordering(607) 00:14:54.657 fused_ordering(608) 00:14:54.657 fused_ordering(609) 00:14:54.657 fused_ordering(610) 00:14:54.657 fused_ordering(611) 00:14:54.657 fused_ordering(612) 00:14:54.657 fused_ordering(613) 00:14:54.657 fused_ordering(614) 00:14:54.657 fused_ordering(615) 00:14:55.225 fused_ordering(616) 00:14:55.225 fused_ordering(617) 00:14:55.225 fused_ordering(618) 00:14:55.225 fused_ordering(619) 00:14:55.225 fused_ordering(620) 00:14:55.225 fused_ordering(621) 00:14:55.225 fused_ordering(622) 00:14:55.225 fused_ordering(623) 00:14:55.225 fused_ordering(624) 00:14:55.225 fused_ordering(625) 00:14:55.225 fused_ordering(626) 00:14:55.225 fused_ordering(627) 00:14:55.225 fused_ordering(628) 00:14:55.225 fused_ordering(629) 00:14:55.225 fused_ordering(630) 00:14:55.225 fused_ordering(631) 00:14:55.225 fused_ordering(632) 00:14:55.225 fused_ordering(633) 00:14:55.225 fused_ordering(634) 00:14:55.225 fused_ordering(635) 00:14:55.225 fused_ordering(636) 00:14:55.225 fused_ordering(637) 00:14:55.225 fused_ordering(638) 00:14:55.225 fused_ordering(639) 00:14:55.225 fused_ordering(640) 00:14:55.225 fused_ordering(641) 00:14:55.225 fused_ordering(642) 00:14:55.225 fused_ordering(643) 00:14:55.225 fused_ordering(644) 00:14:55.225 fused_ordering(645) 00:14:55.225 fused_ordering(646) 00:14:55.225 fused_ordering(647) 00:14:55.225 fused_ordering(648) 00:14:55.225 fused_ordering(649) 00:14:55.225 fused_ordering(650) 00:14:55.225 fused_ordering(651) 00:14:55.225 fused_ordering(652) 00:14:55.225 fused_ordering(653) 00:14:55.225 fused_ordering(654) 00:14:55.225 fused_ordering(655) 00:14:55.225 fused_ordering(656) 00:14:55.225 fused_ordering(657) 00:14:55.225 fused_ordering(658) 00:14:55.225 fused_ordering(659) 00:14:55.225 fused_ordering(660) 00:14:55.225 fused_ordering(661) 00:14:55.225 fused_ordering(662) 00:14:55.225 fused_ordering(663) 00:14:55.225 fused_ordering(664) 00:14:55.225 fused_ordering(665) 00:14:55.225 fused_ordering(666) 00:14:55.225 fused_ordering(667) 00:14:55.225 fused_ordering(668) 00:14:55.225 fused_ordering(669) 00:14:55.225 fused_ordering(670) 00:14:55.225 fused_ordering(671) 00:14:55.225 fused_ordering(672) 00:14:55.225 fused_ordering(673) 00:14:55.225 fused_ordering(674) 00:14:55.225 fused_ordering(675) 00:14:55.225 fused_ordering(676) 00:14:55.225 fused_ordering(677) 00:14:55.225 fused_ordering(678) 00:14:55.225 fused_ordering(679) 00:14:55.225 fused_ordering(680) 00:14:55.225 fused_ordering(681) 00:14:55.225 fused_ordering(682) 00:14:55.225 fused_ordering(683) 00:14:55.225 fused_ordering(684) 00:14:55.225 fused_ordering(685) 00:14:55.225 fused_ordering(686) 00:14:55.225 fused_ordering(687) 00:14:55.225 fused_ordering(688) 00:14:55.225 fused_ordering(689) 00:14:55.225 fused_ordering(690) 00:14:55.225 fused_ordering(691) 00:14:55.225 fused_ordering(692) 00:14:55.225 fused_ordering(693) 00:14:55.225 fused_ordering(694) 00:14:55.225 fused_ordering(695) 00:14:55.225 fused_ordering(696) 00:14:55.225 fused_ordering(697) 00:14:55.225 fused_ordering(698) 00:14:55.225 fused_ordering(699) 00:14:55.225 fused_ordering(700) 00:14:55.225 fused_ordering(701) 00:14:55.225 fused_ordering(702) 00:14:55.225 fused_ordering(703) 00:14:55.225 fused_ordering(704) 00:14:55.225 fused_ordering(705) 00:14:55.225 fused_ordering(706) 00:14:55.225 fused_ordering(707) 00:14:55.225 fused_ordering(708) 00:14:55.225 fused_ordering(709) 00:14:55.225 fused_ordering(710) 00:14:55.225 fused_ordering(711) 00:14:55.225 fused_ordering(712) 00:14:55.226 fused_ordering(713) 00:14:55.226 fused_ordering(714) 00:14:55.226 fused_ordering(715) 00:14:55.226 fused_ordering(716) 00:14:55.226 fused_ordering(717) 00:14:55.226 fused_ordering(718) 00:14:55.226 fused_ordering(719) 00:14:55.226 fused_ordering(720) 00:14:55.226 fused_ordering(721) 00:14:55.226 fused_ordering(722) 00:14:55.226 fused_ordering(723) 00:14:55.226 fused_ordering(724) 00:14:55.226 fused_ordering(725) 00:14:55.226 fused_ordering(726) 00:14:55.226 fused_ordering(727) 00:14:55.226 fused_ordering(728) 00:14:55.226 fused_ordering(729) 00:14:55.226 fused_ordering(730) 00:14:55.226 fused_ordering(731) 00:14:55.226 fused_ordering(732) 00:14:55.226 fused_ordering(733) 00:14:55.226 fused_ordering(734) 00:14:55.226 fused_ordering(735) 00:14:55.226 fused_ordering(736) 00:14:55.226 fused_ordering(737) 00:14:55.226 fused_ordering(738) 00:14:55.226 fused_ordering(739) 00:14:55.226 fused_ordering(740) 00:14:55.226 fused_ordering(741) 00:14:55.226 fused_ordering(742) 00:14:55.226 fused_ordering(743) 00:14:55.226 fused_ordering(744) 00:14:55.226 fused_ordering(745) 00:14:55.226 fused_ordering(746) 00:14:55.226 fused_ordering(747) 00:14:55.226 fused_ordering(748) 00:14:55.226 fused_ordering(749) 00:14:55.226 fused_ordering(750) 00:14:55.226 fused_ordering(751) 00:14:55.226 fused_ordering(752) 00:14:55.226 fused_ordering(753) 00:14:55.226 fused_ordering(754) 00:14:55.226 fused_ordering(755) 00:14:55.226 fused_ordering(756) 00:14:55.226 fused_ordering(757) 00:14:55.226 fused_ordering(758) 00:14:55.226 fused_ordering(759) 00:14:55.226 fused_ordering(760) 00:14:55.226 fused_ordering(761) 00:14:55.226 fused_ordering(762) 00:14:55.226 fused_ordering(763) 00:14:55.226 fused_ordering(764) 00:14:55.226 fused_ordering(765) 00:14:55.226 fused_ordering(766) 00:14:55.226 fused_ordering(767) 00:14:55.226 fused_ordering(768) 00:14:55.226 fused_ordering(769) 00:14:55.226 fused_ordering(770) 00:14:55.226 fused_ordering(771) 00:14:55.226 fused_ordering(772) 00:14:55.226 fused_ordering(773) 00:14:55.226 fused_ordering(774) 00:14:55.226 fused_ordering(775) 00:14:55.226 fused_ordering(776) 00:14:55.226 fused_ordering(777) 00:14:55.226 fused_ordering(778) 00:14:55.226 fused_ordering(779) 00:14:55.226 fused_ordering(780) 00:14:55.226 fused_ordering(781) 00:14:55.226 fused_ordering(782) 00:14:55.226 fused_ordering(783) 00:14:55.226 fused_ordering(784) 00:14:55.226 fused_ordering(785) 00:14:55.226 fused_ordering(786) 00:14:55.226 fused_ordering(787) 00:14:55.226 fused_ordering(788) 00:14:55.226 fused_ordering(789) 00:14:55.226 fused_ordering(790) 00:14:55.226 fused_ordering(791) 00:14:55.226 fused_ordering(792) 00:14:55.226 fused_ordering(793) 00:14:55.226 fused_ordering(794) 00:14:55.226 fused_ordering(795) 00:14:55.226 fused_ordering(796) 00:14:55.226 fused_ordering(797) 00:14:55.226 fused_ordering(798) 00:14:55.226 fused_ordering(799) 00:14:55.226 fused_ordering(800) 00:14:55.226 fused_ordering(801) 00:14:55.226 fused_ordering(802) 00:14:55.226 fused_ordering(803) 00:14:55.226 fused_ordering(804) 00:14:55.226 fused_ordering(805) 00:14:55.226 fused_ordering(806) 00:14:55.226 fused_ordering(807) 00:14:55.226 fused_ordering(808) 00:14:55.226 fused_ordering(809) 00:14:55.226 fused_ordering(810) 00:14:55.226 fused_ordering(811) 00:14:55.226 fused_ordering(812) 00:14:55.226 fused_ordering(813) 00:14:55.226 fused_ordering(814) 00:14:55.226 fused_ordering(815) 00:14:55.226 fused_ordering(816) 00:14:55.226 fused_ordering(817) 00:14:55.226 fused_ordering(818) 00:14:55.226 fused_ordering(819) 00:14:55.226 fused_ordering(820) 00:14:55.822 fused_ordering(821) 00:14:55.823 fused_ordering(822) 00:14:55.823 fused_ordering(823) 00:14:55.823 fused_ordering(824) 00:14:55.823 fused_ordering(825) 00:14:55.823 fused_ordering(826) 00:14:55.823 fused_ordering(827) 00:14:55.823 fused_ordering(828) 00:14:55.823 fused_ordering(829) 00:14:55.823 fused_ordering(830) 00:14:55.823 fused_ordering(831) 00:14:55.823 fused_ordering(832) 00:14:55.823 fused_ordering(833) 00:14:55.823 fused_ordering(834) 00:14:55.823 fused_ordering(835) 00:14:55.823 fused_ordering(836) 00:14:55.823 fused_ordering(837) 00:14:55.823 fused_ordering(838) 00:14:55.823 fused_ordering(839) 00:14:55.823 fused_ordering(840) 00:14:55.823 fused_ordering(841) 00:14:55.823 fused_ordering(842) 00:14:55.823 fused_ordering(843) 00:14:55.823 fused_ordering(844) 00:14:55.823 fused_ordering(845) 00:14:55.823 fused_ordering(846) 00:14:55.823 fused_ordering(847) 00:14:55.823 fused_ordering(848) 00:14:55.823 fused_ordering(849) 00:14:55.823 fused_ordering(850) 00:14:55.823 fused_ordering(851) 00:14:55.823 fused_ordering(852) 00:14:55.823 fused_ordering(853) 00:14:55.823 fused_ordering(854) 00:14:55.823 fused_ordering(855) 00:14:55.823 fused_ordering(856) 00:14:55.823 fused_ordering(857) 00:14:55.823 fused_ordering(858) 00:14:55.823 fused_ordering(859) 00:14:55.823 fused_ordering(860) 00:14:55.823 fused_ordering(861) 00:14:55.823 fused_ordering(862) 00:14:55.823 fused_ordering(863) 00:14:55.823 fused_ordering(864) 00:14:55.823 fused_ordering(865) 00:14:55.823 fused_ordering(866) 00:14:55.823 fused_ordering(867) 00:14:55.823 fused_ordering(868) 00:14:55.823 fused_ordering(869) 00:14:55.823 fused_ordering(870) 00:14:55.823 fused_ordering(871) 00:14:55.823 fused_ordering(872) 00:14:55.823 fused_ordering(873) 00:14:55.823 fused_ordering(874) 00:14:55.823 fused_ordering(875) 00:14:55.823 fused_ordering(876) 00:14:55.823 fused_ordering(877) 00:14:55.823 fused_ordering(878) 00:14:55.823 fused_ordering(879) 00:14:55.823 fused_ordering(880) 00:14:55.823 fused_ordering(881) 00:14:55.823 fused_ordering(882) 00:14:55.823 fused_ordering(883) 00:14:55.823 fused_ordering(884) 00:14:55.823 fused_ordering(885) 00:14:55.823 fused_ordering(886) 00:14:55.823 fused_ordering(887) 00:14:55.823 fused_ordering(888) 00:14:55.823 fused_ordering(889) 00:14:55.823 fused_ordering(890) 00:14:55.823 fused_ordering(891) 00:14:55.823 fused_ordering(892) 00:14:55.823 fused_ordering(893) 00:14:55.823 fused_ordering(894) 00:14:55.823 fused_ordering(895) 00:14:55.823 fused_ordering(896) 00:14:55.823 fused_ordering(897) 00:14:55.823 fused_ordering(898) 00:14:55.823 fused_ordering(899) 00:14:55.823 fused_ordering(900) 00:14:55.823 fused_ordering(901) 00:14:55.823 fused_ordering(902) 00:14:55.823 fused_ordering(903) 00:14:55.823 fused_ordering(904) 00:14:55.823 fused_ordering(905) 00:14:55.823 fused_ordering(906) 00:14:55.823 fused_ordering(907) 00:14:55.823 fused_ordering(908) 00:14:55.823 fused_ordering(909) 00:14:55.823 fused_ordering(910) 00:14:55.823 fused_ordering(911) 00:14:55.823 fused_ordering(912) 00:14:55.823 fused_ordering(913) 00:14:55.823 fused_ordering(914) 00:14:55.823 fused_ordering(915) 00:14:55.823 fused_ordering(916) 00:14:55.823 fused_ordering(917) 00:14:55.823 fused_ordering(918) 00:14:55.823 fused_ordering(919) 00:14:55.823 fused_ordering(920) 00:14:55.823 fused_ordering(921) 00:14:55.823 fused_ordering(922) 00:14:55.823 fused_ordering(923) 00:14:55.823 fused_ordering(924) 00:14:55.823 fused_ordering(925) 00:14:55.823 fused_ordering(926) 00:14:55.823 fused_ordering(927) 00:14:55.823 fused_ordering(928) 00:14:55.823 fused_ordering(929) 00:14:55.823 fused_ordering(930) 00:14:55.823 fused_ordering(931) 00:14:55.823 fused_ordering(932) 00:14:55.823 fused_ordering(933) 00:14:55.823 fused_ordering(934) 00:14:55.823 fused_ordering(935) 00:14:55.823 fused_ordering(936) 00:14:55.823 fused_ordering(937) 00:14:55.823 fused_ordering(938) 00:14:55.823 fused_ordering(939) 00:14:55.823 fused_ordering(940) 00:14:55.823 fused_ordering(941) 00:14:55.823 fused_ordering(942) 00:14:55.823 fused_ordering(943) 00:14:55.823 fused_ordering(944) 00:14:55.823 fused_ordering(945) 00:14:55.823 fused_ordering(946) 00:14:55.823 fused_ordering(947) 00:14:55.823 fused_ordering(948) 00:14:55.823 fused_ordering(949) 00:14:55.823 fused_ordering(950) 00:14:55.823 fused_ordering(951) 00:14:55.823 fused_ordering(952) 00:14:55.823 fused_ordering(953) 00:14:55.823 fused_ordering(954) 00:14:55.823 fused_ordering(955) 00:14:55.823 fused_ordering(956) 00:14:55.823 fused_ordering(957) 00:14:55.823 fused_ordering(958) 00:14:55.823 fused_ordering(959) 00:14:55.823 fused_ordering(960) 00:14:55.823 fused_ordering(961) 00:14:55.823 fused_ordering(962) 00:14:55.823 fused_ordering(963) 00:14:55.823 fused_ordering(964) 00:14:55.823 fused_ordering(965) 00:14:55.823 fused_ordering(966) 00:14:55.823 fused_ordering(967) 00:14:55.823 fused_ordering(968) 00:14:55.823 fused_ordering(969) 00:14:55.823 fused_ordering(970) 00:14:55.823 fused_ordering(971) 00:14:55.823 fused_ordering(972) 00:14:55.823 fused_ordering(973) 00:14:55.823 fused_ordering(974) 00:14:55.823 fused_ordering(975) 00:14:55.823 fused_ordering(976) 00:14:55.823 fused_ordering(977) 00:14:55.823 fused_ordering(978) 00:14:55.823 fused_ordering(979) 00:14:55.823 fused_ordering(980) 00:14:55.823 fused_ordering(981) 00:14:55.823 fused_ordering(982) 00:14:55.823 fused_ordering(983) 00:14:55.823 fused_ordering(984) 00:14:55.823 fused_ordering(985) 00:14:55.823 fused_ordering(986) 00:14:55.823 fused_ordering(987) 00:14:55.823 fused_ordering(988) 00:14:55.823 fused_ordering(989) 00:14:55.823 fused_ordering(990) 00:14:55.823 fused_ordering(991) 00:14:55.823 fused_ordering(992) 00:14:55.823 fused_ordering(993) 00:14:55.823 fused_ordering(994) 00:14:55.823 fused_ordering(995) 00:14:55.823 fused_ordering(996) 00:14:55.823 fused_ordering(997) 00:14:55.823 fused_ordering(998) 00:14:55.823 fused_ordering(999) 00:14:55.823 fused_ordering(1000) 00:14:55.823 fused_ordering(1001) 00:14:55.823 fused_ordering(1002) 00:14:55.823 fused_ordering(1003) 00:14:55.823 fused_ordering(1004) 00:14:55.823 fused_ordering(1005) 00:14:55.823 fused_ordering(1006) 00:14:55.823 fused_ordering(1007) 00:14:55.823 fused_ordering(1008) 00:14:55.823 fused_ordering(1009) 00:14:55.823 fused_ordering(1010) 00:14:55.823 fused_ordering(1011) 00:14:55.823 fused_ordering(1012) 00:14:55.823 fused_ordering(1013) 00:14:55.823 fused_ordering(1014) 00:14:55.823 fused_ordering(1015) 00:14:55.823 fused_ordering(1016) 00:14:55.823 fused_ordering(1017) 00:14:55.823 fused_ordering(1018) 00:14:55.823 fused_ordering(1019) 00:14:55.823 fused_ordering(1020) 00:14:55.823 fused_ordering(1021) 00:14:55.823 fused_ordering(1022) 00:14:55.823 fused_ordering(1023) 00:14:55.823 05:10:57 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:14:55.823 05:10:57 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:14:55.823 05:10:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:55.823 05:10:57 -- nvmf/common.sh@116 -- # sync 00:14:55.823 05:10:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:55.823 05:10:57 -- nvmf/common.sh@119 -- # set +e 00:14:55.823 05:10:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:55.823 05:10:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:55.823 rmmod nvme_tcp 00:14:55.823 rmmod nvme_fabrics 00:14:55.823 rmmod nvme_keyring 00:14:56.082 05:10:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:56.082 05:10:57 -- nvmf/common.sh@123 -- # set -e 00:14:56.082 05:10:57 -- nvmf/common.sh@124 -- # return 0 00:14:56.082 05:10:57 -- nvmf/common.sh@477 -- # '[' -n 3263454 ']' 00:14:56.082 05:10:57 -- nvmf/common.sh@478 -- # killprocess 3263454 00:14:56.082 05:10:57 -- common/autotest_common.sh@936 -- # '[' -z 3263454 ']' 00:14:56.082 05:10:57 -- common/autotest_common.sh@940 -- # kill -0 3263454 00:14:56.082 05:10:57 -- common/autotest_common.sh@941 -- # uname 00:14:56.082 05:10:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:56.082 05:10:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3263454 00:14:56.082 05:10:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:56.082 05:10:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:56.082 05:10:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3263454' 00:14:56.082 killing process with pid 3263454 00:14:56.082 05:10:57 -- common/autotest_common.sh@955 -- # kill 3263454 00:14:56.082 05:10:57 -- common/autotest_common.sh@960 -- # wait 3263454 00:14:56.340 05:10:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:56.341 05:10:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:56.341 05:10:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:56.341 05:10:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:56.341 05:10:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:56.341 05:10:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:56.341 05:10:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:56.341 05:10:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:58.244 05:10:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:58.244 00:14:58.244 real 0m8.189s 00:14:58.244 user 0m5.977s 00:14:58.244 sys 0m3.209s 00:14:58.244 05:10:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:58.245 05:10:59 -- common/autotest_common.sh@10 -- # set +x 00:14:58.245 ************************************ 00:14:58.245 END TEST nvmf_fused_ordering 00:14:58.245 ************************************ 00:14:58.245 05:10:59 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:58.245 05:10:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:58.245 05:10:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:58.245 05:10:59 -- common/autotest_common.sh@10 -- # set +x 00:14:58.245 ************************************ 00:14:58.245 START TEST nvmf_delete_subsystem 00:14:58.245 ************************************ 00:14:58.245 05:10:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:58.245 * Looking for test storage... 00:14:58.245 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:58.245 05:11:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:58.245 05:11:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:58.245 05:11:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:58.503 05:11:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:58.503 05:11:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:58.503 05:11:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:58.503 05:11:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:58.503 05:11:00 -- scripts/common.sh@335 -- # IFS=.-: 00:14:58.503 05:11:00 -- scripts/common.sh@335 -- # read -ra ver1 00:14:58.503 05:11:00 -- scripts/common.sh@336 -- # IFS=.-: 00:14:58.503 05:11:00 -- scripts/common.sh@336 -- # read -ra ver2 00:14:58.503 05:11:00 -- scripts/common.sh@337 -- # local 'op=<' 00:14:58.503 05:11:00 -- scripts/common.sh@339 -- # ver1_l=2 00:14:58.503 05:11:00 -- scripts/common.sh@340 -- # ver2_l=1 00:14:58.503 05:11:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:58.503 05:11:00 -- scripts/common.sh@343 -- # case "$op" in 00:14:58.503 05:11:00 -- scripts/common.sh@344 -- # : 1 00:14:58.503 05:11:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:58.503 05:11:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:58.503 05:11:00 -- scripts/common.sh@364 -- # decimal 1 00:14:58.503 05:11:00 -- scripts/common.sh@352 -- # local d=1 00:14:58.503 05:11:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:58.503 05:11:00 -- scripts/common.sh@354 -- # echo 1 00:14:58.503 05:11:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:58.503 05:11:00 -- scripts/common.sh@365 -- # decimal 2 00:14:58.504 05:11:00 -- scripts/common.sh@352 -- # local d=2 00:14:58.504 05:11:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:58.504 05:11:00 -- scripts/common.sh@354 -- # echo 2 00:14:58.504 05:11:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:58.504 05:11:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:58.504 05:11:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:58.504 05:11:00 -- scripts/common.sh@367 -- # return 0 00:14:58.504 05:11:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:58.504 05:11:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:58.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.504 --rc genhtml_branch_coverage=1 00:14:58.504 --rc genhtml_function_coverage=1 00:14:58.504 --rc genhtml_legend=1 00:14:58.504 --rc geninfo_all_blocks=1 00:14:58.504 --rc geninfo_unexecuted_blocks=1 00:14:58.504 00:14:58.504 ' 00:14:58.504 05:11:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:58.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.504 --rc genhtml_branch_coverage=1 00:14:58.504 --rc genhtml_function_coverage=1 00:14:58.504 --rc genhtml_legend=1 00:14:58.504 --rc geninfo_all_blocks=1 00:14:58.504 --rc geninfo_unexecuted_blocks=1 00:14:58.504 00:14:58.504 ' 00:14:58.504 05:11:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:58.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.504 --rc genhtml_branch_coverage=1 00:14:58.504 --rc genhtml_function_coverage=1 00:14:58.504 --rc genhtml_legend=1 00:14:58.504 --rc geninfo_all_blocks=1 00:14:58.504 --rc geninfo_unexecuted_blocks=1 00:14:58.504 00:14:58.504 ' 00:14:58.504 05:11:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:58.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.504 --rc genhtml_branch_coverage=1 00:14:58.504 --rc genhtml_function_coverage=1 00:14:58.504 --rc genhtml_legend=1 00:14:58.504 --rc geninfo_all_blocks=1 00:14:58.504 --rc geninfo_unexecuted_blocks=1 00:14:58.504 00:14:58.504 ' 00:14:58.504 05:11:00 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:58.504 05:11:00 -- nvmf/common.sh@7 -- # uname -s 00:14:58.504 05:11:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:58.504 05:11:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:58.504 05:11:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:58.504 05:11:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:58.504 05:11:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:58.504 05:11:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:58.504 05:11:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:58.504 05:11:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:58.504 05:11:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:58.504 05:11:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:58.504 05:11:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:58.504 05:11:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:58.504 05:11:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:58.504 05:11:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:58.504 05:11:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:58.504 05:11:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:58.504 05:11:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:58.504 05:11:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:58.504 05:11:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:58.504 05:11:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.504 05:11:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.504 05:11:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.504 05:11:00 -- paths/export.sh@5 -- # export PATH 00:14:58.504 05:11:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.504 05:11:00 -- nvmf/common.sh@46 -- # : 0 00:14:58.504 05:11:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:58.504 05:11:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:58.504 05:11:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:58.504 05:11:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:58.504 05:11:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:58.504 05:11:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:58.504 05:11:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:58.504 05:11:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:58.504 05:11:00 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:14:58.504 05:11:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:58.504 05:11:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:58.504 05:11:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:58.504 05:11:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:58.504 05:11:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:58.504 05:11:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:58.504 05:11:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:58.504 05:11:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:58.504 05:11:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:58.504 05:11:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:58.504 05:11:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:58.504 05:11:00 -- common/autotest_common.sh@10 -- # set +x 00:15:01.039 05:11:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:01.039 05:11:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:01.039 05:11:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:01.039 05:11:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:01.039 05:11:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:01.039 05:11:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:01.039 05:11:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:01.039 05:11:02 -- nvmf/common.sh@294 -- # net_devs=() 00:15:01.039 05:11:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:01.039 05:11:02 -- nvmf/common.sh@295 -- # e810=() 00:15:01.039 05:11:02 -- nvmf/common.sh@295 -- # local -ga e810 00:15:01.039 05:11:02 -- nvmf/common.sh@296 -- # x722=() 00:15:01.039 05:11:02 -- nvmf/common.sh@296 -- # local -ga x722 00:15:01.039 05:11:02 -- nvmf/common.sh@297 -- # mlx=() 00:15:01.039 05:11:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:01.039 05:11:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:01.039 05:11:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:01.039 05:11:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:01.039 05:11:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:01.039 05:11:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:01.039 05:11:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:01.039 05:11:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:01.039 05:11:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:01.039 05:11:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:01.039 05:11:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:01.039 05:11:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:01.039 05:11:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:01.039 05:11:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:01.039 05:11:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:01.039 05:11:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:01.039 05:11:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:01.039 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:01.039 05:11:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:01.039 05:11:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:01.039 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:01.039 05:11:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:01.039 05:11:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:01.039 05:11:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:01.039 05:11:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:01.039 05:11:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:01.039 05:11:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:01.039 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:01.039 05:11:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:01.039 05:11:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:01.039 05:11:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:01.039 05:11:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:01.039 05:11:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:01.039 05:11:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:01.039 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:01.039 05:11:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:01.039 05:11:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:01.039 05:11:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:01.039 05:11:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:01.039 05:11:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:01.039 05:11:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:01.039 05:11:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:01.039 05:11:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:01.039 05:11:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:01.039 05:11:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:01.039 05:11:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:01.039 05:11:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:01.039 05:11:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:01.039 05:11:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:01.040 05:11:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:01.040 05:11:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:01.040 05:11:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:01.040 05:11:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:01.040 05:11:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:01.040 05:11:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:01.040 05:11:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:01.040 05:11:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:01.040 05:11:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:01.040 05:11:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:01.040 05:11:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:01.040 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:01.040 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.280 ms 00:15:01.040 00:15:01.040 --- 10.0.0.2 ping statistics --- 00:15:01.040 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:01.040 rtt min/avg/max/mdev = 0.280/0.280/0.280/0.000 ms 00:15:01.040 05:11:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:01.040 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:01.040 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.085 ms 00:15:01.040 00:15:01.040 --- 10.0.0.1 ping statistics --- 00:15:01.040 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:01.040 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:15:01.040 05:11:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:01.040 05:11:02 -- nvmf/common.sh@410 -- # return 0 00:15:01.040 05:11:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:01.040 05:11:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:01.040 05:11:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:01.040 05:11:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:01.040 05:11:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:01.040 05:11:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:01.040 05:11:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:01.040 05:11:02 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:01.040 05:11:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:01.040 05:11:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:01.040 05:11:02 -- common/autotest_common.sh@10 -- # set +x 00:15:01.040 05:11:02 -- nvmf/common.sh@469 -- # nvmfpid=3265947 00:15:01.040 05:11:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:01.040 05:11:02 -- nvmf/common.sh@470 -- # waitforlisten 3265947 00:15:01.040 05:11:02 -- common/autotest_common.sh@829 -- # '[' -z 3265947 ']' 00:15:01.040 05:11:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:01.040 05:11:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:01.040 05:11:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:01.040 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:01.040 05:11:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:01.040 05:11:02 -- common/autotest_common.sh@10 -- # set +x 00:15:01.040 [2024-11-26 05:11:02.425347] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:01.040 [2024-11-26 05:11:02.425428] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:01.040 EAL: No free 2048 kB hugepages reported on node 1 00:15:01.040 [2024-11-26 05:11:02.489786] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:01.040 [2024-11-26 05:11:02.579212] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:01.040 [2024-11-26 05:11:02.579369] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:01.040 [2024-11-26 05:11:02.579387] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:01.040 [2024-11-26 05:11:02.579400] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:01.040 [2024-11-26 05:11:02.579458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:01.040 [2024-11-26 05:11:02.579473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:01.974 05:11:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:01.974 05:11:03 -- common/autotest_common.sh@862 -- # return 0 00:15:01.974 05:11:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:01.974 05:11:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:01.974 05:11:03 -- common/autotest_common.sh@10 -- # set +x 00:15:01.974 05:11:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:01.974 05:11:03 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:01.974 05:11:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.974 05:11:03 -- common/autotest_common.sh@10 -- # set +x 00:15:01.974 [2024-11-26 05:11:03.427400] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:01.974 05:11:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.975 05:11:03 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:01.975 05:11:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.975 05:11:03 -- common/autotest_common.sh@10 -- # set +x 00:15:01.975 05:11:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.975 05:11:03 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:01.975 05:11:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.975 05:11:03 -- common/autotest_common.sh@10 -- # set +x 00:15:01.975 [2024-11-26 05:11:03.443666] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:01.975 05:11:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.975 05:11:03 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:01.975 05:11:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.975 05:11:03 -- common/autotest_common.sh@10 -- # set +x 00:15:01.975 NULL1 00:15:01.975 05:11:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.975 05:11:03 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:01.975 05:11:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.975 05:11:03 -- common/autotest_common.sh@10 -- # set +x 00:15:01.975 Delay0 00:15:01.975 05:11:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.975 05:11:03 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:01.975 05:11:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.975 05:11:03 -- common/autotest_common.sh@10 -- # set +x 00:15:01.975 05:11:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.975 05:11:03 -- target/delete_subsystem.sh@28 -- # perf_pid=3266056 00:15:01.975 05:11:03 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:01.975 05:11:03 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:01.975 EAL: No free 2048 kB hugepages reported on node 1 00:15:01.975 [2024-11-26 05:11:03.518334] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:03.876 05:11:05 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:03.876 05:11:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.876 05:11:05 -- common/autotest_common.sh@10 -- # set +x 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 [2024-11-26 05:11:05.769063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x217c810 is same with the state(5) to be set 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 starting I/O failed: -6 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Read completed with error (sct=0, sc=8) 00:15:04.153 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 starting I/O failed: -6 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 starting I/O failed: -6 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 starting I/O failed: -6 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 starting I/O failed: -6 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 starting I/O failed: -6 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 [2024-11-26 05:11:05.769759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f2d8c000c00 is same with the state(5) to be set 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Write completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:04.154 Read completed with error (sct=0, sc=8) 00:15:05.126 [2024-11-26 05:11:06.736210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x217da40 is same with the state(5) to be set 00:15:05.126 Write completed with error (sct=0, sc=8) 00:15:05.126 Write completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Write completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Write completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 [2024-11-26 05:11:06.768777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x217c690 is same with the state(5) to be set 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Write completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Write completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 Write completed with error (sct=0, sc=8) 00:15:05.126 Read completed with error (sct=0, sc=8) 00:15:05.126 [2024-11-26 05:11:06.768934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x217dc90 is same with the state(5) to be set 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 [2024-11-26 05:11:06.771422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f2d8c00bf20 is same with the state(5) to be set 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Write completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 Read completed with error (sct=0, sc=8) 00:15:05.127 [2024-11-26 05:11:06.771908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f2d8c00c600 is same with the state(5) to be set 00:15:05.127 [2024-11-26 05:11:06.772572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x217da40 (9): Bad file descriptor 00:15:05.127 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:05.127 05:11:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.127 05:11:06 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:05.127 05:11:06 -- target/delete_subsystem.sh@35 -- # kill -0 3266056 00:15:05.127 05:11:06 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:05.127 Initializing NVMe Controllers 00:15:05.127 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:05.127 Controller IO queue size 128, less than required. 00:15:05.127 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:05.127 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:05.127 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:05.127 Initialization complete. Launching workers. 00:15:05.127 ======================================================== 00:15:05.127 Latency(us) 00:15:05.127 Device Information : IOPS MiB/s Average min max 00:15:05.127 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 161.84 0.08 913326.64 533.09 1010927.56 00:15:05.127 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 174.25 0.09 885712.65 382.92 1011922.55 00:15:05.127 ======================================================== 00:15:05.127 Total : 336.09 0.16 899009.79 382.92 1011922.55 00:15:05.127 00:15:05.694 05:11:07 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:05.694 05:11:07 -- target/delete_subsystem.sh@35 -- # kill -0 3266056 00:15:05.694 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3266056) - No such process 00:15:05.694 05:11:07 -- target/delete_subsystem.sh@45 -- # NOT wait 3266056 00:15:05.694 05:11:07 -- common/autotest_common.sh@650 -- # local es=0 00:15:05.694 05:11:07 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 3266056 00:15:05.694 05:11:07 -- common/autotest_common.sh@638 -- # local arg=wait 00:15:05.694 05:11:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:05.694 05:11:07 -- common/autotest_common.sh@642 -- # type -t wait 00:15:05.694 05:11:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:05.694 05:11:07 -- common/autotest_common.sh@653 -- # wait 3266056 00:15:05.694 05:11:07 -- common/autotest_common.sh@653 -- # es=1 00:15:05.694 05:11:07 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:05.694 05:11:07 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:05.694 05:11:07 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:05.694 05:11:07 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:05.694 05:11:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.694 05:11:07 -- common/autotest_common.sh@10 -- # set +x 00:15:05.694 05:11:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.694 05:11:07 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:05.694 05:11:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.694 05:11:07 -- common/autotest_common.sh@10 -- # set +x 00:15:05.694 [2024-11-26 05:11:07.297844] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:05.694 05:11:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.694 05:11:07 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:05.694 05:11:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.694 05:11:07 -- common/autotest_common.sh@10 -- # set +x 00:15:05.694 05:11:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.694 05:11:07 -- target/delete_subsystem.sh@54 -- # perf_pid=3266531 00:15:05.694 05:11:07 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:05.694 05:11:07 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:05.694 05:11:07 -- target/delete_subsystem.sh@57 -- # kill -0 3266531 00:15:05.694 05:11:07 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:05.694 EAL: No free 2048 kB hugepages reported on node 1 00:15:05.694 [2024-11-26 05:11:07.360858] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:06.259 05:11:07 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:06.259 05:11:07 -- target/delete_subsystem.sh@57 -- # kill -0 3266531 00:15:06.259 05:11:07 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:06.825 05:11:08 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:06.825 05:11:08 -- target/delete_subsystem.sh@57 -- # kill -0 3266531 00:15:06.825 05:11:08 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:07.082 05:11:08 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:07.082 05:11:08 -- target/delete_subsystem.sh@57 -- # kill -0 3266531 00:15:07.082 05:11:08 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:07.647 05:11:09 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:07.647 05:11:09 -- target/delete_subsystem.sh@57 -- # kill -0 3266531 00:15:07.647 05:11:09 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:08.211 05:11:09 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:08.211 05:11:09 -- target/delete_subsystem.sh@57 -- # kill -0 3266531 00:15:08.211 05:11:09 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:08.777 05:11:10 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:08.777 05:11:10 -- target/delete_subsystem.sh@57 -- # kill -0 3266531 00:15:08.777 05:11:10 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:09.034 Initializing NVMe Controllers 00:15:09.034 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:09.034 Controller IO queue size 128, less than required. 00:15:09.034 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:09.034 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:09.034 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:09.034 Initialization complete. Launching workers. 00:15:09.034 ======================================================== 00:15:09.034 Latency(us) 00:15:09.034 Device Information : IOPS MiB/s Average min max 00:15:09.034 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003819.73 1000196.48 1012426.55 00:15:09.034 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1005235.82 1000226.34 1013223.74 00:15:09.035 ======================================================== 00:15:09.035 Total : 256.00 0.12 1004527.77 1000196.48 1013223.74 00:15:09.035 00:15:09.293 05:11:10 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:09.293 05:11:10 -- target/delete_subsystem.sh@57 -- # kill -0 3266531 00:15:09.293 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3266531) - No such process 00:15:09.293 05:11:10 -- target/delete_subsystem.sh@67 -- # wait 3266531 00:15:09.293 05:11:10 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:09.293 05:11:10 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:09.293 05:11:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:09.293 05:11:10 -- nvmf/common.sh@116 -- # sync 00:15:09.293 05:11:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:09.293 05:11:10 -- nvmf/common.sh@119 -- # set +e 00:15:09.293 05:11:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:09.293 05:11:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:09.293 rmmod nvme_tcp 00:15:09.293 rmmod nvme_fabrics 00:15:09.293 rmmod nvme_keyring 00:15:09.293 05:11:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:09.293 05:11:10 -- nvmf/common.sh@123 -- # set -e 00:15:09.293 05:11:10 -- nvmf/common.sh@124 -- # return 0 00:15:09.293 05:11:10 -- nvmf/common.sh@477 -- # '[' -n 3265947 ']' 00:15:09.293 05:11:10 -- nvmf/common.sh@478 -- # killprocess 3265947 00:15:09.293 05:11:10 -- common/autotest_common.sh@936 -- # '[' -z 3265947 ']' 00:15:09.293 05:11:10 -- common/autotest_common.sh@940 -- # kill -0 3265947 00:15:09.293 05:11:10 -- common/autotest_common.sh@941 -- # uname 00:15:09.293 05:11:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:09.293 05:11:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3265947 00:15:09.293 05:11:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:09.293 05:11:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:09.293 05:11:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3265947' 00:15:09.293 killing process with pid 3265947 00:15:09.293 05:11:10 -- common/autotest_common.sh@955 -- # kill 3265947 00:15:09.294 05:11:10 -- common/autotest_common.sh@960 -- # wait 3265947 00:15:09.553 05:11:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:09.553 05:11:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:09.553 05:11:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:09.553 05:11:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:09.553 05:11:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:09.553 05:11:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:09.553 05:11:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:09.553 05:11:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:11.458 05:11:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:11.458 00:15:11.458 real 0m13.236s 00:15:11.458 user 0m29.775s 00:15:11.458 sys 0m3.079s 00:15:11.458 05:11:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:11.458 05:11:13 -- common/autotest_common.sh@10 -- # set +x 00:15:11.458 ************************************ 00:15:11.458 END TEST nvmf_delete_subsystem 00:15:11.458 ************************************ 00:15:11.458 05:11:13 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:11.458 05:11:13 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:11.458 05:11:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:11.459 05:11:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:11.459 05:11:13 -- common/autotest_common.sh@10 -- # set +x 00:15:11.459 ************************************ 00:15:11.459 START TEST nvmf_nvme_cli 00:15:11.459 ************************************ 00:15:11.459 05:11:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:11.717 * Looking for test storage... 00:15:11.717 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:11.717 05:11:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:11.717 05:11:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:11.717 05:11:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:11.717 05:11:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:11.717 05:11:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:11.717 05:11:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:11.717 05:11:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:11.717 05:11:13 -- scripts/common.sh@335 -- # IFS=.-: 00:15:11.717 05:11:13 -- scripts/common.sh@335 -- # read -ra ver1 00:15:11.717 05:11:13 -- scripts/common.sh@336 -- # IFS=.-: 00:15:11.717 05:11:13 -- scripts/common.sh@336 -- # read -ra ver2 00:15:11.717 05:11:13 -- scripts/common.sh@337 -- # local 'op=<' 00:15:11.717 05:11:13 -- scripts/common.sh@339 -- # ver1_l=2 00:15:11.717 05:11:13 -- scripts/common.sh@340 -- # ver2_l=1 00:15:11.717 05:11:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:11.717 05:11:13 -- scripts/common.sh@343 -- # case "$op" in 00:15:11.717 05:11:13 -- scripts/common.sh@344 -- # : 1 00:15:11.717 05:11:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:11.717 05:11:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:11.717 05:11:13 -- scripts/common.sh@364 -- # decimal 1 00:15:11.717 05:11:13 -- scripts/common.sh@352 -- # local d=1 00:15:11.717 05:11:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:11.717 05:11:13 -- scripts/common.sh@354 -- # echo 1 00:15:11.717 05:11:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:11.718 05:11:13 -- scripts/common.sh@365 -- # decimal 2 00:15:11.718 05:11:13 -- scripts/common.sh@352 -- # local d=2 00:15:11.718 05:11:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:11.718 05:11:13 -- scripts/common.sh@354 -- # echo 2 00:15:11.718 05:11:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:11.718 05:11:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:11.718 05:11:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:11.718 05:11:13 -- scripts/common.sh@367 -- # return 0 00:15:11.718 05:11:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:11.718 05:11:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:11.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:11.718 --rc genhtml_branch_coverage=1 00:15:11.718 --rc genhtml_function_coverage=1 00:15:11.718 --rc genhtml_legend=1 00:15:11.718 --rc geninfo_all_blocks=1 00:15:11.718 --rc geninfo_unexecuted_blocks=1 00:15:11.718 00:15:11.718 ' 00:15:11.718 05:11:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:11.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:11.718 --rc genhtml_branch_coverage=1 00:15:11.718 --rc genhtml_function_coverage=1 00:15:11.718 --rc genhtml_legend=1 00:15:11.718 --rc geninfo_all_blocks=1 00:15:11.718 --rc geninfo_unexecuted_blocks=1 00:15:11.718 00:15:11.718 ' 00:15:11.718 05:11:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:11.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:11.718 --rc genhtml_branch_coverage=1 00:15:11.718 --rc genhtml_function_coverage=1 00:15:11.718 --rc genhtml_legend=1 00:15:11.718 --rc geninfo_all_blocks=1 00:15:11.718 --rc geninfo_unexecuted_blocks=1 00:15:11.718 00:15:11.718 ' 00:15:11.718 05:11:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:11.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:11.718 --rc genhtml_branch_coverage=1 00:15:11.718 --rc genhtml_function_coverage=1 00:15:11.718 --rc genhtml_legend=1 00:15:11.718 --rc geninfo_all_blocks=1 00:15:11.718 --rc geninfo_unexecuted_blocks=1 00:15:11.718 00:15:11.718 ' 00:15:11.718 05:11:13 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:11.718 05:11:13 -- nvmf/common.sh@7 -- # uname -s 00:15:11.718 05:11:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:11.718 05:11:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:11.718 05:11:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:11.718 05:11:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:11.718 05:11:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:11.718 05:11:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:11.718 05:11:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:11.718 05:11:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:11.718 05:11:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:11.718 05:11:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:11.718 05:11:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:11.718 05:11:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:11.718 05:11:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:11.718 05:11:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:11.718 05:11:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:11.718 05:11:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:11.718 05:11:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:11.718 05:11:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:11.718 05:11:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:11.718 05:11:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:11.718 05:11:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:11.718 05:11:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:11.718 05:11:13 -- paths/export.sh@5 -- # export PATH 00:15:11.718 05:11:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:11.718 05:11:13 -- nvmf/common.sh@46 -- # : 0 00:15:11.718 05:11:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:11.718 05:11:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:11.718 05:11:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:11.718 05:11:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:11.718 05:11:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:11.718 05:11:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:11.718 05:11:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:11.718 05:11:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:11.718 05:11:13 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:11.718 05:11:13 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:11.718 05:11:13 -- target/nvme_cli.sh@14 -- # devs=() 00:15:11.718 05:11:13 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:11.718 05:11:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:11.718 05:11:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:11.718 05:11:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:11.718 05:11:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:11.718 05:11:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:11.718 05:11:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:11.718 05:11:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:11.718 05:11:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:11.718 05:11:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:11.718 05:11:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:11.718 05:11:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:11.718 05:11:13 -- common/autotest_common.sh@10 -- # set +x 00:15:13.632 05:11:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:13.632 05:11:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:13.632 05:11:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:13.632 05:11:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:13.632 05:11:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:13.632 05:11:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:13.632 05:11:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:13.632 05:11:15 -- nvmf/common.sh@294 -- # net_devs=() 00:15:13.632 05:11:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:13.632 05:11:15 -- nvmf/common.sh@295 -- # e810=() 00:15:13.632 05:11:15 -- nvmf/common.sh@295 -- # local -ga e810 00:15:13.632 05:11:15 -- nvmf/common.sh@296 -- # x722=() 00:15:13.632 05:11:15 -- nvmf/common.sh@296 -- # local -ga x722 00:15:13.632 05:11:15 -- nvmf/common.sh@297 -- # mlx=() 00:15:13.632 05:11:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:13.632 05:11:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:13.632 05:11:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:13.632 05:11:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:13.632 05:11:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:13.632 05:11:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:13.632 05:11:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:13.632 05:11:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:13.632 05:11:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:13.632 05:11:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:13.632 05:11:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:13.632 05:11:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:13.632 05:11:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:13.632 05:11:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:13.632 05:11:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:13.632 05:11:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:13.632 05:11:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:13.632 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:13.632 05:11:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:13.632 05:11:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:13.632 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:13.632 05:11:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:13.632 05:11:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:13.632 05:11:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:13.633 05:11:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:13.633 05:11:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:13.633 05:11:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:13.633 05:11:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:13.633 05:11:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:13.633 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:13.633 05:11:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:13.633 05:11:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:13.633 05:11:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:13.633 05:11:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:13.633 05:11:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:13.633 05:11:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:13.633 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:13.633 05:11:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:13.633 05:11:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:13.633 05:11:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:13.633 05:11:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:13.633 05:11:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:13.633 05:11:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:13.633 05:11:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:13.633 05:11:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:13.633 05:11:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:13.633 05:11:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:13.633 05:11:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:13.633 05:11:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:13.633 05:11:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:13.633 05:11:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:13.633 05:11:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:13.633 05:11:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:13.633 05:11:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:13.633 05:11:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:13.633 05:11:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:13.891 05:11:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:13.891 05:11:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:13.891 05:11:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:13.891 05:11:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:13.891 05:11:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:13.891 05:11:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:13.891 05:11:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:13.891 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:13.891 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.255 ms 00:15:13.891 00:15:13.891 --- 10.0.0.2 ping statistics --- 00:15:13.891 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:13.891 rtt min/avg/max/mdev = 0.255/0.255/0.255/0.000 ms 00:15:13.891 05:11:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:13.891 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:13.891 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:15:13.891 00:15:13.891 --- 10.0.0.1 ping statistics --- 00:15:13.891 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:13.891 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:15:13.891 05:11:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:13.891 05:11:15 -- nvmf/common.sh@410 -- # return 0 00:15:13.892 05:11:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:13.892 05:11:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:13.892 05:11:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:13.892 05:11:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:13.892 05:11:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:13.892 05:11:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:13.892 05:11:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:13.892 05:11:15 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:13.892 05:11:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:13.892 05:11:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:13.892 05:11:15 -- common/autotest_common.sh@10 -- # set +x 00:15:13.892 05:11:15 -- nvmf/common.sh@469 -- # nvmfpid=3268899 00:15:13.892 05:11:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:13.892 05:11:15 -- nvmf/common.sh@470 -- # waitforlisten 3268899 00:15:13.892 05:11:15 -- common/autotest_common.sh@829 -- # '[' -z 3268899 ']' 00:15:13.892 05:11:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:13.892 05:11:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:13.892 05:11:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:13.892 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:13.892 05:11:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:13.892 05:11:15 -- common/autotest_common.sh@10 -- # set +x 00:15:13.892 [2024-11-26 05:11:15.560595] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:13.892 [2024-11-26 05:11:15.560676] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:13.892 EAL: No free 2048 kB hugepages reported on node 1 00:15:13.892 [2024-11-26 05:11:15.624713] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:14.150 [2024-11-26 05:11:15.709769] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:14.150 [2024-11-26 05:11:15.709934] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:14.150 [2024-11-26 05:11:15.709953] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:14.150 [2024-11-26 05:11:15.709965] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:14.150 [2024-11-26 05:11:15.710033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:14.150 [2024-11-26 05:11:15.710124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:14.150 [2024-11-26 05:11:15.710155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:14.150 [2024-11-26 05:11:15.710157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:15.083 05:11:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:15.083 05:11:16 -- common/autotest_common.sh@862 -- # return 0 00:15:15.083 05:11:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:15.083 05:11:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:15.083 05:11:16 -- common/autotest_common.sh@10 -- # set +x 00:15:15.083 05:11:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:15.083 05:11:16 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:15.083 05:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.083 05:11:16 -- common/autotest_common.sh@10 -- # set +x 00:15:15.083 [2024-11-26 05:11:16.643089] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:15.083 05:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.083 05:11:16 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:15.083 05:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.083 05:11:16 -- common/autotest_common.sh@10 -- # set +x 00:15:15.083 Malloc0 00:15:15.083 05:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.083 05:11:16 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:15.083 05:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.083 05:11:16 -- common/autotest_common.sh@10 -- # set +x 00:15:15.083 Malloc1 00:15:15.083 05:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.083 05:11:16 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:15.083 05:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.083 05:11:16 -- common/autotest_common.sh@10 -- # set +x 00:15:15.083 05:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.083 05:11:16 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:15.083 05:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.083 05:11:16 -- common/autotest_common.sh@10 -- # set +x 00:15:15.083 05:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.083 05:11:16 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:15.083 05:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.083 05:11:16 -- common/autotest_common.sh@10 -- # set +x 00:15:15.083 05:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.083 05:11:16 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:15.083 05:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.083 05:11:16 -- common/autotest_common.sh@10 -- # set +x 00:15:15.083 [2024-11-26 05:11:16.729564] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:15.083 05:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.083 05:11:16 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:15.083 05:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.083 05:11:16 -- common/autotest_common.sh@10 -- # set +x 00:15:15.083 05:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.083 05:11:16 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:15.341 00:15:15.341 Discovery Log Number of Records 2, Generation counter 2 00:15:15.341 =====Discovery Log Entry 0====== 00:15:15.341 trtype: tcp 00:15:15.341 adrfam: ipv4 00:15:15.341 subtype: current discovery subsystem 00:15:15.341 treq: not required 00:15:15.341 portid: 0 00:15:15.341 trsvcid: 4420 00:15:15.341 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:15.341 traddr: 10.0.0.2 00:15:15.341 eflags: explicit discovery connections, duplicate discovery information 00:15:15.341 sectype: none 00:15:15.341 =====Discovery Log Entry 1====== 00:15:15.341 trtype: tcp 00:15:15.341 adrfam: ipv4 00:15:15.341 subtype: nvme subsystem 00:15:15.341 treq: not required 00:15:15.341 portid: 0 00:15:15.341 trsvcid: 4420 00:15:15.341 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:15.341 traddr: 10.0.0.2 00:15:15.341 eflags: none 00:15:15.341 sectype: none 00:15:15.341 05:11:16 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:15.341 05:11:16 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:15.341 05:11:16 -- nvmf/common.sh@510 -- # local dev _ 00:15:15.341 05:11:16 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:15.341 05:11:16 -- nvmf/common.sh@509 -- # nvme list 00:15:15.341 05:11:16 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:15.342 05:11:16 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:15.342 05:11:16 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:15.342 05:11:16 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:15.342 05:11:16 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:15.342 05:11:16 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:15.907 05:11:17 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:15.907 05:11:17 -- common/autotest_common.sh@1187 -- # local i=0 00:15:15.907 05:11:17 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:15.907 05:11:17 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:15.907 05:11:17 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:15.907 05:11:17 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:17.803 05:11:19 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:17.803 05:11:19 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:17.803 05:11:19 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:17.803 05:11:19 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:17.803 05:11:19 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:17.803 05:11:19 -- common/autotest_common.sh@1197 -- # return 0 00:15:17.803 05:11:19 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:17.803 05:11:19 -- nvmf/common.sh@510 -- # local dev _ 00:15:17.803 05:11:19 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:17.803 05:11:19 -- nvmf/common.sh@509 -- # nvme list 00:15:17.803 05:11:19 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:17.803 05:11:19 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:17.803 05:11:19 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:17.803 05:11:19 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:17.803 05:11:19 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:17.803 05:11:19 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:17.803 05:11:19 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:17.803 05:11:19 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:17.803 05:11:19 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:17.803 05:11:19 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:17.803 05:11:19 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:17.803 /dev/nvme0n2 ]] 00:15:17.803 05:11:19 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:17.803 05:11:19 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:17.804 05:11:19 -- nvmf/common.sh@510 -- # local dev _ 00:15:17.804 05:11:19 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:17.804 05:11:19 -- nvmf/common.sh@509 -- # nvme list 00:15:17.804 05:11:19 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:17.804 05:11:19 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:17.804 05:11:19 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:17.804 05:11:19 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:17.804 05:11:19 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:17.804 05:11:19 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:17.804 05:11:19 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:17.804 05:11:19 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:17.804 05:11:19 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:17.804 05:11:19 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:17.804 05:11:19 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:17.804 05:11:19 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:18.062 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:18.062 05:11:19 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:18.062 05:11:19 -- common/autotest_common.sh@1208 -- # local i=0 00:15:18.062 05:11:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:18.062 05:11:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:18.062 05:11:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:18.062 05:11:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:18.062 05:11:19 -- common/autotest_common.sh@1220 -- # return 0 00:15:18.062 05:11:19 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:18.062 05:11:19 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:18.062 05:11:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.062 05:11:19 -- common/autotest_common.sh@10 -- # set +x 00:15:18.062 05:11:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.062 05:11:19 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:18.062 05:11:19 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:18.062 05:11:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:18.062 05:11:19 -- nvmf/common.sh@116 -- # sync 00:15:18.062 05:11:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:18.062 05:11:19 -- nvmf/common.sh@119 -- # set +e 00:15:18.062 05:11:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:18.062 05:11:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:18.062 rmmod nvme_tcp 00:15:18.062 rmmod nvme_fabrics 00:15:18.062 rmmod nvme_keyring 00:15:18.062 05:11:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:18.062 05:11:19 -- nvmf/common.sh@123 -- # set -e 00:15:18.062 05:11:19 -- nvmf/common.sh@124 -- # return 0 00:15:18.062 05:11:19 -- nvmf/common.sh@477 -- # '[' -n 3268899 ']' 00:15:18.062 05:11:19 -- nvmf/common.sh@478 -- # killprocess 3268899 00:15:18.063 05:11:19 -- common/autotest_common.sh@936 -- # '[' -z 3268899 ']' 00:15:18.063 05:11:19 -- common/autotest_common.sh@940 -- # kill -0 3268899 00:15:18.063 05:11:19 -- common/autotest_common.sh@941 -- # uname 00:15:18.063 05:11:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:18.063 05:11:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3268899 00:15:18.063 05:11:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:18.063 05:11:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:18.063 05:11:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3268899' 00:15:18.063 killing process with pid 3268899 00:15:18.063 05:11:19 -- common/autotest_common.sh@955 -- # kill 3268899 00:15:18.063 05:11:19 -- common/autotest_common.sh@960 -- # wait 3268899 00:15:18.322 05:11:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:18.322 05:11:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:18.322 05:11:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:18.322 05:11:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:18.322 05:11:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:18.322 05:11:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:18.322 05:11:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:18.322 05:11:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:20.859 05:11:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:20.859 00:15:20.859 real 0m8.832s 00:15:20.859 user 0m17.953s 00:15:20.859 sys 0m2.205s 00:15:20.859 05:11:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:20.859 05:11:22 -- common/autotest_common.sh@10 -- # set +x 00:15:20.859 ************************************ 00:15:20.859 END TEST nvmf_nvme_cli 00:15:20.859 ************************************ 00:15:20.859 05:11:22 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:20.859 05:11:22 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:20.859 05:11:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:20.859 05:11:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:20.859 05:11:22 -- common/autotest_common.sh@10 -- # set +x 00:15:20.859 ************************************ 00:15:20.859 START TEST nvmf_vfio_user 00:15:20.859 ************************************ 00:15:20.859 05:11:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:20.859 * Looking for test storage... 00:15:20.859 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:20.859 05:11:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:20.859 05:11:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:20.859 05:11:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:20.859 05:11:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:20.859 05:11:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:20.859 05:11:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:20.859 05:11:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:20.859 05:11:22 -- scripts/common.sh@335 -- # IFS=.-: 00:15:20.859 05:11:22 -- scripts/common.sh@335 -- # read -ra ver1 00:15:20.859 05:11:22 -- scripts/common.sh@336 -- # IFS=.-: 00:15:20.859 05:11:22 -- scripts/common.sh@336 -- # read -ra ver2 00:15:20.859 05:11:22 -- scripts/common.sh@337 -- # local 'op=<' 00:15:20.859 05:11:22 -- scripts/common.sh@339 -- # ver1_l=2 00:15:20.859 05:11:22 -- scripts/common.sh@340 -- # ver2_l=1 00:15:20.859 05:11:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:20.859 05:11:22 -- scripts/common.sh@343 -- # case "$op" in 00:15:20.859 05:11:22 -- scripts/common.sh@344 -- # : 1 00:15:20.859 05:11:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:20.859 05:11:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:20.859 05:11:22 -- scripts/common.sh@364 -- # decimal 1 00:15:20.859 05:11:22 -- scripts/common.sh@352 -- # local d=1 00:15:20.859 05:11:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:20.859 05:11:22 -- scripts/common.sh@354 -- # echo 1 00:15:20.859 05:11:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:20.859 05:11:22 -- scripts/common.sh@365 -- # decimal 2 00:15:20.859 05:11:22 -- scripts/common.sh@352 -- # local d=2 00:15:20.859 05:11:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:20.859 05:11:22 -- scripts/common.sh@354 -- # echo 2 00:15:20.859 05:11:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:20.859 05:11:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:20.859 05:11:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:20.859 05:11:22 -- scripts/common.sh@367 -- # return 0 00:15:20.859 05:11:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:20.859 05:11:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:20.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:20.859 --rc genhtml_branch_coverage=1 00:15:20.859 --rc genhtml_function_coverage=1 00:15:20.859 --rc genhtml_legend=1 00:15:20.859 --rc geninfo_all_blocks=1 00:15:20.859 --rc geninfo_unexecuted_blocks=1 00:15:20.859 00:15:20.859 ' 00:15:20.859 05:11:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:20.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:20.859 --rc genhtml_branch_coverage=1 00:15:20.859 --rc genhtml_function_coverage=1 00:15:20.859 --rc genhtml_legend=1 00:15:20.859 --rc geninfo_all_blocks=1 00:15:20.859 --rc geninfo_unexecuted_blocks=1 00:15:20.859 00:15:20.859 ' 00:15:20.859 05:11:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:20.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:20.859 --rc genhtml_branch_coverage=1 00:15:20.859 --rc genhtml_function_coverage=1 00:15:20.859 --rc genhtml_legend=1 00:15:20.859 --rc geninfo_all_blocks=1 00:15:20.859 --rc geninfo_unexecuted_blocks=1 00:15:20.859 00:15:20.859 ' 00:15:20.859 05:11:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:20.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:20.859 --rc genhtml_branch_coverage=1 00:15:20.859 --rc genhtml_function_coverage=1 00:15:20.859 --rc genhtml_legend=1 00:15:20.859 --rc geninfo_all_blocks=1 00:15:20.859 --rc geninfo_unexecuted_blocks=1 00:15:20.859 00:15:20.859 ' 00:15:20.859 05:11:22 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:20.859 05:11:22 -- nvmf/common.sh@7 -- # uname -s 00:15:20.859 05:11:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:20.859 05:11:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:20.859 05:11:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:20.859 05:11:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:20.859 05:11:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:20.859 05:11:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:20.859 05:11:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:20.859 05:11:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:20.859 05:11:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:20.859 05:11:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:20.859 05:11:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:20.859 05:11:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:20.859 05:11:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:20.859 05:11:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:20.859 05:11:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:20.859 05:11:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:20.859 05:11:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:20.859 05:11:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:20.860 05:11:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:20.860 05:11:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.860 05:11:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.860 05:11:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.860 05:11:22 -- paths/export.sh@5 -- # export PATH 00:15:20.860 05:11:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.860 05:11:22 -- nvmf/common.sh@46 -- # : 0 00:15:20.860 05:11:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:20.860 05:11:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:20.860 05:11:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:20.860 05:11:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:20.860 05:11:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:20.860 05:11:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:20.860 05:11:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:20.860 05:11:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=3269857 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 3269857' 00:15:20.860 Process pid: 3269857 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:20.860 05:11:22 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 3269857 00:15:20.860 05:11:22 -- common/autotest_common.sh@829 -- # '[' -z 3269857 ']' 00:15:20.860 05:11:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:20.860 05:11:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:20.860 05:11:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:20.860 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:20.860 05:11:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:20.860 05:11:22 -- common/autotest_common.sh@10 -- # set +x 00:15:20.860 [2024-11-26 05:11:22.290581] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:20.860 [2024-11-26 05:11:22.290683] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:20.860 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.860 [2024-11-26 05:11:22.350691] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:20.860 [2024-11-26 05:11:22.435486] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:20.860 [2024-11-26 05:11:22.435660] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:20.860 [2024-11-26 05:11:22.435676] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:20.860 [2024-11-26 05:11:22.435695] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:20.860 [2024-11-26 05:11:22.435829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:20.860 [2024-11-26 05:11:22.435896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:20.860 [2024-11-26 05:11:22.435961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:20.860 [2024-11-26 05:11:22.435964] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:21.795 05:11:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:21.795 05:11:23 -- common/autotest_common.sh@862 -- # return 0 00:15:21.795 05:11:23 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:22.730 05:11:24 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:22.988 05:11:24 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:22.988 05:11:24 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:22.988 05:11:24 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:22.988 05:11:24 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:22.988 05:11:24 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:23.247 Malloc1 00:15:23.247 05:11:24 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:23.505 05:11:25 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:23.763 05:11:25 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:24.020 05:11:25 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:24.020 05:11:25 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:24.020 05:11:25 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:24.279 Malloc2 00:15:24.279 05:11:25 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:24.537 05:11:26 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:24.794 05:11:26 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:25.054 05:11:26 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:25.054 05:11:26 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:25.054 05:11:26 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:25.054 05:11:26 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:25.054 05:11:26 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:25.054 05:11:26 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:25.054 [2024-11-26 05:11:26.721017] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:25.054 [2024-11-26 05:11:26.721068] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3270422 ] 00:15:25.054 EAL: No free 2048 kB hugepages reported on node 1 00:15:25.054 [2024-11-26 05:11:26.752518] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:25.054 [2024-11-26 05:11:26.756954] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:25.054 [2024-11-26 05:11:26.757015] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f5c32cd3000 00:15:25.054 [2024-11-26 05:11:26.757948] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:25.054 [2024-11-26 05:11:26.758941] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:25.054 [2024-11-26 05:11:26.759957] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:25.054 [2024-11-26 05:11:26.760952] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:25.054 [2024-11-26 05:11:26.761953] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:25.054 [2024-11-26 05:11:26.762964] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:25.054 [2024-11-26 05:11:26.763966] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:25.054 [2024-11-26 05:11:26.764969] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:25.054 [2024-11-26 05:11:26.765996] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:25.054 [2024-11-26 05:11:26.766017] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f5c319cb000 00:15:25.054 [2024-11-26 05:11:26.767150] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:25.054 [2024-11-26 05:11:26.782315] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:25.054 [2024-11-26 05:11:26.782347] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:25.054 [2024-11-26 05:11:26.787121] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:25.054 [2024-11-26 05:11:26.787172] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:25.054 [2024-11-26 05:11:26.787263] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:25.054 [2024-11-26 05:11:26.787297] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:25.054 [2024-11-26 05:11:26.787308] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:25.054 [2024-11-26 05:11:26.788117] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:25.054 [2024-11-26 05:11:26.788137] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:25.054 [2024-11-26 05:11:26.788149] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:25.054 [2024-11-26 05:11:26.789118] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:25.054 [2024-11-26 05:11:26.789136] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:25.054 [2024-11-26 05:11:26.789149] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:25.054 [2024-11-26 05:11:26.790121] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:25.054 [2024-11-26 05:11:26.790144] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:25.054 [2024-11-26 05:11:26.791131] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:25.054 [2024-11-26 05:11:26.791151] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:25.054 [2024-11-26 05:11:26.791160] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:25.054 [2024-11-26 05:11:26.791170] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:25.054 [2024-11-26 05:11:26.791280] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:25.055 [2024-11-26 05:11:26.791288] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:25.055 [2024-11-26 05:11:26.791296] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:25.055 [2024-11-26 05:11:26.792698] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:25.055 [2024-11-26 05:11:26.793141] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:25.055 [2024-11-26 05:11:26.794151] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:25.055 [2024-11-26 05:11:26.795190] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:25.055 [2024-11-26 05:11:26.796162] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:25.055 [2024-11-26 05:11:26.796179] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:25.055 [2024-11-26 05:11:26.796188] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796211] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:25.055 [2024-11-26 05:11:26.796229] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796252] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:25.055 [2024-11-26 05:11:26.796261] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:25.055 [2024-11-26 05:11:26.796282] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:25.055 [2024-11-26 05:11:26.796335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:25.055 [2024-11-26 05:11:26.796352] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:25.055 [2024-11-26 05:11:26.796360] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:25.055 [2024-11-26 05:11:26.796366] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:25.055 [2024-11-26 05:11:26.796374] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:25.055 [2024-11-26 05:11:26.796385] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:25.055 [2024-11-26 05:11:26.796393] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:25.055 [2024-11-26 05:11:26.796401] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796418] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796433] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:25.055 [2024-11-26 05:11:26.796450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:25.055 [2024-11-26 05:11:26.796470] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:25.055 [2024-11-26 05:11:26.796483] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:25.055 [2024-11-26 05:11:26.796494] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:25.055 [2024-11-26 05:11:26.796505] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:25.055 [2024-11-26 05:11:26.796513] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796527] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796541] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:25.055 [2024-11-26 05:11:26.796552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:25.055 [2024-11-26 05:11:26.796563] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:25.055 [2024-11-26 05:11:26.796570] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796581] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796594] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796607] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:25.055 [2024-11-26 05:11:26.796618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:25.055 [2024-11-26 05:11:26.796701] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796718] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796732] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:25.055 [2024-11-26 05:11:26.796740] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:25.055 [2024-11-26 05:11:26.796750] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:25.055 [2024-11-26 05:11:26.796769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:25.055 [2024-11-26 05:11:26.796793] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:25.055 [2024-11-26 05:11:26.796809] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796825] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796836] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:25.055 [2024-11-26 05:11:26.796844] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:25.055 [2024-11-26 05:11:26.796854] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:25.055 [2024-11-26 05:11:26.796878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:25.055 [2024-11-26 05:11:26.796901] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796917] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796929] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:25.055 [2024-11-26 05:11:26.796937] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:25.055 [2024-11-26 05:11:26.796947] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:25.055 [2024-11-26 05:11:26.796958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:25.055 [2024-11-26 05:11:26.796972] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.796999] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.797014] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.797024] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:25.055 [2024-11-26 05:11:26.797033] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:25.056 [2024-11-26 05:11:26.797055] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:25.056 [2024-11-26 05:11:26.797063] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:25.056 [2024-11-26 05:11:26.797071] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:25.056 [2024-11-26 05:11:26.797098] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:25.056 [2024-11-26 05:11:26.797116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:25.056 [2024-11-26 05:11:26.797134] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:25.056 [2024-11-26 05:11:26.797149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:25.056 [2024-11-26 05:11:26.797165] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:25.056 [2024-11-26 05:11:26.797179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:25.056 [2024-11-26 05:11:26.797194] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:25.056 [2024-11-26 05:11:26.797205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:25.056 [2024-11-26 05:11:26.797222] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:25.056 [2024-11-26 05:11:26.797231] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:25.056 [2024-11-26 05:11:26.797237] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:25.056 [2024-11-26 05:11:26.797242] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:25.056 [2024-11-26 05:11:26.797251] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:25.056 [2024-11-26 05:11:26.797262] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:25.056 [2024-11-26 05:11:26.797269] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:25.056 [2024-11-26 05:11:26.797278] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:25.056 [2024-11-26 05:11:26.797288] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:25.056 [2024-11-26 05:11:26.797295] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:25.056 [2024-11-26 05:11:26.797304] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:25.056 [2024-11-26 05:11:26.797315] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:25.056 [2024-11-26 05:11:26.797322] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:25.056 [2024-11-26 05:11:26.797331] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:25.056 [2024-11-26 05:11:26.797342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:25.056 [2024-11-26 05:11:26.797362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:25.056 [2024-11-26 05:11:26.797377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:25.056 [2024-11-26 05:11:26.797388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:25.056 ===================================================== 00:15:25.056 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:25.056 ===================================================== 00:15:25.056 Controller Capabilities/Features 00:15:25.056 ================================ 00:15:25.056 Vendor ID: 4e58 00:15:25.056 Subsystem Vendor ID: 4e58 00:15:25.056 Serial Number: SPDK1 00:15:25.056 Model Number: SPDK bdev Controller 00:15:25.056 Firmware Version: 24.01.1 00:15:25.056 Recommended Arb Burst: 6 00:15:25.056 IEEE OUI Identifier: 8d 6b 50 00:15:25.056 Multi-path I/O 00:15:25.056 May have multiple subsystem ports: Yes 00:15:25.056 May have multiple controllers: Yes 00:15:25.056 Associated with SR-IOV VF: No 00:15:25.056 Max Data Transfer Size: 131072 00:15:25.056 Max Number of Namespaces: 32 00:15:25.056 Max Number of I/O Queues: 127 00:15:25.056 NVMe Specification Version (VS): 1.3 00:15:25.056 NVMe Specification Version (Identify): 1.3 00:15:25.056 Maximum Queue Entries: 256 00:15:25.056 Contiguous Queues Required: Yes 00:15:25.056 Arbitration Mechanisms Supported 00:15:25.056 Weighted Round Robin: Not Supported 00:15:25.056 Vendor Specific: Not Supported 00:15:25.056 Reset Timeout: 15000 ms 00:15:25.056 Doorbell Stride: 4 bytes 00:15:25.056 NVM Subsystem Reset: Not Supported 00:15:25.056 Command Sets Supported 00:15:25.056 NVM Command Set: Supported 00:15:25.056 Boot Partition: Not Supported 00:15:25.056 Memory Page Size Minimum: 4096 bytes 00:15:25.056 Memory Page Size Maximum: 4096 bytes 00:15:25.056 Persistent Memory Region: Not Supported 00:15:25.056 Optional Asynchronous Events Supported 00:15:25.056 Namespace Attribute Notices: Supported 00:15:25.056 Firmware Activation Notices: Not Supported 00:15:25.056 ANA Change Notices: Not Supported 00:15:25.056 PLE Aggregate Log Change Notices: Not Supported 00:15:25.056 LBA Status Info Alert Notices: Not Supported 00:15:25.056 EGE Aggregate Log Change Notices: Not Supported 00:15:25.056 Normal NVM Subsystem Shutdown event: Not Supported 00:15:25.056 Zone Descriptor Change Notices: Not Supported 00:15:25.056 Discovery Log Change Notices: Not Supported 00:15:25.056 Controller Attributes 00:15:25.056 128-bit Host Identifier: Supported 00:15:25.056 Non-Operational Permissive Mode: Not Supported 00:15:25.056 NVM Sets: Not Supported 00:15:25.056 Read Recovery Levels: Not Supported 00:15:25.056 Endurance Groups: Not Supported 00:15:25.056 Predictable Latency Mode: Not Supported 00:15:25.056 Traffic Based Keep ALive: Not Supported 00:15:25.056 Namespace Granularity: Not Supported 00:15:25.056 SQ Associations: Not Supported 00:15:25.056 UUID List: Not Supported 00:15:25.056 Multi-Domain Subsystem: Not Supported 00:15:25.056 Fixed Capacity Management: Not Supported 00:15:25.056 Variable Capacity Management: Not Supported 00:15:25.056 Delete Endurance Group: Not Supported 00:15:25.056 Delete NVM Set: Not Supported 00:15:25.056 Extended LBA Formats Supported: Not Supported 00:15:25.056 Flexible Data Placement Supported: Not Supported 00:15:25.056 00:15:25.056 Controller Memory Buffer Support 00:15:25.056 ================================ 00:15:25.056 Supported: No 00:15:25.056 00:15:25.056 Persistent Memory Region Support 00:15:25.056 ================================ 00:15:25.056 Supported: No 00:15:25.056 00:15:25.056 Admin Command Set Attributes 00:15:25.056 ============================ 00:15:25.056 Security Send/Receive: Not Supported 00:15:25.056 Format NVM: Not Supported 00:15:25.056 Firmware Activate/Download: Not Supported 00:15:25.056 Namespace Management: Not Supported 00:15:25.056 Device Self-Test: Not Supported 00:15:25.056 Directives: Not Supported 00:15:25.056 NVMe-MI: Not Supported 00:15:25.056 Virtualization Management: Not Supported 00:15:25.056 Doorbell Buffer Config: Not Supported 00:15:25.056 Get LBA Status Capability: Not Supported 00:15:25.056 Command & Feature Lockdown Capability: Not Supported 00:15:25.056 Abort Command Limit: 4 00:15:25.056 Async Event Request Limit: 4 00:15:25.056 Number of Firmware Slots: N/A 00:15:25.056 Firmware Slot 1 Read-Only: N/A 00:15:25.056 Firmware Activation Without Reset: N/A 00:15:25.056 Multiple Update Detection Support: N/A 00:15:25.057 Firmware Update Granularity: No Information Provided 00:15:25.057 Per-Namespace SMART Log: No 00:15:25.057 Asymmetric Namespace Access Log Page: Not Supported 00:15:25.057 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:25.057 Command Effects Log Page: Supported 00:15:25.057 Get Log Page Extended Data: Supported 00:15:25.057 Telemetry Log Pages: Not Supported 00:15:25.057 Persistent Event Log Pages: Not Supported 00:15:25.057 Supported Log Pages Log Page: May Support 00:15:25.057 Commands Supported & Effects Log Page: Not Supported 00:15:25.057 Feature Identifiers & Effects Log Page:May Support 00:15:25.057 NVMe-MI Commands & Effects Log Page: May Support 00:15:25.057 Data Area 4 for Telemetry Log: Not Supported 00:15:25.057 Error Log Page Entries Supported: 128 00:15:25.057 Keep Alive: Supported 00:15:25.057 Keep Alive Granularity: 10000 ms 00:15:25.057 00:15:25.057 NVM Command Set Attributes 00:15:25.057 ========================== 00:15:25.057 Submission Queue Entry Size 00:15:25.057 Max: 64 00:15:25.057 Min: 64 00:15:25.057 Completion Queue Entry Size 00:15:25.057 Max: 16 00:15:25.057 Min: 16 00:15:25.057 Number of Namespaces: 32 00:15:25.057 Compare Command: Supported 00:15:25.057 Write Uncorrectable Command: Not Supported 00:15:25.057 Dataset Management Command: Supported 00:15:25.057 Write Zeroes Command: Supported 00:15:25.057 Set Features Save Field: Not Supported 00:15:25.057 Reservations: Not Supported 00:15:25.057 Timestamp: Not Supported 00:15:25.057 Copy: Supported 00:15:25.057 Volatile Write Cache: Present 00:15:25.057 Atomic Write Unit (Normal): 1 00:15:25.057 Atomic Write Unit (PFail): 1 00:15:25.057 Atomic Compare & Write Unit: 1 00:15:25.057 Fused Compare & Write: Supported 00:15:25.057 Scatter-Gather List 00:15:25.057 SGL Command Set: Supported (Dword aligned) 00:15:25.057 SGL Keyed: Not Supported 00:15:25.057 SGL Bit Bucket Descriptor: Not Supported 00:15:25.057 SGL Metadata Pointer: Not Supported 00:15:25.057 Oversized SGL: Not Supported 00:15:25.057 SGL Metadata Address: Not Supported 00:15:25.057 SGL Offset: Not Supported 00:15:25.057 Transport SGL Data Block: Not Supported 00:15:25.057 Replay Protected Memory Block: Not Supported 00:15:25.057 00:15:25.057 Firmware Slot Information 00:15:25.057 ========================= 00:15:25.057 Active slot: 1 00:15:25.057 Slot 1 Firmware Revision: 24.01.1 00:15:25.057 00:15:25.057 00:15:25.057 Commands Supported and Effects 00:15:25.057 ============================== 00:15:25.057 Admin Commands 00:15:25.057 -------------- 00:15:25.057 Get Log Page (02h): Supported 00:15:25.057 Identify (06h): Supported 00:15:25.057 Abort (08h): Supported 00:15:25.057 Set Features (09h): Supported 00:15:25.057 Get Features (0Ah): Supported 00:15:25.057 Asynchronous Event Request (0Ch): Supported 00:15:25.057 Keep Alive (18h): Supported 00:15:25.057 I/O Commands 00:15:25.057 ------------ 00:15:25.057 Flush (00h): Supported LBA-Change 00:15:25.057 Write (01h): Supported LBA-Change 00:15:25.057 Read (02h): Supported 00:15:25.057 Compare (05h): Supported 00:15:25.057 Write Zeroes (08h): Supported LBA-Change 00:15:25.057 Dataset Management (09h): Supported LBA-Change 00:15:25.057 Copy (19h): Supported LBA-Change 00:15:25.057 Unknown (79h): Supported LBA-Change 00:15:25.057 Unknown (7Ah): Supported 00:15:25.057 00:15:25.057 Error Log 00:15:25.057 ========= 00:15:25.057 00:15:25.057 Arbitration 00:15:25.057 =========== 00:15:25.057 Arbitration Burst: 1 00:15:25.057 00:15:25.057 Power Management 00:15:25.057 ================ 00:15:25.057 Number of Power States: 1 00:15:25.057 Current Power State: Power State #0 00:15:25.057 Power State #0: 00:15:25.057 Max Power: 0.00 W 00:15:25.057 Non-Operational State: Operational 00:15:25.057 Entry Latency: Not Reported 00:15:25.057 Exit Latency: Not Reported 00:15:25.057 Relative Read Throughput: 0 00:15:25.057 Relative Read Latency: 0 00:15:25.057 Relative Write Throughput: 0 00:15:25.057 Relative Write Latency: 0 00:15:25.057 Idle Power: Not Reported 00:15:25.057 Active Power: Not Reported 00:15:25.057 Non-Operational Permissive Mode: Not Supported 00:15:25.057 00:15:25.057 Health Information 00:15:25.057 ================== 00:15:25.057 Critical Warnings: 00:15:25.057 Available Spare Space: OK 00:15:25.057 Temperature: OK 00:15:25.057 Device Reliability: OK 00:15:25.057 Read Only: No 00:15:25.057 Volatile Memory Backup: OK 00:15:25.057 Current Temperature: 0 Kelvin[2024-11-26 05:11:26.797514] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:25.057 [2024-11-26 05:11:26.797530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:25.057 [2024-11-26 05:11:26.797568] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:25.057 [2024-11-26 05:11:26.797585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:25.057 [2024-11-26 05:11:26.797596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:25.057 [2024-11-26 05:11:26.797610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:25.057 [2024-11-26 05:11:26.797620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:25.057 [2024-11-26 05:11:26.800697] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:25.057 [2024-11-26 05:11:26.800720] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:25.057 [2024-11-26 05:11:26.801234] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:25.057 [2024-11-26 05:11:26.801247] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:25.057 [2024-11-26 05:11:26.802194] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:25.057 [2024-11-26 05:11:26.802216] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:25.057 [2024-11-26 05:11:26.802270] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:25.057 [2024-11-26 05:11:26.804238] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:25.316 (-273 Celsius) 00:15:25.316 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:25.316 Available Spare: 0% 00:15:25.316 Available Spare Threshold: 0% 00:15:25.316 Life Percentage Used: 0% 00:15:25.316 Data Units Read: 0 00:15:25.316 Data Units Written: 0 00:15:25.316 Host Read Commands: 0 00:15:25.316 Host Write Commands: 0 00:15:25.316 Controller Busy Time: 0 minutes 00:15:25.316 Power Cycles: 0 00:15:25.316 Power On Hours: 0 hours 00:15:25.316 Unsafe Shutdowns: 0 00:15:25.316 Unrecoverable Media Errors: 0 00:15:25.316 Lifetime Error Log Entries: 0 00:15:25.316 Warning Temperature Time: 0 minutes 00:15:25.316 Critical Temperature Time: 0 minutes 00:15:25.316 00:15:25.316 Number of Queues 00:15:25.316 ================ 00:15:25.316 Number of I/O Submission Queues: 127 00:15:25.316 Number of I/O Completion Queues: 127 00:15:25.316 00:15:25.316 Active Namespaces 00:15:25.316 ================= 00:15:25.316 Namespace ID:1 00:15:25.316 Error Recovery Timeout: Unlimited 00:15:25.316 Command Set Identifier: NVM (00h) 00:15:25.316 Deallocate: Supported 00:15:25.316 Deallocated/Unwritten Error: Not Supported 00:15:25.316 Deallocated Read Value: Unknown 00:15:25.316 Deallocate in Write Zeroes: Not Supported 00:15:25.316 Deallocated Guard Field: 0xFFFF 00:15:25.316 Flush: Supported 00:15:25.316 Reservation: Supported 00:15:25.316 Namespace Sharing Capabilities: Multiple Controllers 00:15:25.316 Size (in LBAs): 131072 (0GiB) 00:15:25.316 Capacity (in LBAs): 131072 (0GiB) 00:15:25.316 Utilization (in LBAs): 131072 (0GiB) 00:15:25.316 NGUID: B43FE023719B434185A3FA5C7AF529B7 00:15:25.316 UUID: b43fe023-719b-4341-85a3-fa5c7af529b7 00:15:25.316 Thin Provisioning: Not Supported 00:15:25.316 Per-NS Atomic Units: Yes 00:15:25.316 Atomic Boundary Size (Normal): 0 00:15:25.316 Atomic Boundary Size (PFail): 0 00:15:25.316 Atomic Boundary Offset: 0 00:15:25.316 Maximum Single Source Range Length: 65535 00:15:25.316 Maximum Copy Length: 65535 00:15:25.316 Maximum Source Range Count: 1 00:15:25.316 NGUID/EUI64 Never Reused: No 00:15:25.316 Namespace Write Protected: No 00:15:25.316 Number of LBA Formats: 1 00:15:25.316 Current LBA Format: LBA Format #00 00:15:25.316 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:25.316 00:15:25.316 05:11:26 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:25.316 EAL: No free 2048 kB hugepages reported on node 1 00:15:30.582 Initializing NVMe Controllers 00:15:30.582 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:30.582 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:30.582 Initialization complete. Launching workers. 00:15:30.582 ======================================================== 00:15:30.582 Latency(us) 00:15:30.582 Device Information : IOPS MiB/s Average min max 00:15:30.582 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 36511.24 142.62 3505.77 1158.79 7441.85 00:15:30.582 ======================================================== 00:15:30.582 Total : 36511.24 142.62 3505.77 1158.79 7441.85 00:15:30.582 00:15:30.582 05:11:32 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:30.582 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.846 Initializing NVMe Controllers 00:15:35.846 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:35.847 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:35.847 Initialization complete. Launching workers. 00:15:35.847 ======================================================== 00:15:35.847 Latency(us) 00:15:35.847 Device Information : IOPS MiB/s Average min max 00:15:35.847 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16038.17 62.65 7986.21 5968.96 11968.60 00:15:35.847 ======================================================== 00:15:35.847 Total : 16038.17 62.65 7986.21 5968.96 11968.60 00:15:35.847 00:15:35.847 05:11:37 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:35.847 EAL: No free 2048 kB hugepages reported on node 1 00:15:41.112 Initializing NVMe Controllers 00:15:41.112 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:41.112 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:41.112 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:41.112 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:41.112 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:41.112 Initialization complete. Launching workers. 00:15:41.112 Starting thread on core 2 00:15:41.112 Starting thread on core 3 00:15:41.112 Starting thread on core 1 00:15:41.112 05:11:42 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:41.112 EAL: No free 2048 kB hugepages reported on node 1 00:15:45.300 Initializing NVMe Controllers 00:15:45.300 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:45.300 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:45.300 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:45.300 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:45.300 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:45.300 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:45.300 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:45.300 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:45.300 Initialization complete. Launching workers. 00:15:45.300 Starting thread on core 1 with urgent priority queue 00:15:45.300 Starting thread on core 2 with urgent priority queue 00:15:45.300 Starting thread on core 3 with urgent priority queue 00:15:45.300 Starting thread on core 0 with urgent priority queue 00:15:45.300 SPDK bdev Controller (SPDK1 ) core 0: 5030.67 IO/s 19.88 secs/100000 ios 00:15:45.300 SPDK bdev Controller (SPDK1 ) core 1: 5054.00 IO/s 19.79 secs/100000 ios 00:15:45.300 SPDK bdev Controller (SPDK1 ) core 2: 5043.33 IO/s 19.83 secs/100000 ios 00:15:45.300 SPDK bdev Controller (SPDK1 ) core 3: 4741.00 IO/s 21.09 secs/100000 ios 00:15:45.300 ======================================================== 00:15:45.300 00:15:45.300 05:11:46 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:45.300 EAL: No free 2048 kB hugepages reported on node 1 00:15:45.300 Initializing NVMe Controllers 00:15:45.300 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:45.300 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:45.300 Namespace ID: 1 size: 0GB 00:15:45.300 Initialization complete. 00:15:45.300 INFO: using host memory buffer for IO 00:15:45.300 Hello world! 00:15:45.300 05:11:46 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:45.300 EAL: No free 2048 kB hugepages reported on node 1 00:15:46.710 Initializing NVMe Controllers 00:15:46.710 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:46.710 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:46.710 Initialization complete. Launching workers. 00:15:46.710 submit (in ns) avg, min, max = 7181.2, 3451.1, 7991938.9 00:15:46.710 complete (in ns) avg, min, max = 26915.6, 2031.1, 8005908.9 00:15:46.710 00:15:46.710 Submit histogram 00:15:46.710 ================ 00:15:46.710 Range in us Cumulative Count 00:15:46.710 3.437 - 3.461: 0.0223% ( 3) 00:15:46.710 3.461 - 3.484: 0.5065% ( 65) 00:15:46.710 3.484 - 3.508: 1.9367% ( 192) 00:15:46.710 3.508 - 3.532: 5.7356% ( 510) 00:15:46.710 3.532 - 3.556: 12.0298% ( 845) 00:15:46.710 3.556 - 3.579: 20.5885% ( 1149) 00:15:46.710 3.579 - 3.603: 29.5047% ( 1197) 00:15:46.710 3.603 - 3.627: 38.6816% ( 1232) 00:15:46.710 3.627 - 3.650: 46.0261% ( 986) 00:15:46.710 3.650 - 3.674: 51.3371% ( 713) 00:15:46.710 3.674 - 3.698: 55.8585% ( 607) 00:15:46.710 3.698 - 3.721: 60.7449% ( 656) 00:15:46.710 3.721 - 3.745: 64.4171% ( 493) 00:15:46.710 3.745 - 3.769: 68.2011% ( 508) 00:15:46.710 3.769 - 3.793: 71.6499% ( 463) 00:15:46.710 3.793 - 3.816: 75.6276% ( 534) 00:15:46.710 3.816 - 3.840: 79.8883% ( 572) 00:15:46.710 3.840 - 3.864: 83.3743% ( 468) 00:15:46.710 3.864 - 3.887: 85.6611% ( 307) 00:15:46.710 3.887 - 3.911: 87.5084% ( 248) 00:15:46.710 3.911 - 3.935: 89.3110% ( 242) 00:15:46.710 3.935 - 3.959: 90.8007% ( 200) 00:15:46.710 3.959 - 3.982: 91.9777% ( 158) 00:15:46.710 3.982 - 4.006: 92.9758% ( 134) 00:15:46.710 4.006 - 4.030: 93.7952% ( 110) 00:15:46.710 4.030 - 4.053: 94.6145% ( 110) 00:15:46.710 4.053 - 4.077: 95.2179% ( 81) 00:15:46.710 4.077 - 4.101: 95.6499% ( 58) 00:15:46.710 4.101 - 4.124: 95.8957% ( 33) 00:15:46.710 4.124 - 4.148: 96.0596% ( 22) 00:15:46.710 4.148 - 4.172: 96.2309% ( 23) 00:15:46.710 4.172 - 4.196: 96.4022% ( 23) 00:15:46.710 4.196 - 4.219: 96.5214% ( 16) 00:15:46.710 4.219 - 4.243: 96.6257% ( 14) 00:15:46.710 4.243 - 4.267: 96.7598% ( 18) 00:15:46.710 4.267 - 4.290: 96.8864% ( 17) 00:15:46.710 4.290 - 4.314: 96.9460% ( 8) 00:15:46.710 4.314 - 4.338: 96.9907% ( 6) 00:15:46.710 4.338 - 4.361: 97.0503% ( 8) 00:15:46.710 4.361 - 4.385: 97.0875% ( 5) 00:15:46.710 4.385 - 4.409: 97.0950% ( 1) 00:15:46.710 4.433 - 4.456: 97.1322% ( 5) 00:15:46.710 4.480 - 4.504: 97.1397% ( 1) 00:15:46.710 4.527 - 4.551: 97.1471% ( 1) 00:15:46.710 4.599 - 4.622: 97.1546% ( 1) 00:15:46.710 4.622 - 4.646: 97.1844% ( 4) 00:15:46.710 4.646 - 4.670: 97.1993% ( 2) 00:15:46.710 4.670 - 4.693: 97.2439% ( 6) 00:15:46.710 4.693 - 4.717: 97.2886% ( 6) 00:15:46.710 4.717 - 4.741: 97.3184% ( 4) 00:15:46.710 4.741 - 4.764: 97.3706% ( 7) 00:15:46.710 4.764 - 4.788: 97.4078% ( 5) 00:15:46.710 4.788 - 4.812: 97.4600% ( 7) 00:15:46.710 4.812 - 4.836: 97.5121% ( 7) 00:15:46.710 4.836 - 4.859: 97.5345% ( 3) 00:15:46.710 4.859 - 4.883: 97.5642% ( 4) 00:15:46.710 4.883 - 4.907: 97.5866% ( 3) 00:15:46.710 4.907 - 4.930: 97.6313% ( 6) 00:15:46.710 4.930 - 4.954: 97.6611% ( 4) 00:15:46.710 4.954 - 4.978: 97.6983% ( 5) 00:15:46.710 4.978 - 5.001: 97.7356% ( 5) 00:15:46.710 5.001 - 5.025: 97.7505% ( 2) 00:15:46.710 5.025 - 5.049: 97.7803% ( 4) 00:15:46.710 5.049 - 5.073: 97.7952% ( 2) 00:15:46.710 5.073 - 5.096: 97.8250% ( 4) 00:15:46.710 5.096 - 5.120: 97.8399% ( 2) 00:15:46.710 5.120 - 5.144: 97.8473% ( 1) 00:15:46.710 5.144 - 5.167: 97.8696% ( 3) 00:15:46.710 5.167 - 5.191: 97.8771% ( 1) 00:15:46.710 5.191 - 5.215: 97.8994% ( 3) 00:15:46.710 5.239 - 5.262: 97.9143% ( 2) 00:15:46.710 5.333 - 5.357: 97.9292% ( 2) 00:15:46.710 5.357 - 5.381: 97.9367% ( 1) 00:15:46.710 5.381 - 5.404: 97.9441% ( 1) 00:15:46.710 5.523 - 5.547: 97.9516% ( 1) 00:15:46.710 5.570 - 5.594: 97.9590% ( 1) 00:15:46.710 5.618 - 5.641: 97.9665% ( 1) 00:15:46.710 5.641 - 5.665: 97.9739% ( 1) 00:15:46.710 5.665 - 5.689: 97.9814% ( 1) 00:15:46.710 5.689 - 5.713: 97.9963% ( 2) 00:15:46.710 5.784 - 5.807: 98.0037% ( 1) 00:15:46.710 5.807 - 5.831: 98.0112% ( 1) 00:15:46.710 5.926 - 5.950: 98.0186% ( 1) 00:15:46.710 6.068 - 6.116: 98.0261% ( 1) 00:15:46.710 6.163 - 6.210: 98.0335% ( 1) 00:15:46.710 6.305 - 6.353: 98.0410% ( 1) 00:15:46.710 6.447 - 6.495: 98.0559% ( 2) 00:15:46.710 6.542 - 6.590: 98.0633% ( 1) 00:15:46.710 6.637 - 6.684: 98.0708% ( 1) 00:15:46.710 6.684 - 6.732: 98.0931% ( 3) 00:15:46.710 6.779 - 6.827: 98.1006% ( 1) 00:15:46.710 6.827 - 6.874: 98.1080% ( 1) 00:15:46.710 6.874 - 6.921: 98.1229% ( 2) 00:15:46.710 6.921 - 6.969: 98.1304% ( 1) 00:15:46.710 7.016 - 7.064: 98.1378% ( 1) 00:15:46.710 7.064 - 7.111: 98.1453% ( 1) 00:15:46.710 7.159 - 7.206: 98.1601% ( 2) 00:15:46.710 7.253 - 7.301: 98.1750% ( 2) 00:15:46.710 7.301 - 7.348: 98.1825% ( 1) 00:15:46.710 7.396 - 7.443: 98.1899% ( 1) 00:15:46.710 7.443 - 7.490: 98.2197% ( 4) 00:15:46.710 7.490 - 7.538: 98.2346% ( 2) 00:15:46.710 7.585 - 7.633: 98.2421% ( 1) 00:15:46.710 7.633 - 7.680: 98.2644% ( 3) 00:15:46.710 7.680 - 7.727: 98.2793% ( 2) 00:15:46.710 7.727 - 7.775: 98.2868% ( 1) 00:15:46.710 7.775 - 7.822: 98.2942% ( 1) 00:15:46.710 7.870 - 7.917: 98.3091% ( 2) 00:15:46.710 7.917 - 7.964: 98.3166% ( 1) 00:15:46.710 7.964 - 8.012: 98.3464% ( 4) 00:15:46.710 8.012 - 8.059: 98.3538% ( 1) 00:15:46.710 8.059 - 8.107: 98.3762% ( 3) 00:15:46.710 8.201 - 8.249: 98.3836% ( 1) 00:15:46.710 8.249 - 8.296: 98.3985% ( 2) 00:15:46.710 8.296 - 8.344: 98.4060% ( 1) 00:15:46.710 8.391 - 8.439: 98.4134% ( 1) 00:15:46.710 8.439 - 8.486: 98.4358% ( 3) 00:15:46.710 8.486 - 8.533: 98.4432% ( 1) 00:15:46.710 8.628 - 8.676: 98.4507% ( 1) 00:15:46.710 8.676 - 8.723: 98.4804% ( 4) 00:15:46.710 8.770 - 8.818: 98.4953% ( 2) 00:15:46.710 8.818 - 8.865: 98.5028% ( 1) 00:15:46.710 8.913 - 8.960: 98.5326% ( 4) 00:15:46.710 9.007 - 9.055: 98.5400% ( 1) 00:15:46.710 9.055 - 9.102: 98.5475% ( 1) 00:15:46.711 9.102 - 9.150: 98.5624% ( 2) 00:15:46.711 9.150 - 9.197: 98.5698% ( 1) 00:15:46.711 9.244 - 9.292: 98.5773% ( 1) 00:15:46.711 9.529 - 9.576: 98.5847% ( 1) 00:15:46.711 9.576 - 9.624: 98.5996% ( 2) 00:15:46.711 9.671 - 9.719: 98.6071% ( 1) 00:15:46.711 9.908 - 9.956: 98.6145% ( 1) 00:15:46.711 9.956 - 10.003: 98.6294% ( 2) 00:15:46.711 10.193 - 10.240: 98.6369% ( 1) 00:15:46.711 10.335 - 10.382: 98.6443% ( 1) 00:15:46.711 10.382 - 10.430: 98.6518% ( 1) 00:15:46.711 10.430 - 10.477: 98.6667% ( 2) 00:15:46.711 10.524 - 10.572: 98.6816% ( 2) 00:15:46.711 10.572 - 10.619: 98.6890% ( 1) 00:15:46.711 10.619 - 10.667: 98.7039% ( 2) 00:15:46.711 10.667 - 10.714: 98.7114% ( 1) 00:15:46.711 10.856 - 10.904: 98.7188% ( 1) 00:15:46.711 11.046 - 11.093: 98.7337% ( 2) 00:15:46.711 11.141 - 11.188: 98.7412% ( 1) 00:15:46.711 11.188 - 11.236: 98.7486% ( 1) 00:15:46.711 11.330 - 11.378: 98.7709% ( 3) 00:15:46.711 11.378 - 11.425: 98.7784% ( 1) 00:15:46.711 11.473 - 11.520: 98.7933% ( 2) 00:15:46.711 11.520 - 11.567: 98.8007% ( 1) 00:15:46.711 11.567 - 11.615: 98.8082% ( 1) 00:15:46.711 11.662 - 11.710: 98.8231% ( 2) 00:15:46.711 11.757 - 11.804: 98.8305% ( 1) 00:15:46.711 12.136 - 12.231: 98.8454% ( 2) 00:15:46.711 12.231 - 12.326: 98.8678% ( 3) 00:15:46.711 12.326 - 12.421: 98.8752% ( 1) 00:15:46.711 12.421 - 12.516: 98.8827% ( 1) 00:15:46.711 12.705 - 12.800: 98.8901% ( 1) 00:15:46.711 12.895 - 12.990: 98.8976% ( 1) 00:15:46.711 12.990 - 13.084: 98.9125% ( 2) 00:15:46.711 13.084 - 13.179: 98.9199% ( 1) 00:15:46.711 13.179 - 13.274: 98.9274% ( 1) 00:15:46.711 13.369 - 13.464: 98.9423% ( 2) 00:15:46.711 13.843 - 13.938: 98.9497% ( 1) 00:15:46.711 13.938 - 14.033: 98.9721% ( 3) 00:15:46.711 14.033 - 14.127: 98.9795% ( 1) 00:15:46.711 14.127 - 14.222: 98.9944% ( 2) 00:15:46.711 14.222 - 14.317: 99.0019% ( 1) 00:15:46.711 14.317 - 14.412: 99.0242% ( 3) 00:15:46.711 14.412 - 14.507: 99.0317% ( 1) 00:15:46.711 14.507 - 14.601: 99.0391% ( 1) 00:15:46.711 14.601 - 14.696: 99.0466% ( 1) 00:15:46.711 14.696 - 14.791: 99.0540% ( 1) 00:15:46.711 14.791 - 14.886: 99.0689% ( 2) 00:15:46.711 14.981 - 15.076: 99.0764% ( 1) 00:15:46.711 16.877 - 16.972: 99.0912% ( 2) 00:15:46.711 16.972 - 17.067: 99.0987% ( 1) 00:15:46.711 17.067 - 17.161: 99.1061% ( 1) 00:15:46.711 17.161 - 17.256: 99.1210% ( 2) 00:15:46.711 17.351 - 17.446: 99.1285% ( 1) 00:15:46.711 17.446 - 17.541: 99.1508% ( 3) 00:15:46.711 17.541 - 17.636: 99.1955% ( 6) 00:15:46.711 17.636 - 17.730: 99.2775% ( 11) 00:15:46.711 17.730 - 17.825: 99.3073% ( 4) 00:15:46.711 17.825 - 17.920: 99.3371% ( 4) 00:15:46.711 17.920 - 18.015: 99.3892% ( 7) 00:15:46.711 18.015 - 18.110: 99.4488% ( 8) 00:15:46.711 18.110 - 18.204: 99.4860% ( 5) 00:15:46.711 18.204 - 18.299: 99.5754% ( 12) 00:15:46.711 18.299 - 18.394: 99.6425% ( 9) 00:15:46.711 18.394 - 18.489: 99.6797% ( 5) 00:15:46.711 18.489 - 18.584: 99.7095% ( 4) 00:15:46.711 18.584 - 18.679: 99.7616% ( 7) 00:15:46.711 18.679 - 18.773: 99.7914% ( 4) 00:15:46.711 18.773 - 18.868: 99.8063% ( 2) 00:15:46.711 18.868 - 18.963: 99.8138% ( 1) 00:15:46.711 18.963 - 19.058: 99.8287% ( 2) 00:15:46.711 19.058 - 19.153: 99.8436% ( 2) 00:15:46.711 19.153 - 19.247: 99.8659% ( 3) 00:15:46.711 19.247 - 19.342: 99.8734% ( 1) 00:15:46.711 19.342 - 19.437: 99.8808% ( 1) 00:15:46.711 19.437 - 19.532: 99.8883% ( 1) 00:15:46.711 19.627 - 19.721: 99.8957% ( 1) 00:15:46.711 19.721 - 19.816: 99.9032% ( 1) 00:15:46.711 23.514 - 23.609: 99.9106% ( 1) 00:15:46.711 23.799 - 23.893: 99.9181% ( 1) 00:15:46.711 28.065 - 28.255: 99.9255% ( 1) 00:15:46.711 3980.705 - 4004.978: 99.9777% ( 7) 00:15:46.711 4004.978 - 4029.250: 99.9926% ( 2) 00:15:46.711 7961.410 - 8009.956: 100.0000% ( 1) 00:15:46.711 00:15:46.711 Complete histogram 00:15:46.711 ================== 00:15:46.711 Range in us Cumulative Count 00:15:46.711 2.027 - 2.039: 1.4153% ( 190) 00:15:46.711 2.039 - 2.050: 12.8119% ( 1530) 00:15:46.711 2.050 - 2.062: 15.1732% ( 317) 00:15:46.711 2.062 - 2.074: 27.4711% ( 1651) 00:15:46.711 2.074 - 2.086: 53.1397% ( 3446) 00:15:46.711 2.086 - 2.098: 56.6927% ( 477) 00:15:46.711 2.098 - 2.110: 59.8510% ( 424) 00:15:46.711 2.110 - 2.121: 63.5903% ( 502) 00:15:46.711 2.121 - 2.133: 64.4469% ( 115) 00:15:46.711 2.133 - 2.145: 73.2812% ( 1186) 00:15:46.711 2.145 - 2.157: 81.2737% ( 1073) 00:15:46.711 2.157 - 2.169: 82.6667% ( 187) 00:15:46.711 2.169 - 2.181: 84.5289% ( 250) 00:15:46.711 2.181 - 2.193: 85.9590% ( 192) 00:15:46.711 2.193 - 2.204: 86.8082% ( 114) 00:15:46.711 2.204 - 2.216: 90.7486% ( 529) 00:15:46.711 2.216 - 2.228: 93.8026% ( 410) 00:15:46.711 2.228 - 2.240: 94.3166% ( 69) 00:15:46.711 2.240 - 2.252: 94.8901% ( 77) 00:15:46.711 2.252 - 2.264: 95.1285% ( 32) 00:15:46.711 2.264 - 2.276: 95.3520% ( 30) 00:15:46.711 2.276 - 2.287: 95.8212% ( 63) 00:15:46.711 2.287 - 2.299: 95.9479% ( 17) 00:15:46.711 2.299 - 2.311: 96.0074% ( 8) 00:15:46.711 2.311 - 2.323: 96.1937% ( 25) 00:15:46.711 2.323 - 2.335: 96.4246% ( 31) 00:15:46.711 2.335 - 2.347: 96.6182% ( 26) 00:15:46.711 2.347 - 2.359: 97.0056% ( 52) 00:15:46.711 2.359 - 2.370: 97.2291% ( 30) 00:15:46.711 2.370 - 2.382: 97.4451% ( 29) 00:15:46.711 2.382 - 2.394: 97.6834% ( 32) 00:15:46.711 2.394 - 2.406: 97.8696% ( 25) 00:15:46.711 2.406 - 2.418: 98.0559% ( 25) 00:15:46.711 2.418 - 2.430: 98.1974% ( 19) 00:15:46.711 2.430 - 2.441: 98.3017% ( 14) 00:15:46.711 2.441 - 2.453: 98.3762% ( 10) 00:15:46.711 2.453 - 2.465: 98.4283% ( 7) 00:15:46.711 2.465 - 2.477: 98.4655% ( 5) 00:15:46.711 2.477 - 2.489: 98.4730% ( 1) 00:15:46.711 2.489 - 2.501: 98.5028% ( 4) 00:15:46.711 2.501 - 2.513: 98.5102% ( 1) 00:15:46.711 2.513 - 2.524: 98.5251% ( 2) 00:15:46.711 2.572 - 2.584: 98.5400% ( 2) 00:15:46.711 2.596 - 2.607: 98.5475% ( 1) 00:15:46.711 2.667 - 2.679: 98.5549% ( 1) 00:15:46.711 2.679 - 2.690: 98.5624% ( 1) 00:15:46.711 2.690 - 2.702: 98.5698% ( 1) 00:15:46.711 2.738 - 2.750: 98.5847% ( 2) 00:15:46.711 2.809 - 2.821: 98.5922% ( 1) 00:15:46.711 3.271 - 3.295: 98.6071% ( 2) 00:15:46.711 3.295 - 3.319: 98.6443% ( 5) 00:15:46.711 3.319 - 3.342: 98.6518% ( 1) 00:15:46.711 3.461 - 3.484: 98.6592% ( 1) 00:15:46.711 3.484 - 3.508: 98.6741% ( 2) 00:15:46.711 3.532 - 3.556: 98.6890% ( 2) 00:15:46.711 3.556 - 3.579: 98.6965% ( 1) 00:15:46.711 3.579 - 3.603: 98.7039% ( 1) 00:15:46.711 3.650 - 3.674: 98.7114% ( 1) 00:15:46.711 3.745 - 3.769: 98.7263% ( 2) 00:15:46.711 3.793 - 3.816: 98.7412% ( 2) 00:15:46.711 3.816 - 3.840: 98.7561% ( 2) 00:15:46.711 3.911 - 3.935: 98.7635% ( 1) 00:15:46.712 4.243 - 4.267: 98.7709% ( 1) 00:15:46.712 5.001 - 5.025: 98.7784% ( 1) 00:15:46.712 5.120 - 5.144: 98.7858% ( 1) 00:15:46.712 5.167 - 5.191: 98.7933% ( 1) 00:15:46.712 5.215 - 5.239: 98.8007% ( 1) 00:15:46.712 5.357 - 5.381: 98.8082% ( 1) 00:15:46.712 5.618 - 5.641: 98.8156% ( 1) 00:15:46.712 5.807 - 5.831: 98.8231% ( 1) 00:15:46.712 5.831 - 5.855: 98.8305% ( 1) 00:15:46.712 5.926 - 5.950: 98.8380% ( 1) 00:15:46.712 6.021 - 6.044: 98.8454% ( 1) 00:15:46.712 6.044 - 6.068: 98.8529% ( 1) 00:15:46.712 6.258 - 6.305: 98.8603% ( 1) 00:15:46.712 6.353 - 6.400: 98.8678% ( 1) 00:15:46.712 6.400 - 6.447: 98.8901% ( 3) 00:15:46.712 6.447 - 6.495: 98.8976% ( 1) 00:15:46.712 6.495 - 6.542: 98.9050% ( 1) 00:15:46.712 6.542 - 6.590: 98.9125% ( 1) 00:15:46.712 8.581 - 8.628: 98.9199% ( 1) 00:15:46.712 13.464 - 13.559: 98.9274% ( 1) 00:15:46.712 15.360 - 15.455: 98.9348% ( 1) 00:15:46.712 15.550 - 15.644: 98.9497% ( 2) 00:15:46.712 15.644 - 15.739: 98.9572% ( 1) 00:15:46.712 15.739 - 15.834: 98.9721% ( 2) 00:15:46.712 15.834 - 15.929: 99.0093% ( 5) 00:15:46.712 16.024 - 16.119: 99.0466% ( 5) 00:15:46.712 16.119 - 16.213: 99.0615% ( 2) 00:15:46.712 16.213 - 16.308: 99.1061% ( 6) 00:15:46.712 16.308 - 16.403: 99.1285% ( 3) 00:15:46.712 16.403 - 16.498: 99.1732% ( 6) 00:15:46.712 16.498 - 16.593: 99.2104% ( 5) 00:15:46.712 16.593 - 16.687: 99.2551% ( 6) 00:15:46.712 16.687 - 16.782: 99.2924% ( 5) 00:15:46.712 16.782 - 16.877: 99.3147% ( 3) 00:15:46.712 16.877 - 16.972: 99.3222% ( 1) 00:15:46.712 16.972 - 17.067: 99.3296% ( 1) 00:15:46.712 17.161 - 17.256: 99.3669% ( 5) 00:15:46.712 17.351 - 17.446: 99.3743% ( 1) 00:15:46.712 17.446 - 17.541: 99.3818% ( 1) 00:15:46.712 17.636 - 17.730: 99.3892% ( 1) 00:15:46.712 17.730 - 17.825: 99.3966% ( 1) 00:15:46.712 18.015 - 18.110: 99.4041% ( 1) 00:15:46.712 18.394 - 18.489: 99.4115% ( 1) 00:15:46.712 3980.705 - 4004.978: 99.8883% ( 64) 00:15:46.712 4004.978 - 4029.250: 99.9702% ( 11) 00:15:46.712 7961.410 - 8009.956: 100.0000% ( 4) 00:15:46.712 00:15:46.712 05:11:48 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:46.712 05:11:48 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:46.712 05:11:48 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:46.712 05:11:48 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:46.712 05:11:48 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:46.999 [2024-11-26 05:11:48.510485] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:46.999 [ 00:15:46.999 { 00:15:46.999 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:46.999 "subtype": "Discovery", 00:15:46.999 "listen_addresses": [], 00:15:46.999 "allow_any_host": true, 00:15:46.999 "hosts": [] 00:15:46.999 }, 00:15:46.999 { 00:15:46.999 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:46.999 "subtype": "NVMe", 00:15:46.999 "listen_addresses": [ 00:15:46.999 { 00:15:46.999 "transport": "VFIOUSER", 00:15:46.999 "trtype": "VFIOUSER", 00:15:46.999 "adrfam": "IPv4", 00:15:46.999 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:46.999 "trsvcid": "0" 00:15:46.999 } 00:15:46.999 ], 00:15:46.999 "allow_any_host": true, 00:15:46.999 "hosts": [], 00:15:46.999 "serial_number": "SPDK1", 00:15:46.999 "model_number": "SPDK bdev Controller", 00:15:46.999 "max_namespaces": 32, 00:15:46.999 "min_cntlid": 1, 00:15:46.999 "max_cntlid": 65519, 00:15:46.999 "namespaces": [ 00:15:46.999 { 00:15:46.999 "nsid": 1, 00:15:46.999 "bdev_name": "Malloc1", 00:15:46.999 "name": "Malloc1", 00:15:46.999 "nguid": "B43FE023719B434185A3FA5C7AF529B7", 00:15:46.999 "uuid": "b43fe023-719b-4341-85a3-fa5c7af529b7" 00:15:46.999 } 00:15:46.999 ] 00:15:46.999 }, 00:15:46.999 { 00:15:46.999 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:46.999 "subtype": "NVMe", 00:15:46.999 "listen_addresses": [ 00:15:46.999 { 00:15:46.999 "transport": "VFIOUSER", 00:15:46.999 "trtype": "VFIOUSER", 00:15:46.999 "adrfam": "IPv4", 00:15:46.999 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:46.999 "trsvcid": "0" 00:15:46.999 } 00:15:46.999 ], 00:15:46.999 "allow_any_host": true, 00:15:46.999 "hosts": [], 00:15:46.999 "serial_number": "SPDK2", 00:15:46.999 "model_number": "SPDK bdev Controller", 00:15:46.999 "max_namespaces": 32, 00:15:46.999 "min_cntlid": 1, 00:15:46.999 "max_cntlid": 65519, 00:15:46.999 "namespaces": [ 00:15:46.999 { 00:15:46.999 "nsid": 1, 00:15:46.999 "bdev_name": "Malloc2", 00:15:46.999 "name": "Malloc2", 00:15:46.999 "nguid": "2A3772393AE74ED8B44595F92082652E", 00:15:46.999 "uuid": "2a377239-3ae7-4ed8-b445-95f92082652e" 00:15:46.999 } 00:15:46.999 ] 00:15:46.999 } 00:15:46.999 ] 00:15:46.999 05:11:48 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:46.999 05:11:48 -- target/nvmf_vfio_user.sh@34 -- # aerpid=3273029 00:15:46.999 05:11:48 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:46.999 05:11:48 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:46.999 05:11:48 -- common/autotest_common.sh@1254 -- # local i=0 00:15:46.999 05:11:48 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:46.999 05:11:48 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:46.999 05:11:48 -- common/autotest_common.sh@1265 -- # return 0 00:15:46.999 05:11:48 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:46.999 05:11:48 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:46.999 EAL: No free 2048 kB hugepages reported on node 1 00:15:47.257 Malloc3 00:15:47.257 05:11:48 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:47.515 05:11:49 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:47.515 Asynchronous Event Request test 00:15:47.515 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:47.515 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:47.515 Registering asynchronous event callbacks... 00:15:47.515 Starting namespace attribute notice tests for all controllers... 00:15:47.515 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:47.515 aer_cb - Changed Namespace 00:15:47.515 Cleaning up... 00:15:47.774 [ 00:15:47.774 { 00:15:47.774 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:47.774 "subtype": "Discovery", 00:15:47.774 "listen_addresses": [], 00:15:47.774 "allow_any_host": true, 00:15:47.774 "hosts": [] 00:15:47.774 }, 00:15:47.774 { 00:15:47.774 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:47.774 "subtype": "NVMe", 00:15:47.774 "listen_addresses": [ 00:15:47.774 { 00:15:47.774 "transport": "VFIOUSER", 00:15:47.774 "trtype": "VFIOUSER", 00:15:47.774 "adrfam": "IPv4", 00:15:47.774 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:47.774 "trsvcid": "0" 00:15:47.774 } 00:15:47.774 ], 00:15:47.774 "allow_any_host": true, 00:15:47.774 "hosts": [], 00:15:47.774 "serial_number": "SPDK1", 00:15:47.774 "model_number": "SPDK bdev Controller", 00:15:47.774 "max_namespaces": 32, 00:15:47.774 "min_cntlid": 1, 00:15:47.774 "max_cntlid": 65519, 00:15:47.774 "namespaces": [ 00:15:47.774 { 00:15:47.774 "nsid": 1, 00:15:47.774 "bdev_name": "Malloc1", 00:15:47.774 "name": "Malloc1", 00:15:47.774 "nguid": "B43FE023719B434185A3FA5C7AF529B7", 00:15:47.774 "uuid": "b43fe023-719b-4341-85a3-fa5c7af529b7" 00:15:47.774 }, 00:15:47.774 { 00:15:47.774 "nsid": 2, 00:15:47.774 "bdev_name": "Malloc3", 00:15:47.774 "name": "Malloc3", 00:15:47.774 "nguid": "AA416BD340E84771AAF75315F600464A", 00:15:47.774 "uuid": "aa416bd3-40e8-4771-aaf7-5315f600464a" 00:15:47.774 } 00:15:47.774 ] 00:15:47.774 }, 00:15:47.774 { 00:15:47.774 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:47.774 "subtype": "NVMe", 00:15:47.774 "listen_addresses": [ 00:15:47.774 { 00:15:47.774 "transport": "VFIOUSER", 00:15:47.774 "trtype": "VFIOUSER", 00:15:47.774 "adrfam": "IPv4", 00:15:47.774 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:47.774 "trsvcid": "0" 00:15:47.774 } 00:15:47.774 ], 00:15:47.774 "allow_any_host": true, 00:15:47.774 "hosts": [], 00:15:47.774 "serial_number": "SPDK2", 00:15:47.774 "model_number": "SPDK bdev Controller", 00:15:47.774 "max_namespaces": 32, 00:15:47.774 "min_cntlid": 1, 00:15:47.774 "max_cntlid": 65519, 00:15:47.774 "namespaces": [ 00:15:47.774 { 00:15:47.774 "nsid": 1, 00:15:47.774 "bdev_name": "Malloc2", 00:15:47.774 "name": "Malloc2", 00:15:47.774 "nguid": "2A3772393AE74ED8B44595F92082652E", 00:15:47.774 "uuid": "2a377239-3ae7-4ed8-b445-95f92082652e" 00:15:47.775 } 00:15:47.775 ] 00:15:47.775 } 00:15:47.775 ] 00:15:47.775 05:11:49 -- target/nvmf_vfio_user.sh@44 -- # wait 3273029 00:15:47.775 05:11:49 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:47.775 05:11:49 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:47.775 05:11:49 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:47.775 05:11:49 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:47.775 [2024-11-26 05:11:49.349454] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:47.775 [2024-11-26 05:11:49.349496] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3273161 ] 00:15:47.775 EAL: No free 2048 kB hugepages reported on node 1 00:15:47.775 [2024-11-26 05:11:49.381379] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:47.775 [2024-11-26 05:11:49.394722] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:47.775 [2024-11-26 05:11:49.394753] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f3a3b17d000 00:15:47.775 [2024-11-26 05:11:49.395726] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:47.775 [2024-11-26 05:11:49.396722] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:47.775 [2024-11-26 05:11:49.397744] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:47.775 [2024-11-26 05:11:49.398755] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:47.775 [2024-11-26 05:11:49.399762] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:47.775 [2024-11-26 05:11:49.400762] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:47.775 [2024-11-26 05:11:49.401777] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:47.775 [2024-11-26 05:11:49.402779] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:47.775 [2024-11-26 05:11:49.403796] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:47.775 [2024-11-26 05:11:49.403819] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f3a39e75000 00:15:47.775 [2024-11-26 05:11:49.404945] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:47.775 [2024-11-26 05:11:49.419696] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:47.775 [2024-11-26 05:11:49.419733] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:47.775 [2024-11-26 05:11:49.421824] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:47.775 [2024-11-26 05:11:49.421881] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:47.775 [2024-11-26 05:11:49.421984] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:47.775 [2024-11-26 05:11:49.422009] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:47.775 [2024-11-26 05:11:49.422027] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:47.775 [2024-11-26 05:11:49.422828] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:47.775 [2024-11-26 05:11:49.422849] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:47.775 [2024-11-26 05:11:49.422862] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:47.775 [2024-11-26 05:11:49.423837] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:47.775 [2024-11-26 05:11:49.423859] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:47.775 [2024-11-26 05:11:49.423873] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:47.775 [2024-11-26 05:11:49.424841] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:47.775 [2024-11-26 05:11:49.424861] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:47.775 [2024-11-26 05:11:49.425851] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:47.775 [2024-11-26 05:11:49.425872] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:47.775 [2024-11-26 05:11:49.425881] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:47.775 [2024-11-26 05:11:49.425897] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:47.775 [2024-11-26 05:11:49.426008] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:47.775 [2024-11-26 05:11:49.426018] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:47.775 [2024-11-26 05:11:49.426027] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:47.775 [2024-11-26 05:11:49.426860] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:47.775 [2024-11-26 05:11:49.427869] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:47.775 [2024-11-26 05:11:49.428876] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:47.775 [2024-11-26 05:11:49.429907] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:47.775 [2024-11-26 05:11:49.430882] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:47.775 [2024-11-26 05:11:49.430903] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:47.775 [2024-11-26 05:11:49.430912] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:47.775 [2024-11-26 05:11:49.430936] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:47.775 [2024-11-26 05:11:49.430949] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:47.775 [2024-11-26 05:11:49.430993] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:47.775 [2024-11-26 05:11:49.431004] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:47.775 [2024-11-26 05:11:49.431023] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:47.775 [2024-11-26 05:11:49.438708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:47.775 [2024-11-26 05:11:49.438733] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:47.775 [2024-11-26 05:11:49.438742] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:47.775 [2024-11-26 05:11:49.438750] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:47.775 [2024-11-26 05:11:49.438761] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:47.775 [2024-11-26 05:11:49.438769] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:47.775 [2024-11-26 05:11:49.438776] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:47.775 [2024-11-26 05:11:49.438784] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.438801] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.438818] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:47.776 [2024-11-26 05:11:49.446698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:47.776 [2024-11-26 05:11:49.446729] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:47.776 [2024-11-26 05:11:49.446743] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:47.776 [2024-11-26 05:11:49.446759] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:47.776 [2024-11-26 05:11:49.446771] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:47.776 [2024-11-26 05:11:49.446779] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.446795] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.446809] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:47.776 [2024-11-26 05:11:49.454695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:47.776 [2024-11-26 05:11:49.454714] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:47.776 [2024-11-26 05:11:49.454723] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.454735] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.454755] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.454770] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:47.776 [2024-11-26 05:11:49.462707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:47.776 [2024-11-26 05:11:49.462779] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.462794] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.462806] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:47.776 [2024-11-26 05:11:49.462815] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:47.776 [2024-11-26 05:11:49.462824] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:47.776 [2024-11-26 05:11:49.470695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:47.776 [2024-11-26 05:11:49.470723] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:47.776 [2024-11-26 05:11:49.470757] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.470772] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.470788] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:47.776 [2024-11-26 05:11:49.470797] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:47.776 [2024-11-26 05:11:49.470807] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:47.776 [2024-11-26 05:11:49.478713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:47.776 [2024-11-26 05:11:49.478741] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.478757] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.478770] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:47.776 [2024-11-26 05:11:49.478778] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:47.776 [2024-11-26 05:11:49.478788] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:47.776 [2024-11-26 05:11:49.486695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:47.776 [2024-11-26 05:11:49.486717] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.486730] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.486745] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.486756] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.486764] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.486773] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:47.776 [2024-11-26 05:11:49.486780] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:47.776 [2024-11-26 05:11:49.486789] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:47.776 [2024-11-26 05:11:49.486816] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:47.776 [2024-11-26 05:11:49.494696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:47.776 [2024-11-26 05:11:49.494722] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:47.776 [2024-11-26 05:11:49.502699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:47.776 [2024-11-26 05:11:49.502724] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:47.776 [2024-11-26 05:11:49.510694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:47.776 [2024-11-26 05:11:49.510719] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:47.776 [2024-11-26 05:11:49.518698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:47.776 [2024-11-26 05:11:49.518729] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:47.776 [2024-11-26 05:11:49.518739] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:47.776 [2024-11-26 05:11:49.518745] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:47.776 [2024-11-26 05:11:49.518751] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:47.776 [2024-11-26 05:11:49.518761] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:47.776 [2024-11-26 05:11:49.518772] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:47.776 [2024-11-26 05:11:49.518780] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:47.776 [2024-11-26 05:11:49.518789] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:47.776 [2024-11-26 05:11:49.518799] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:47.776 [2024-11-26 05:11:49.518807] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:47.776 [2024-11-26 05:11:49.518816] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:47.776 [2024-11-26 05:11:49.518827] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:47.776 [2024-11-26 05:11:49.518835] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:47.776 [2024-11-26 05:11:49.518844] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:47.776 [2024-11-26 05:11:49.526699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:47.777 [2024-11-26 05:11:49.526730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:47.777 [2024-11-26 05:11:49.526746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:47.777 [2024-11-26 05:11:49.526757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:47.777 ===================================================== 00:15:47.777 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:47.777 ===================================================== 00:15:47.777 Controller Capabilities/Features 00:15:47.777 ================================ 00:15:47.777 Vendor ID: 4e58 00:15:47.777 Subsystem Vendor ID: 4e58 00:15:47.777 Serial Number: SPDK2 00:15:47.777 Model Number: SPDK bdev Controller 00:15:47.777 Firmware Version: 24.01.1 00:15:47.777 Recommended Arb Burst: 6 00:15:47.777 IEEE OUI Identifier: 8d 6b 50 00:15:47.777 Multi-path I/O 00:15:47.777 May have multiple subsystem ports: Yes 00:15:47.777 May have multiple controllers: Yes 00:15:47.777 Associated with SR-IOV VF: No 00:15:47.777 Max Data Transfer Size: 131072 00:15:47.777 Max Number of Namespaces: 32 00:15:47.777 Max Number of I/O Queues: 127 00:15:47.777 NVMe Specification Version (VS): 1.3 00:15:47.777 NVMe Specification Version (Identify): 1.3 00:15:47.777 Maximum Queue Entries: 256 00:15:47.777 Contiguous Queues Required: Yes 00:15:47.777 Arbitration Mechanisms Supported 00:15:47.777 Weighted Round Robin: Not Supported 00:15:47.777 Vendor Specific: Not Supported 00:15:47.777 Reset Timeout: 15000 ms 00:15:47.777 Doorbell Stride: 4 bytes 00:15:47.777 NVM Subsystem Reset: Not Supported 00:15:47.777 Command Sets Supported 00:15:47.777 NVM Command Set: Supported 00:15:47.777 Boot Partition: Not Supported 00:15:47.777 Memory Page Size Minimum: 4096 bytes 00:15:47.777 Memory Page Size Maximum: 4096 bytes 00:15:47.777 Persistent Memory Region: Not Supported 00:15:47.777 Optional Asynchronous Events Supported 00:15:47.777 Namespace Attribute Notices: Supported 00:15:47.777 Firmware Activation Notices: Not Supported 00:15:47.777 ANA Change Notices: Not Supported 00:15:47.777 PLE Aggregate Log Change Notices: Not Supported 00:15:47.777 LBA Status Info Alert Notices: Not Supported 00:15:47.777 EGE Aggregate Log Change Notices: Not Supported 00:15:47.777 Normal NVM Subsystem Shutdown event: Not Supported 00:15:47.777 Zone Descriptor Change Notices: Not Supported 00:15:47.777 Discovery Log Change Notices: Not Supported 00:15:47.777 Controller Attributes 00:15:47.777 128-bit Host Identifier: Supported 00:15:47.777 Non-Operational Permissive Mode: Not Supported 00:15:47.777 NVM Sets: Not Supported 00:15:47.777 Read Recovery Levels: Not Supported 00:15:47.777 Endurance Groups: Not Supported 00:15:47.777 Predictable Latency Mode: Not Supported 00:15:47.777 Traffic Based Keep ALive: Not Supported 00:15:47.777 Namespace Granularity: Not Supported 00:15:47.777 SQ Associations: Not Supported 00:15:47.777 UUID List: Not Supported 00:15:47.777 Multi-Domain Subsystem: Not Supported 00:15:47.777 Fixed Capacity Management: Not Supported 00:15:47.777 Variable Capacity Management: Not Supported 00:15:47.777 Delete Endurance Group: Not Supported 00:15:47.777 Delete NVM Set: Not Supported 00:15:47.777 Extended LBA Formats Supported: Not Supported 00:15:47.777 Flexible Data Placement Supported: Not Supported 00:15:47.777 00:15:47.777 Controller Memory Buffer Support 00:15:47.777 ================================ 00:15:47.777 Supported: No 00:15:47.777 00:15:47.777 Persistent Memory Region Support 00:15:47.777 ================================ 00:15:47.777 Supported: No 00:15:47.777 00:15:47.777 Admin Command Set Attributes 00:15:47.777 ============================ 00:15:47.777 Security Send/Receive: Not Supported 00:15:47.777 Format NVM: Not Supported 00:15:47.777 Firmware Activate/Download: Not Supported 00:15:47.777 Namespace Management: Not Supported 00:15:47.777 Device Self-Test: Not Supported 00:15:47.777 Directives: Not Supported 00:15:47.777 NVMe-MI: Not Supported 00:15:47.777 Virtualization Management: Not Supported 00:15:47.777 Doorbell Buffer Config: Not Supported 00:15:47.777 Get LBA Status Capability: Not Supported 00:15:47.777 Command & Feature Lockdown Capability: Not Supported 00:15:47.777 Abort Command Limit: 4 00:15:47.777 Async Event Request Limit: 4 00:15:47.777 Number of Firmware Slots: N/A 00:15:47.777 Firmware Slot 1 Read-Only: N/A 00:15:47.777 Firmware Activation Without Reset: N/A 00:15:47.777 Multiple Update Detection Support: N/A 00:15:47.777 Firmware Update Granularity: No Information Provided 00:15:47.777 Per-Namespace SMART Log: No 00:15:47.777 Asymmetric Namespace Access Log Page: Not Supported 00:15:47.777 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:47.777 Command Effects Log Page: Supported 00:15:47.777 Get Log Page Extended Data: Supported 00:15:47.777 Telemetry Log Pages: Not Supported 00:15:47.777 Persistent Event Log Pages: Not Supported 00:15:47.777 Supported Log Pages Log Page: May Support 00:15:47.777 Commands Supported & Effects Log Page: Not Supported 00:15:47.777 Feature Identifiers & Effects Log Page:May Support 00:15:47.777 NVMe-MI Commands & Effects Log Page: May Support 00:15:47.777 Data Area 4 for Telemetry Log: Not Supported 00:15:47.777 Error Log Page Entries Supported: 128 00:15:47.777 Keep Alive: Supported 00:15:47.777 Keep Alive Granularity: 10000 ms 00:15:47.777 00:15:47.777 NVM Command Set Attributes 00:15:47.777 ========================== 00:15:47.777 Submission Queue Entry Size 00:15:47.777 Max: 64 00:15:47.777 Min: 64 00:15:47.777 Completion Queue Entry Size 00:15:47.777 Max: 16 00:15:47.777 Min: 16 00:15:47.777 Number of Namespaces: 32 00:15:47.777 Compare Command: Supported 00:15:47.777 Write Uncorrectable Command: Not Supported 00:15:47.777 Dataset Management Command: Supported 00:15:47.777 Write Zeroes Command: Supported 00:15:47.777 Set Features Save Field: Not Supported 00:15:47.777 Reservations: Not Supported 00:15:47.777 Timestamp: Not Supported 00:15:47.777 Copy: Supported 00:15:47.777 Volatile Write Cache: Present 00:15:47.777 Atomic Write Unit (Normal): 1 00:15:47.777 Atomic Write Unit (PFail): 1 00:15:47.777 Atomic Compare & Write Unit: 1 00:15:47.777 Fused Compare & Write: Supported 00:15:47.777 Scatter-Gather List 00:15:47.777 SGL Command Set: Supported (Dword aligned) 00:15:47.777 SGL Keyed: Not Supported 00:15:47.777 SGL Bit Bucket Descriptor: Not Supported 00:15:47.777 SGL Metadata Pointer: Not Supported 00:15:47.777 Oversized SGL: Not Supported 00:15:47.777 SGL Metadata Address: Not Supported 00:15:47.777 SGL Offset: Not Supported 00:15:47.777 Transport SGL Data Block: Not Supported 00:15:47.777 Replay Protected Memory Block: Not Supported 00:15:47.777 00:15:47.778 Firmware Slot Information 00:15:47.778 ========================= 00:15:47.778 Active slot: 1 00:15:47.778 Slot 1 Firmware Revision: 24.01.1 00:15:47.778 00:15:47.778 00:15:47.778 Commands Supported and Effects 00:15:47.778 ============================== 00:15:47.778 Admin Commands 00:15:47.778 -------------- 00:15:47.778 Get Log Page (02h): Supported 00:15:47.778 Identify (06h): Supported 00:15:47.778 Abort (08h): Supported 00:15:47.778 Set Features (09h): Supported 00:15:47.778 Get Features (0Ah): Supported 00:15:47.778 Asynchronous Event Request (0Ch): Supported 00:15:47.778 Keep Alive (18h): Supported 00:15:47.778 I/O Commands 00:15:47.778 ------------ 00:15:47.778 Flush (00h): Supported LBA-Change 00:15:47.778 Write (01h): Supported LBA-Change 00:15:47.778 Read (02h): Supported 00:15:47.778 Compare (05h): Supported 00:15:47.778 Write Zeroes (08h): Supported LBA-Change 00:15:47.778 Dataset Management (09h): Supported LBA-Change 00:15:47.778 Copy (19h): Supported LBA-Change 00:15:47.778 Unknown (79h): Supported LBA-Change 00:15:47.778 Unknown (7Ah): Supported 00:15:47.778 00:15:47.778 Error Log 00:15:47.778 ========= 00:15:47.778 00:15:47.778 Arbitration 00:15:47.778 =========== 00:15:47.778 Arbitration Burst: 1 00:15:47.778 00:15:47.778 Power Management 00:15:47.778 ================ 00:15:47.778 Number of Power States: 1 00:15:47.778 Current Power State: Power State #0 00:15:47.778 Power State #0: 00:15:47.778 Max Power: 0.00 W 00:15:47.778 Non-Operational State: Operational 00:15:47.778 Entry Latency: Not Reported 00:15:47.778 Exit Latency: Not Reported 00:15:47.778 Relative Read Throughput: 0 00:15:47.778 Relative Read Latency: 0 00:15:47.778 Relative Write Throughput: 0 00:15:47.778 Relative Write Latency: 0 00:15:47.778 Idle Power: Not Reported 00:15:47.778 Active Power: Not Reported 00:15:47.778 Non-Operational Permissive Mode: Not Supported 00:15:47.778 00:15:47.778 Health Information 00:15:47.778 ================== 00:15:47.778 Critical Warnings: 00:15:47.778 Available Spare Space: OK 00:15:47.778 Temperature: OK 00:15:47.778 Device Reliability: OK 00:15:47.778 Read Only: No 00:15:47.778 Volatile Memory Backup: OK 00:15:47.778 Current Temperature: 0 Kelvin[2024-11-26 05:11:49.526883] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:47.778 [2024-11-26 05:11:49.534696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:47.778 [2024-11-26 05:11:49.534744] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:47.778 [2024-11-26 05:11:49.534761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:47.778 [2024-11-26 05:11:49.534772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:47.778 [2024-11-26 05:11:49.534782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:47.778 [2024-11-26 05:11:49.534791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:47.778 [2024-11-26 05:11:49.534857] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:47.778 [2024-11-26 05:11:49.534877] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:47.778 [2024-11-26 05:11:49.535924] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:47.778 [2024-11-26 05:11:49.535946] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:48.036 [2024-11-26 05:11:49.538698] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:48.036 [2024-11-26 05:11:49.538723] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 2 milliseconds 00:15:48.036 [2024-11-26 05:11:49.538790] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:48.036 [2024-11-26 05:11:49.540017] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:48.036 (-273 Celsius) 00:15:48.036 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:48.036 Available Spare: 0% 00:15:48.036 Available Spare Threshold: 0% 00:15:48.036 Life Percentage Used: 0% 00:15:48.036 Data Units Read: 0 00:15:48.036 Data Units Written: 0 00:15:48.036 Host Read Commands: 0 00:15:48.036 Host Write Commands: 0 00:15:48.036 Controller Busy Time: 0 minutes 00:15:48.036 Power Cycles: 0 00:15:48.036 Power On Hours: 0 hours 00:15:48.036 Unsafe Shutdowns: 0 00:15:48.036 Unrecoverable Media Errors: 0 00:15:48.036 Lifetime Error Log Entries: 0 00:15:48.036 Warning Temperature Time: 0 minutes 00:15:48.036 Critical Temperature Time: 0 minutes 00:15:48.036 00:15:48.036 Number of Queues 00:15:48.036 ================ 00:15:48.036 Number of I/O Submission Queues: 127 00:15:48.036 Number of I/O Completion Queues: 127 00:15:48.036 00:15:48.036 Active Namespaces 00:15:48.036 ================= 00:15:48.036 Namespace ID:1 00:15:48.036 Error Recovery Timeout: Unlimited 00:15:48.036 Command Set Identifier: NVM (00h) 00:15:48.036 Deallocate: Supported 00:15:48.036 Deallocated/Unwritten Error: Not Supported 00:15:48.036 Deallocated Read Value: Unknown 00:15:48.036 Deallocate in Write Zeroes: Not Supported 00:15:48.036 Deallocated Guard Field: 0xFFFF 00:15:48.036 Flush: Supported 00:15:48.036 Reservation: Supported 00:15:48.036 Namespace Sharing Capabilities: Multiple Controllers 00:15:48.036 Size (in LBAs): 131072 (0GiB) 00:15:48.036 Capacity (in LBAs): 131072 (0GiB) 00:15:48.036 Utilization (in LBAs): 131072 (0GiB) 00:15:48.036 NGUID: 2A3772393AE74ED8B44595F92082652E 00:15:48.036 UUID: 2a377239-3ae7-4ed8-b445-95f92082652e 00:15:48.036 Thin Provisioning: Not Supported 00:15:48.036 Per-NS Atomic Units: Yes 00:15:48.036 Atomic Boundary Size (Normal): 0 00:15:48.036 Atomic Boundary Size (PFail): 0 00:15:48.036 Atomic Boundary Offset: 0 00:15:48.036 Maximum Single Source Range Length: 65535 00:15:48.036 Maximum Copy Length: 65535 00:15:48.036 Maximum Source Range Count: 1 00:15:48.036 NGUID/EUI64 Never Reused: No 00:15:48.036 Namespace Write Protected: No 00:15:48.036 Number of LBA Formats: 1 00:15:48.036 Current LBA Format: LBA Format #00 00:15:48.036 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:48.036 00:15:48.036 05:11:49 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:48.036 EAL: No free 2048 kB hugepages reported on node 1 00:15:53.301 Initializing NVMe Controllers 00:15:53.301 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:53.301 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:53.301 Initialization complete. Launching workers. 00:15:53.301 ======================================================== 00:15:53.301 Latency(us) 00:15:53.301 Device Information : IOPS MiB/s Average min max 00:15:53.301 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 37078.33 144.84 3451.55 1152.62 7304.17 00:15:53.301 ======================================================== 00:15:53.301 Total : 37078.33 144.84 3451.55 1152.62 7304.17 00:15:53.301 00:15:53.301 05:11:54 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:53.301 EAL: No free 2048 kB hugepages reported on node 1 00:15:58.569 Initializing NVMe Controllers 00:15:58.569 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:58.569 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:58.569 Initialization complete. Launching workers. 00:15:58.569 ======================================================== 00:15:58.569 Latency(us) 00:15:58.569 Device Information : IOPS MiB/s Average min max 00:15:58.569 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 35361.11 138.13 3619.13 1177.95 11301.55 00:15:58.569 ======================================================== 00:15:58.569 Total : 35361.11 138.13 3619.13 1177.95 11301.55 00:15:58.569 00:15:58.569 05:12:00 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:58.569 EAL: No free 2048 kB hugepages reported on node 1 00:16:03.836 Initializing NVMe Controllers 00:16:03.836 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:03.836 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:03.836 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:16:03.836 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:16:03.836 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:16:03.836 Initialization complete. Launching workers. 00:16:03.836 Starting thread on core 2 00:16:03.836 Starting thread on core 3 00:16:03.836 Starting thread on core 1 00:16:03.836 05:12:05 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:16:03.836 EAL: No free 2048 kB hugepages reported on node 1 00:16:07.168 Initializing NVMe Controllers 00:16:07.168 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:07.168 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:07.168 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:16:07.168 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:16:07.168 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:16:07.168 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:16:07.168 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:07.168 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:07.168 Initialization complete. Launching workers. 00:16:07.168 Starting thread on core 1 with urgent priority queue 00:16:07.168 Starting thread on core 2 with urgent priority queue 00:16:07.168 Starting thread on core 3 with urgent priority queue 00:16:07.168 Starting thread on core 0 with urgent priority queue 00:16:07.168 SPDK bdev Controller (SPDK2 ) core 0: 6005.67 IO/s 16.65 secs/100000 ios 00:16:07.168 SPDK bdev Controller (SPDK2 ) core 1: 5798.33 IO/s 17.25 secs/100000 ios 00:16:07.168 SPDK bdev Controller (SPDK2 ) core 2: 5489.67 IO/s 18.22 secs/100000 ios 00:16:07.168 SPDK bdev Controller (SPDK2 ) core 3: 6014.67 IO/s 16.63 secs/100000 ios 00:16:07.168 ======================================================== 00:16:07.168 00:16:07.168 05:12:08 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:07.427 EAL: No free 2048 kB hugepages reported on node 1 00:16:07.427 Initializing NVMe Controllers 00:16:07.427 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:07.427 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:07.427 Namespace ID: 1 size: 0GB 00:16:07.427 Initialization complete. 00:16:07.427 INFO: using host memory buffer for IO 00:16:07.427 Hello world! 00:16:07.427 05:12:09 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:07.688 EAL: No free 2048 kB hugepages reported on node 1 00:16:09.070 Initializing NVMe Controllers 00:16:09.070 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:09.070 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:09.070 Initialization complete. Launching workers. 00:16:09.070 submit (in ns) avg, min, max = 6462.6, 3446.7, 4021918.9 00:16:09.070 complete (in ns) avg, min, max = 24636.1, 2036.7, 4025388.9 00:16:09.070 00:16:09.070 Submit histogram 00:16:09.070 ================ 00:16:09.070 Range in us Cumulative Count 00:16:09.070 3.437 - 3.461: 0.0686% ( 9) 00:16:09.070 3.461 - 3.484: 0.3808% ( 41) 00:16:09.070 3.484 - 3.508: 1.6147% ( 162) 00:16:09.070 3.508 - 3.532: 3.8464% ( 293) 00:16:09.070 3.532 - 3.556: 8.5917% ( 623) 00:16:09.070 3.556 - 3.579: 16.0941% ( 985) 00:16:09.070 3.579 - 3.603: 24.1679% ( 1060) 00:16:09.070 3.603 - 3.627: 30.7487% ( 864) 00:16:09.070 3.627 - 3.650: 37.8094% ( 927) 00:16:09.070 3.650 - 3.674: 44.1846% ( 837) 00:16:09.070 3.674 - 3.698: 49.8058% ( 738) 00:16:09.070 3.698 - 3.721: 54.9928% ( 681) 00:16:09.070 3.721 - 3.745: 59.1972% ( 552) 00:16:09.070 3.745 - 3.769: 62.7085% ( 461) 00:16:09.070 3.769 - 3.793: 66.8215% ( 540) 00:16:09.070 3.793 - 3.816: 70.7061% ( 510) 00:16:09.070 3.816 - 3.840: 74.9562% ( 558) 00:16:09.070 3.840 - 3.864: 78.7189% ( 494) 00:16:09.070 3.864 - 3.887: 81.7579% ( 399) 00:16:09.070 3.887 - 3.911: 84.5228% ( 363) 00:16:09.070 3.911 - 3.935: 86.6860% ( 284) 00:16:09.070 3.935 - 3.959: 88.3845% ( 223) 00:16:09.070 3.959 - 3.982: 89.6717% ( 169) 00:16:09.070 3.982 - 4.006: 90.8218% ( 151) 00:16:09.070 4.006 - 4.030: 91.8501% ( 135) 00:16:09.070 4.030 - 4.053: 92.7413% ( 117) 00:16:09.070 4.053 - 4.077: 93.6019% ( 113) 00:16:09.070 4.077 - 4.101: 94.1808% ( 76) 00:16:09.070 4.101 - 4.124: 94.7597% ( 76) 00:16:09.070 4.124 - 4.148: 95.0872% ( 43) 00:16:09.070 4.148 - 4.172: 95.3538% ( 35) 00:16:09.070 4.172 - 4.196: 95.5061% ( 20) 00:16:09.070 4.196 - 4.219: 95.6280% ( 16) 00:16:09.070 4.219 - 4.243: 95.7422% ( 15) 00:16:09.070 4.243 - 4.267: 95.8337% ( 12) 00:16:09.070 4.267 - 4.290: 95.9251% ( 12) 00:16:09.070 4.290 - 4.314: 95.9860% ( 8) 00:16:09.070 4.314 - 4.338: 96.0241% ( 5) 00:16:09.070 4.338 - 4.361: 96.0850% ( 8) 00:16:09.070 4.361 - 4.385: 96.1536% ( 9) 00:16:09.070 4.385 - 4.409: 96.1764% ( 3) 00:16:09.070 4.409 - 4.433: 96.2069% ( 4) 00:16:09.070 4.433 - 4.456: 96.2145% ( 1) 00:16:09.070 4.456 - 4.480: 96.2297% ( 2) 00:16:09.070 4.527 - 4.551: 96.2450% ( 2) 00:16:09.070 4.575 - 4.599: 96.2526% ( 1) 00:16:09.070 4.693 - 4.717: 96.2754% ( 3) 00:16:09.070 4.717 - 4.741: 96.3059% ( 4) 00:16:09.070 4.741 - 4.764: 96.3364% ( 4) 00:16:09.070 4.764 - 4.788: 96.3821% ( 6) 00:16:09.070 4.788 - 4.812: 96.4354% ( 7) 00:16:09.070 4.812 - 4.836: 96.5039% ( 9) 00:16:09.070 4.836 - 4.859: 96.5420% ( 5) 00:16:09.070 4.859 - 4.883: 96.6106% ( 9) 00:16:09.070 4.883 - 4.907: 96.6334% ( 3) 00:16:09.070 4.907 - 4.930: 96.6867% ( 7) 00:16:09.070 4.930 - 4.954: 96.7248% ( 5) 00:16:09.070 4.954 - 4.978: 96.7781% ( 7) 00:16:09.070 4.978 - 5.001: 96.8467% ( 9) 00:16:09.070 5.001 - 5.025: 96.8619% ( 2) 00:16:09.070 5.025 - 5.049: 96.8924% ( 4) 00:16:09.070 5.049 - 5.073: 96.9152% ( 3) 00:16:09.070 5.073 - 5.096: 96.9609% ( 6) 00:16:09.070 5.096 - 5.120: 96.9685% ( 1) 00:16:09.070 5.120 - 5.144: 96.9990% ( 4) 00:16:09.070 5.144 - 5.167: 97.0142% ( 2) 00:16:09.070 5.167 - 5.191: 97.0295% ( 2) 00:16:09.070 5.191 - 5.215: 97.0371% ( 1) 00:16:09.070 5.215 - 5.239: 97.0523% ( 2) 00:16:09.070 5.239 - 5.262: 97.0599% ( 1) 00:16:09.070 5.286 - 5.310: 97.0676% ( 1) 00:16:09.070 5.310 - 5.333: 97.0828% ( 2) 00:16:09.070 5.333 - 5.357: 97.0980% ( 2) 00:16:09.070 5.357 - 5.381: 97.1056% ( 1) 00:16:09.070 5.428 - 5.452: 97.1209% ( 2) 00:16:09.070 5.452 - 5.476: 97.1361% ( 2) 00:16:09.070 5.476 - 5.499: 97.1513% ( 2) 00:16:09.070 5.570 - 5.594: 97.1666% ( 2) 00:16:09.070 5.594 - 5.618: 97.1742% ( 1) 00:16:09.070 5.618 - 5.641: 97.1818% ( 1) 00:16:09.070 5.689 - 5.713: 97.1894% ( 1) 00:16:09.070 5.760 - 5.784: 97.2047% ( 2) 00:16:09.070 5.879 - 5.902: 97.2275% ( 3) 00:16:09.070 5.926 - 5.950: 97.2351% ( 1) 00:16:09.070 5.950 - 5.973: 97.2427% ( 1) 00:16:09.070 5.973 - 5.997: 97.2504% ( 1) 00:16:09.070 6.116 - 6.163: 97.2580% ( 1) 00:16:09.070 6.163 - 6.210: 97.2656% ( 1) 00:16:09.070 6.210 - 6.258: 97.2808% ( 2) 00:16:09.070 6.258 - 6.305: 97.2884% ( 1) 00:16:09.070 6.305 - 6.353: 97.3037% ( 2) 00:16:09.070 6.400 - 6.447: 97.3189% ( 2) 00:16:09.070 6.590 - 6.637: 97.3494% ( 4) 00:16:09.070 6.637 - 6.684: 97.3570% ( 1) 00:16:09.070 6.684 - 6.732: 97.3722% ( 2) 00:16:09.070 6.779 - 6.827: 97.3875% ( 2) 00:16:09.070 6.874 - 6.921: 97.3951% ( 1) 00:16:09.070 6.921 - 6.969: 97.4179% ( 3) 00:16:09.070 6.969 - 7.016: 97.4255% ( 1) 00:16:09.070 7.064 - 7.111: 97.4332% ( 1) 00:16:09.070 7.111 - 7.159: 97.4484% ( 2) 00:16:09.070 7.159 - 7.206: 97.4560% ( 1) 00:16:09.070 7.348 - 7.396: 97.4636% ( 1) 00:16:09.070 7.396 - 7.443: 97.4865% ( 3) 00:16:09.070 7.443 - 7.490: 97.5017% ( 2) 00:16:09.070 7.490 - 7.538: 97.5246% ( 3) 00:16:09.070 7.585 - 7.633: 97.5322% ( 1) 00:16:09.070 7.633 - 7.680: 97.5474% ( 2) 00:16:09.070 7.680 - 7.727: 97.5550% ( 1) 00:16:09.070 7.727 - 7.775: 97.5779% ( 3) 00:16:09.070 7.775 - 7.822: 97.5931% ( 2) 00:16:09.070 7.822 - 7.870: 97.6312% ( 5) 00:16:09.070 7.870 - 7.917: 97.6464% ( 2) 00:16:09.070 7.917 - 7.964: 97.6617% ( 2) 00:16:09.070 7.964 - 8.012: 97.6769% ( 2) 00:16:09.070 8.059 - 8.107: 97.6845% ( 1) 00:16:09.070 8.107 - 8.154: 97.6997% ( 2) 00:16:09.070 8.201 - 8.249: 97.7150% ( 2) 00:16:09.070 8.296 - 8.344: 97.7226% ( 1) 00:16:09.070 8.344 - 8.391: 97.7378% ( 2) 00:16:09.071 8.439 - 8.486: 97.7531% ( 2) 00:16:09.071 8.486 - 8.533: 97.7607% ( 1) 00:16:09.071 8.581 - 8.628: 97.7759% ( 2) 00:16:09.071 8.628 - 8.676: 97.7911% ( 2) 00:16:09.071 8.676 - 8.723: 97.8140% ( 3) 00:16:09.071 8.723 - 8.770: 97.8216% ( 1) 00:16:09.071 8.770 - 8.818: 97.8368% ( 2) 00:16:09.071 8.865 - 8.913: 97.8445% ( 1) 00:16:09.071 8.960 - 9.007: 97.8521% ( 1) 00:16:09.071 9.007 - 9.055: 97.8597% ( 1) 00:16:09.071 9.055 - 9.102: 97.8749% ( 2) 00:16:09.071 9.102 - 9.150: 97.8978% ( 3) 00:16:09.071 9.197 - 9.244: 97.9054% ( 1) 00:16:09.071 9.339 - 9.387: 97.9130% ( 1) 00:16:09.071 9.387 - 9.434: 97.9359% ( 3) 00:16:09.071 9.434 - 9.481: 97.9435% ( 1) 00:16:09.071 9.481 - 9.529: 97.9663% ( 3) 00:16:09.071 9.529 - 9.576: 97.9816% ( 2) 00:16:09.071 9.576 - 9.624: 97.9968% ( 2) 00:16:09.071 9.719 - 9.766: 98.0044% ( 1) 00:16:09.071 9.861 - 9.908: 98.0120% ( 1) 00:16:09.071 9.908 - 9.956: 98.0197% ( 1) 00:16:09.071 9.956 - 10.003: 98.0577% ( 5) 00:16:09.071 10.050 - 10.098: 98.0654% ( 1) 00:16:09.071 10.098 - 10.145: 98.0730% ( 1) 00:16:09.071 10.240 - 10.287: 98.1034% ( 4) 00:16:09.071 10.287 - 10.335: 98.1111% ( 1) 00:16:09.071 10.335 - 10.382: 98.1187% ( 1) 00:16:09.071 10.430 - 10.477: 98.1339% ( 2) 00:16:09.071 10.524 - 10.572: 98.1415% ( 1) 00:16:09.071 10.572 - 10.619: 98.1491% ( 1) 00:16:09.071 10.667 - 10.714: 98.1644% ( 2) 00:16:09.071 10.761 - 10.809: 98.1796% ( 2) 00:16:09.071 10.809 - 10.856: 98.1872% ( 1) 00:16:09.071 10.904 - 10.951: 98.1948% ( 1) 00:16:09.071 10.951 - 10.999: 98.2025% ( 1) 00:16:09.071 10.999 - 11.046: 98.2177% ( 2) 00:16:09.071 11.046 - 11.093: 98.2329% ( 2) 00:16:09.071 11.093 - 11.141: 98.2405% ( 1) 00:16:09.071 11.141 - 11.188: 98.2482% ( 1) 00:16:09.071 11.188 - 11.236: 98.2558% ( 1) 00:16:09.071 11.378 - 11.425: 98.2634% ( 1) 00:16:09.071 11.520 - 11.567: 98.2710% ( 1) 00:16:09.071 11.615 - 11.662: 98.2786% ( 1) 00:16:09.071 11.757 - 11.804: 98.2862% ( 1) 00:16:09.071 11.852 - 11.899: 98.2939% ( 1) 00:16:09.071 12.041 - 12.089: 98.3091% ( 2) 00:16:09.071 12.089 - 12.136: 98.3167% ( 1) 00:16:09.071 12.136 - 12.231: 98.3396% ( 3) 00:16:09.071 12.231 - 12.326: 98.3472% ( 1) 00:16:09.071 12.421 - 12.516: 98.3624% ( 2) 00:16:09.071 12.516 - 12.610: 98.3776% ( 2) 00:16:09.071 12.800 - 12.895: 98.3929% ( 2) 00:16:09.071 12.895 - 12.990: 98.4081% ( 2) 00:16:09.071 12.990 - 13.084: 98.4157% ( 1) 00:16:09.071 13.084 - 13.179: 98.4233% ( 1) 00:16:09.071 13.179 - 13.274: 98.4462% ( 3) 00:16:09.071 13.274 - 13.369: 98.4614% ( 2) 00:16:09.071 13.369 - 13.464: 98.4843% ( 3) 00:16:09.071 13.464 - 13.559: 98.4919% ( 1) 00:16:09.071 13.559 - 13.653: 98.4995% ( 1) 00:16:09.071 13.653 - 13.748: 98.5224% ( 3) 00:16:09.071 13.748 - 13.843: 98.5452% ( 3) 00:16:09.071 13.843 - 13.938: 98.5757% ( 4) 00:16:09.071 13.938 - 14.033: 98.5833% ( 1) 00:16:09.071 14.033 - 14.127: 98.6061% ( 3) 00:16:09.071 14.127 - 14.222: 98.6214% ( 2) 00:16:09.071 14.222 - 14.317: 98.6595% ( 5) 00:16:09.071 14.317 - 14.412: 98.6747% ( 2) 00:16:09.071 14.412 - 14.507: 98.6899% ( 2) 00:16:09.071 14.507 - 14.601: 98.7052% ( 2) 00:16:09.071 14.601 - 14.696: 98.7356% ( 4) 00:16:09.071 14.696 - 14.791: 98.7432% ( 1) 00:16:09.071 14.981 - 15.076: 98.7509% ( 1) 00:16:09.071 15.076 - 15.170: 98.7585% ( 1) 00:16:09.071 16.782 - 16.877: 98.7661% ( 1) 00:16:09.071 16.972 - 17.067: 98.7737% ( 1) 00:16:09.071 17.067 - 17.161: 98.7889% ( 2) 00:16:09.071 17.161 - 17.256: 98.8118% ( 3) 00:16:09.071 17.256 - 17.351: 98.8194% ( 1) 00:16:09.071 17.351 - 17.446: 98.8423% ( 3) 00:16:09.071 17.446 - 17.541: 98.8727% ( 4) 00:16:09.071 17.541 - 17.636: 98.9184% ( 6) 00:16:09.071 17.636 - 17.730: 98.9260% ( 1) 00:16:09.071 17.730 - 17.825: 98.9794% ( 7) 00:16:09.071 17.825 - 17.920: 99.0479% ( 9) 00:16:09.071 17.920 - 18.015: 99.0784% ( 4) 00:16:09.071 18.015 - 18.110: 99.1545% ( 10) 00:16:09.071 18.110 - 18.204: 99.2307% ( 10) 00:16:09.071 18.204 - 18.299: 99.3373% ( 14) 00:16:09.071 18.299 - 18.394: 99.3983% ( 8) 00:16:09.071 18.394 - 18.489: 99.4973% ( 13) 00:16:09.071 18.489 - 18.584: 99.5354% ( 5) 00:16:09.071 18.584 - 18.679: 99.5582% ( 3) 00:16:09.071 18.679 - 18.773: 99.6039% ( 6) 00:16:09.071 18.773 - 18.868: 99.6420% ( 5) 00:16:09.071 18.868 - 18.963: 99.6725% ( 4) 00:16:09.071 18.963 - 19.058: 99.6877% ( 2) 00:16:09.071 19.058 - 19.153: 99.6953% ( 1) 00:16:09.071 19.153 - 19.247: 99.7029% ( 1) 00:16:09.071 19.342 - 19.437: 99.7106% ( 1) 00:16:09.071 19.437 - 19.532: 99.7182% ( 1) 00:16:09.071 19.532 - 19.627: 99.7486% ( 4) 00:16:09.071 19.627 - 19.721: 99.7563% ( 1) 00:16:09.071 20.290 - 20.385: 99.7715% ( 2) 00:16:09.071 21.144 - 21.239: 99.7791% ( 1) 00:16:09.071 21.713 - 21.807: 99.7943% ( 2) 00:16:09.071 22.092 - 22.187: 99.8020% ( 1) 00:16:09.071 23.324 - 23.419: 99.8096% ( 1) 00:16:09.071 23.704 - 23.799: 99.8172% ( 1) 00:16:09.071 23.893 - 23.988: 99.8248% ( 1) 00:16:09.071 25.221 - 25.410: 99.8324% ( 1) 00:16:09.071 25.790 - 25.979: 99.8477% ( 2) 00:16:09.071 27.307 - 27.496: 99.8553% ( 1) 00:16:09.071 27.876 - 28.065: 99.8705% ( 2) 00:16:09.071 28.065 - 28.255: 99.8934% ( 3) 00:16:09.071 28.255 - 28.444: 99.9010% ( 1) 00:16:09.071 28.444 - 28.634: 99.9086% ( 1) 00:16:09.071 28.634 - 28.824: 99.9162% ( 1) 00:16:09.071 28.824 - 29.013: 99.9238% ( 1) 00:16:09.071 29.582 - 29.772: 99.9314% ( 1) 00:16:09.071 29.772 - 29.961: 99.9391% ( 1) 00:16:09.071 3980.705 - 4004.978: 99.9695% ( 4) 00:16:09.071 4004.978 - 4029.250: 100.0000% ( 4) 00:16:09.071 00:16:09.071 Complete histogram 00:16:09.071 ================== 00:16:09.071 Range in us Cumulative Count 00:16:09.071 2.027 - 2.039: 0.0076% ( 1) 00:16:09.071 2.039 - 2.050: 5.2098% ( 683) 00:16:09.071 2.050 - 2.062: 18.4172% ( 1734) 00:16:09.071 2.062 - 2.074: 21.1669% ( 361) 00:16:09.071 2.074 - 2.086: 37.7333% ( 2175) 00:16:09.071 2.086 - 2.098: 51.5500% ( 1814) 00:16:09.071 2.098 - 2.110: 54.0178% ( 324) 00:16:09.071 2.110 - 2.121: 59.0449% ( 660) 00:16:09.071 2.121 - 2.133: 62.1144% ( 403) 00:16:09.071 2.133 - 2.145: 63.9653% ( 243) 00:16:09.071 2.145 - 2.157: 73.5623% ( 1260) 00:16:09.071 2.157 - 2.169: 77.8963% ( 569) 00:16:09.071 2.169 - 2.181: 79.3587% ( 192) 00:16:09.071 2.181 - 2.193: 82.0093% ( 348) 00:16:09.071 2.193 - 2.204: 83.5631% ( 204) 00:16:09.071 2.204 - 2.216: 85.1322% ( 206) 00:16:09.071 2.216 - 2.228: 90.0678% ( 648) 00:16:09.071 2.228 - 2.240: 92.5965% ( 332) 00:16:09.071 2.240 - 2.252: 93.5486% ( 125) 00:16:09.071 2.252 - 2.264: 94.1199% ( 75) 00:16:09.071 2.264 - 2.276: 94.4093% ( 38) 00:16:09.071 2.276 - 2.287: 95.0110% ( 79) 00:16:09.071 2.287 - 2.299: 95.4376% ( 56) 00:16:09.071 2.299 - 2.311: 95.5518% ( 15) 00:16:09.071 2.311 - 2.323: 95.6813% ( 17) 00:16:09.071 2.323 - 2.335: 95.9251% ( 32) 00:16:09.071 2.335 - 2.347: 96.0850% ( 21) 00:16:09.071 2.347 - 2.359: 96.4125% ( 43) 00:16:09.071 2.359 - 2.370: 96.7857% ( 49) 00:16:09.071 2.370 - 2.382: 97.0523% ( 35) 00:16:09.071 2.382 - 2.394: 97.2199% ( 22) 00:16:09.071 2.394 - 2.406: 97.3722% ( 20) 00:16:09.071 2.406 - 2.418: 97.5017% ( 17) 00:16:09.071 2.418 - 2.430: 97.6464% ( 19) 00:16:09.071 2.430 - 2.441: 97.8368% ( 25) 00:16:09.071 2.441 - 2.453: 97.8978% ( 8) 00:16:09.071 2.453 - 2.465: 97.9816% ( 11) 00:16:09.071 2.465 - 2.477: 98.0806% ( 13) 00:16:09.071 2.477 - 2.489: 98.1415% ( 8) 00:16:09.071 2.489 - 2.501: 98.2101% ( 9) 00:16:09.071 2.501 - 2.513: 98.2253% ( 2) 00:16:09.071 2.513 - 2.524: 98.2634% ( 5) 00:16:09.071 2.524 - 2.536: 98.2710% ( 1) 00:16:09.071 2.536 - 2.548: 98.2786% ( 1) 00:16:09.071 2.548 - 2.560: 98.2939% ( 2) 00:16:09.071 2.560 - 2.572: 98.3015% ( 1) 00:16:09.071 2.572 - 2.584: 98.3091% ( 1) 00:16:09.071 2.584 - 2.596: 98.3167% ( 1) 00:16:09.071 2.596 - 2.607: 98.3243% ( 1) 00:16:09.071 2.643 - 2.655: 98.3319% ( 1) 00:16:09.071 2.667 - 2.679: 98.3472% ( 2) 00:16:09.071 2.773 - 2.785: 98.3548% ( 1) 00:16:09.071 2.833 - 2.844: 98.3624% ( 1) 00:16:09.071 3.176 - 3.200: 98.3700% ( 1) 00:16:09.071 3.247 - 3.271: 98.3776% ( 1) 00:16:09.071 3.271 - 3.295: 98.3853% ( 1) 00:16:09.071 3.295 - 3.319: 98.3929% ( 1) 00:16:09.071 3.342 - 3.366: 98.4081% ( 2) 00:16:09.071 3.366 - 3.390: 98.4157% ( 1) 00:16:09.071 3.437 - 3.461: 98.4310% ( 2) 00:16:09.071 3.461 - 3.484: 98.4386% ( 1) 00:16:09.072 3.484 - 3.508: 98.4614% ( 3) 00:16:09.072 3.508 - 3.532: 98.4767% ( 2) 00:16:09.072 3.532 - 3.556: 98.4843% ( 1) 00:16:09.072 3.556 - 3.579: 98.4919% ( 1) 00:16:09.072 3.579 - 3.603: 98.5071% ( 2) 00:16:09.072 3.603 - 3.627: 98.5224% ( 2) 00:16:09.072 3.650 - 3.674: 98.5452% ( 3) 00:16:09.072 3.674 - 3.698: 98.5604% ( 2) 00:16:09.072 3.698 - 3.721: 98.5757% ( 2) 00:16:09.072 3.745 - 3.769: 98.5833% ( 1) 00:16:09.072 3.769 - 3.793: 98.5909% ( 1) 00:16:09.072 3.816 - 3.840: 98.6061% ( 2) 00:16:09.072 3.840 - 3.864: 98.6138% ( 1) 00:16:09.072 3.887 - 3.911: 98.6214% ( 1) 00:16:09.072 3.935 - 3.959: 98.6290% ( 1) 00:16:09.072 4.480 - 4.504: 98.6366% ( 1) 00:16:09.072 5.191 - 5.215: 98.6442% ( 1) 00:16:09.072 5.215 - 5.239: 98.6518% ( 1) 00:16:09.072 5.333 - 5.357: 98.6595% ( 1) 00:16:09.072 5.523 - 5.547: 98.6671% ( 1) 00:16:09.072 5.618 - 5.641: 98.6747% ( 1) 00:16:09.072 5.807 - 5.831: 98.6823% ( 1) 00:16:09.072 6.021 - 6.044: 98.6899% ( 1) 00:16:09.072 6.068 - 6.116: 98.6975% ( 1) 00:16:09.072 6.258 - 6.305: 98.7128% ( 2) 00:16:09.072 6.305 - 6.353: 98.7204% ( 1) 00:16:09.072 6.400 - 6.447: 98.7280% ( 1) 00:16:09.072 6.447 - 6.495: 98.7356% ( 1) 00:16:09.072 6.495 - 6.542: 98.7509% ( 2) 00:16:09.072 6.590 - 6.637: 98.7585% ( 1) 00:16:09.072 6.921 - 6.969: 98.7661% ( 1) 00:16:09.072 7.111 - 7.159: 98.7737% ( 1) 00:16:09.072 7.253 - 7.301: 98.7813% ( 1) 00:16:09.072 7.443 - 7.490: 98.7889% ( 1) 00:16:09.072 7.727 - 7.775: 98.7966% ( 1) 00:16:09.072 7.964 - 8.012: 98.8042% ( 1) 00:16:09.072 8.059 - 8.107: 98.8118% ( 1) 00:16:09.072 8.439 - 8.486: 98.8194% ( 1) 00:16:09.072 15.360 - 15.455: 98.8270% ( 1) 00:16:09.072 15.455 - 15.550: 98.8423% ( 2) 00:16:09.072 15.550 - 15.644: 98.8499% ( 1) 00:16:09.072 15.644 - 15.739: 98.8575% ( 1) 00:16:09.072 15.739 - 15.834: 98.8803% ( 3) 00:16:09.072 15.834 - 15.929: 98.9108% ( 4) 00:16:09.072 15.929 - 16.024: 98.9337% ( 3) 00:16:09.072 16.024 - 16.119: 98.9565% ( 3) 00:16:09.072 16.119 - 16.213: 99.0022% ( 6) 00:16:09.072 16.213 - 16.308: 99.0251% ( 3) 00:16:09.072 16.308 - 16.403: 99.0403% ( 2) 00:16:09.072 16.403 - 16.498: 99.0860% ( 6) 00:16:09.072 16.498 - 16.593: 99.1469% ( 8) 00:16:09.072 16.593 - 16.687: 99.1774% ( 4) 00:16:09.072 16.687 - 16.782: 99.2002% ( 3) 00:16:09.072 16.782 - 16.877: 99.2536% ( 7) 00:16:09.072 16.877 - 16.972: 99.2840% ( 4) 00:16:09.072 16.972 - 17.067: 99.3145% ( 4) 00:16:09.072 17.067 - 17.161: 99.3297% ( 2) 00:16:09.072 17.161 - 17.256: 99.3373% ( 1) 00:16:09.072 17.351 - 17.446: 99.3526% ( 2) 00:16:09.072 17.541 - 17.636: 99.3678% ( 2) 00:16:09.072 17.636 - 17.730: 99.3754% ( 1) 00:16:09.072 17.730 - 17.825: 99.3907% ( 2) 00:16:09.072 17.825 - 17.920: 99.3983% ( 1) 00:16:09.072 18.015 - 18.110: 99.4059% ( 1) 00:16:09.072 18.110 - 18.204: 99.4135% ( 1) 00:16:09.072 19.911 - 20.006: 99.4211% ( 1) 00:16:09.072 38.116 - 38.305: 99.4287% ( 1) 00:16:09.072 115.295 - 116.053: 99.4364% ( 1) 00:16:09.072 2026.761 - 2038.898: 99.4440% ( 1) 00:16:09.072 3980.705 - 4004.978: 99.8781% ( 57) 00:16:09.072 4004.978 - 4029.250: 100.0000% ( 16) 00:16:09.072 00:16:09.072 05:12:10 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:16:09.072 05:12:10 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:09.072 05:12:10 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:16:09.072 05:12:10 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:16:09.072 05:12:10 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:09.330 [ 00:16:09.330 { 00:16:09.330 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:09.330 "subtype": "Discovery", 00:16:09.331 "listen_addresses": [], 00:16:09.331 "allow_any_host": true, 00:16:09.331 "hosts": [] 00:16:09.331 }, 00:16:09.331 { 00:16:09.331 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:09.331 "subtype": "NVMe", 00:16:09.331 "listen_addresses": [ 00:16:09.331 { 00:16:09.331 "transport": "VFIOUSER", 00:16:09.331 "trtype": "VFIOUSER", 00:16:09.331 "adrfam": "IPv4", 00:16:09.331 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:09.331 "trsvcid": "0" 00:16:09.331 } 00:16:09.331 ], 00:16:09.331 "allow_any_host": true, 00:16:09.331 "hosts": [], 00:16:09.331 "serial_number": "SPDK1", 00:16:09.331 "model_number": "SPDK bdev Controller", 00:16:09.331 "max_namespaces": 32, 00:16:09.331 "min_cntlid": 1, 00:16:09.331 "max_cntlid": 65519, 00:16:09.331 "namespaces": [ 00:16:09.331 { 00:16:09.331 "nsid": 1, 00:16:09.331 "bdev_name": "Malloc1", 00:16:09.331 "name": "Malloc1", 00:16:09.331 "nguid": "B43FE023719B434185A3FA5C7AF529B7", 00:16:09.331 "uuid": "b43fe023-719b-4341-85a3-fa5c7af529b7" 00:16:09.331 }, 00:16:09.331 { 00:16:09.331 "nsid": 2, 00:16:09.331 "bdev_name": "Malloc3", 00:16:09.331 "name": "Malloc3", 00:16:09.331 "nguid": "AA416BD340E84771AAF75315F600464A", 00:16:09.331 "uuid": "aa416bd3-40e8-4771-aaf7-5315f600464a" 00:16:09.331 } 00:16:09.331 ] 00:16:09.331 }, 00:16:09.331 { 00:16:09.331 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:09.331 "subtype": "NVMe", 00:16:09.331 "listen_addresses": [ 00:16:09.331 { 00:16:09.331 "transport": "VFIOUSER", 00:16:09.331 "trtype": "VFIOUSER", 00:16:09.331 "adrfam": "IPv4", 00:16:09.331 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:09.331 "trsvcid": "0" 00:16:09.331 } 00:16:09.331 ], 00:16:09.331 "allow_any_host": true, 00:16:09.331 "hosts": [], 00:16:09.331 "serial_number": "SPDK2", 00:16:09.331 "model_number": "SPDK bdev Controller", 00:16:09.331 "max_namespaces": 32, 00:16:09.331 "min_cntlid": 1, 00:16:09.331 "max_cntlid": 65519, 00:16:09.331 "namespaces": [ 00:16:09.331 { 00:16:09.331 "nsid": 1, 00:16:09.331 "bdev_name": "Malloc2", 00:16:09.331 "name": "Malloc2", 00:16:09.331 "nguid": "2A3772393AE74ED8B44595F92082652E", 00:16:09.331 "uuid": "2a377239-3ae7-4ed8-b445-95f92082652e" 00:16:09.331 } 00:16:09.331 ] 00:16:09.331 } 00:16:09.331 ] 00:16:09.331 05:12:10 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:09.331 05:12:10 -- target/nvmf_vfio_user.sh@34 -- # aerpid=3276377 00:16:09.331 05:12:10 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:16:09.331 05:12:10 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:09.331 05:12:10 -- common/autotest_common.sh@1254 -- # local i=0 00:16:09.331 05:12:10 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:09.331 05:12:10 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:09.331 05:12:10 -- common/autotest_common.sh@1265 -- # return 0 00:16:09.331 05:12:10 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:09.331 05:12:10 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:16:09.331 EAL: No free 2048 kB hugepages reported on node 1 00:16:09.589 Malloc4 00:16:09.589 05:12:11 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:09.847 05:12:11 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:09.847 Asynchronous Event Request test 00:16:09.847 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:09.847 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:09.847 Registering asynchronous event callbacks... 00:16:09.847 Starting namespace attribute notice tests for all controllers... 00:16:09.847 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:09.847 aer_cb - Changed Namespace 00:16:09.847 Cleaning up... 00:16:10.109 [ 00:16:10.109 { 00:16:10.109 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:10.109 "subtype": "Discovery", 00:16:10.109 "listen_addresses": [], 00:16:10.109 "allow_any_host": true, 00:16:10.109 "hosts": [] 00:16:10.109 }, 00:16:10.109 { 00:16:10.109 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:10.109 "subtype": "NVMe", 00:16:10.109 "listen_addresses": [ 00:16:10.109 { 00:16:10.109 "transport": "VFIOUSER", 00:16:10.109 "trtype": "VFIOUSER", 00:16:10.109 "adrfam": "IPv4", 00:16:10.109 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:10.109 "trsvcid": "0" 00:16:10.109 } 00:16:10.109 ], 00:16:10.109 "allow_any_host": true, 00:16:10.109 "hosts": [], 00:16:10.109 "serial_number": "SPDK1", 00:16:10.109 "model_number": "SPDK bdev Controller", 00:16:10.109 "max_namespaces": 32, 00:16:10.109 "min_cntlid": 1, 00:16:10.109 "max_cntlid": 65519, 00:16:10.109 "namespaces": [ 00:16:10.109 { 00:16:10.109 "nsid": 1, 00:16:10.109 "bdev_name": "Malloc1", 00:16:10.109 "name": "Malloc1", 00:16:10.109 "nguid": "B43FE023719B434185A3FA5C7AF529B7", 00:16:10.109 "uuid": "b43fe023-719b-4341-85a3-fa5c7af529b7" 00:16:10.109 }, 00:16:10.109 { 00:16:10.109 "nsid": 2, 00:16:10.109 "bdev_name": "Malloc3", 00:16:10.109 "name": "Malloc3", 00:16:10.109 "nguid": "AA416BD340E84771AAF75315F600464A", 00:16:10.109 "uuid": "aa416bd3-40e8-4771-aaf7-5315f600464a" 00:16:10.109 } 00:16:10.109 ] 00:16:10.109 }, 00:16:10.109 { 00:16:10.109 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:10.109 "subtype": "NVMe", 00:16:10.109 "listen_addresses": [ 00:16:10.109 { 00:16:10.109 "transport": "VFIOUSER", 00:16:10.109 "trtype": "VFIOUSER", 00:16:10.109 "adrfam": "IPv4", 00:16:10.109 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:10.109 "trsvcid": "0" 00:16:10.109 } 00:16:10.109 ], 00:16:10.109 "allow_any_host": true, 00:16:10.109 "hosts": [], 00:16:10.109 "serial_number": "SPDK2", 00:16:10.109 "model_number": "SPDK bdev Controller", 00:16:10.109 "max_namespaces": 32, 00:16:10.109 "min_cntlid": 1, 00:16:10.109 "max_cntlid": 65519, 00:16:10.109 "namespaces": [ 00:16:10.109 { 00:16:10.109 "nsid": 1, 00:16:10.109 "bdev_name": "Malloc2", 00:16:10.109 "name": "Malloc2", 00:16:10.109 "nguid": "2A3772393AE74ED8B44595F92082652E", 00:16:10.109 "uuid": "2a377239-3ae7-4ed8-b445-95f92082652e" 00:16:10.109 }, 00:16:10.109 { 00:16:10.109 "nsid": 2, 00:16:10.109 "bdev_name": "Malloc4", 00:16:10.109 "name": "Malloc4", 00:16:10.109 "nguid": "FA4C7E7EFA924B02877EA07710E54561", 00:16:10.109 "uuid": "fa4c7e7e-fa92-4b02-877e-a07710e54561" 00:16:10.109 } 00:16:10.109 ] 00:16:10.109 } 00:16:10.109 ] 00:16:10.109 05:12:11 -- target/nvmf_vfio_user.sh@44 -- # wait 3276377 00:16:10.109 05:12:11 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:16:10.109 05:12:11 -- target/nvmf_vfio_user.sh@95 -- # killprocess 3269857 00:16:10.109 05:12:11 -- common/autotest_common.sh@936 -- # '[' -z 3269857 ']' 00:16:10.109 05:12:11 -- common/autotest_common.sh@940 -- # kill -0 3269857 00:16:10.109 05:12:11 -- common/autotest_common.sh@941 -- # uname 00:16:10.109 05:12:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:10.109 05:12:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3269857 00:16:10.109 05:12:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:10.109 05:12:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:10.109 05:12:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3269857' 00:16:10.109 killing process with pid 3269857 00:16:10.109 05:12:11 -- common/autotest_common.sh@955 -- # kill 3269857 00:16:10.109 [2024-11-26 05:12:11.711380] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:16:10.109 05:12:11 -- common/autotest_common.sh@960 -- # wait 3269857 00:16:10.368 05:12:12 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:10.368 05:12:12 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:10.368 05:12:12 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:16:10.368 05:12:12 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:16:10.368 05:12:12 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:16:10.368 05:12:12 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=3276523 00:16:10.368 05:12:12 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:16:10.368 05:12:12 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 3276523' 00:16:10.368 Process pid: 3276523 00:16:10.368 05:12:12 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:10.368 05:12:12 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 3276523 00:16:10.368 05:12:12 -- common/autotest_common.sh@829 -- # '[' -z 3276523 ']' 00:16:10.368 05:12:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:10.368 05:12:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:10.368 05:12:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:10.368 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:10.368 05:12:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:10.368 05:12:12 -- common/autotest_common.sh@10 -- # set +x 00:16:10.368 [2024-11-26 05:12:12.092391] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:16:10.368 [2024-11-26 05:12:12.093370] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:10.368 [2024-11-26 05:12:12.093427] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:10.368 EAL: No free 2048 kB hugepages reported on node 1 00:16:10.627 [2024-11-26 05:12:12.163053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:10.627 [2024-11-26 05:12:12.253081] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:10.627 [2024-11-26 05:12:12.253233] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:10.627 [2024-11-26 05:12:12.253251] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:10.627 [2024-11-26 05:12:12.253264] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:10.627 [2024-11-26 05:12:12.253316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:10.627 [2024-11-26 05:12:12.253357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:10.627 [2024-11-26 05:12:12.253452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:10.627 [2024-11-26 05:12:12.253454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:10.627 [2024-11-26 05:12:12.350030] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:16:10.627 [2024-11-26 05:12:12.350267] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:16:10.627 [2024-11-26 05:12:12.350558] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:16:10.627 [2024-11-26 05:12:12.351328] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:16:10.627 [2024-11-26 05:12:12.351444] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:16:11.566 05:12:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:11.566 05:12:13 -- common/autotest_common.sh@862 -- # return 0 00:16:11.566 05:12:13 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:12.504 05:12:14 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:12.762 05:12:14 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:12.762 05:12:14 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:12.762 05:12:14 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:12.762 05:12:14 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:12.762 05:12:14 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:13.021 Malloc1 00:16:13.021 05:12:14 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:13.279 05:12:14 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:13.537 05:12:15 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:13.795 05:12:15 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:13.795 05:12:15 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:13.795 05:12:15 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:14.054 Malloc2 00:16:14.054 05:12:15 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:14.312 05:12:15 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:14.571 05:12:16 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:14.831 05:12:16 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:14.831 05:12:16 -- target/nvmf_vfio_user.sh@95 -- # killprocess 3276523 00:16:14.831 05:12:16 -- common/autotest_common.sh@936 -- # '[' -z 3276523 ']' 00:16:14.831 05:12:16 -- common/autotest_common.sh@940 -- # kill -0 3276523 00:16:14.831 05:12:16 -- common/autotest_common.sh@941 -- # uname 00:16:14.831 05:12:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:14.831 05:12:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3276523 00:16:14.831 05:12:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:14.831 05:12:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:14.831 05:12:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3276523' 00:16:14.831 killing process with pid 3276523 00:16:14.831 05:12:16 -- common/autotest_common.sh@955 -- # kill 3276523 00:16:14.831 05:12:16 -- common/autotest_common.sh@960 -- # wait 3276523 00:16:15.092 05:12:16 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:15.092 05:12:16 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:15.092 00:16:15.092 real 0m54.632s 00:16:15.092 user 3m36.076s 00:16:15.092 sys 0m4.443s 00:16:15.092 05:12:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:15.092 05:12:16 -- common/autotest_common.sh@10 -- # set +x 00:16:15.092 ************************************ 00:16:15.092 END TEST nvmf_vfio_user 00:16:15.092 ************************************ 00:16:15.092 05:12:16 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:15.092 05:12:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:15.092 05:12:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:15.092 05:12:16 -- common/autotest_common.sh@10 -- # set +x 00:16:15.092 ************************************ 00:16:15.092 START TEST nvmf_vfio_user_nvme_compliance 00:16:15.092 ************************************ 00:16:15.092 05:12:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:15.092 * Looking for test storage... 00:16:15.092 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:15.092 05:12:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:15.092 05:12:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:15.092 05:12:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:15.353 05:12:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:15.353 05:12:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:15.353 05:12:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:15.353 05:12:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:15.353 05:12:16 -- scripts/common.sh@335 -- # IFS=.-: 00:16:15.353 05:12:16 -- scripts/common.sh@335 -- # read -ra ver1 00:16:15.353 05:12:16 -- scripts/common.sh@336 -- # IFS=.-: 00:16:15.353 05:12:16 -- scripts/common.sh@336 -- # read -ra ver2 00:16:15.353 05:12:16 -- scripts/common.sh@337 -- # local 'op=<' 00:16:15.353 05:12:16 -- scripts/common.sh@339 -- # ver1_l=2 00:16:15.353 05:12:16 -- scripts/common.sh@340 -- # ver2_l=1 00:16:15.353 05:12:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:15.353 05:12:16 -- scripts/common.sh@343 -- # case "$op" in 00:16:15.353 05:12:16 -- scripts/common.sh@344 -- # : 1 00:16:15.353 05:12:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:15.353 05:12:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:15.353 05:12:16 -- scripts/common.sh@364 -- # decimal 1 00:16:15.353 05:12:16 -- scripts/common.sh@352 -- # local d=1 00:16:15.353 05:12:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:15.353 05:12:16 -- scripts/common.sh@354 -- # echo 1 00:16:15.353 05:12:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:15.353 05:12:16 -- scripts/common.sh@365 -- # decimal 2 00:16:15.353 05:12:16 -- scripts/common.sh@352 -- # local d=2 00:16:15.353 05:12:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:15.353 05:12:16 -- scripts/common.sh@354 -- # echo 2 00:16:15.353 05:12:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:15.353 05:12:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:15.353 05:12:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:15.353 05:12:16 -- scripts/common.sh@367 -- # return 0 00:16:15.353 05:12:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:15.353 05:12:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:15.353 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:15.353 --rc genhtml_branch_coverage=1 00:16:15.353 --rc genhtml_function_coverage=1 00:16:15.353 --rc genhtml_legend=1 00:16:15.353 --rc geninfo_all_blocks=1 00:16:15.353 --rc geninfo_unexecuted_blocks=1 00:16:15.353 00:16:15.353 ' 00:16:15.353 05:12:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:15.353 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:15.353 --rc genhtml_branch_coverage=1 00:16:15.353 --rc genhtml_function_coverage=1 00:16:15.353 --rc genhtml_legend=1 00:16:15.353 --rc geninfo_all_blocks=1 00:16:15.353 --rc geninfo_unexecuted_blocks=1 00:16:15.353 00:16:15.353 ' 00:16:15.353 05:12:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:15.353 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:15.353 --rc genhtml_branch_coverage=1 00:16:15.353 --rc genhtml_function_coverage=1 00:16:15.353 --rc genhtml_legend=1 00:16:15.353 --rc geninfo_all_blocks=1 00:16:15.353 --rc geninfo_unexecuted_blocks=1 00:16:15.353 00:16:15.353 ' 00:16:15.353 05:12:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:15.353 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:15.353 --rc genhtml_branch_coverage=1 00:16:15.353 --rc genhtml_function_coverage=1 00:16:15.353 --rc genhtml_legend=1 00:16:15.353 --rc geninfo_all_blocks=1 00:16:15.353 --rc geninfo_unexecuted_blocks=1 00:16:15.353 00:16:15.353 ' 00:16:15.353 05:12:16 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:15.353 05:12:16 -- nvmf/common.sh@7 -- # uname -s 00:16:15.353 05:12:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:15.353 05:12:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:15.353 05:12:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:15.353 05:12:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:15.353 05:12:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:15.353 05:12:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:15.353 05:12:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:15.353 05:12:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:15.353 05:12:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:15.353 05:12:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:15.353 05:12:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:15.353 05:12:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:15.353 05:12:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:15.353 05:12:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:15.353 05:12:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:15.353 05:12:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:15.353 05:12:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:15.353 05:12:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:15.354 05:12:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:15.354 05:12:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:15.354 05:12:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:15.354 05:12:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:15.354 05:12:16 -- paths/export.sh@5 -- # export PATH 00:16:15.354 05:12:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:15.354 05:12:16 -- nvmf/common.sh@46 -- # : 0 00:16:15.354 05:12:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:15.354 05:12:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:15.354 05:12:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:15.354 05:12:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:15.354 05:12:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:15.354 05:12:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:15.354 05:12:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:15.354 05:12:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:15.354 05:12:16 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:15.354 05:12:16 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:15.354 05:12:16 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:15.354 05:12:16 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:15.354 05:12:16 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:15.354 05:12:16 -- compliance/compliance.sh@20 -- # nvmfpid=3277159 00:16:15.354 05:12:16 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:15.354 05:12:16 -- compliance/compliance.sh@21 -- # echo 'Process pid: 3277159' 00:16:15.354 Process pid: 3277159 00:16:15.354 05:12:16 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:15.354 05:12:16 -- compliance/compliance.sh@24 -- # waitforlisten 3277159 00:16:15.354 05:12:16 -- common/autotest_common.sh@829 -- # '[' -z 3277159 ']' 00:16:15.354 05:12:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:15.354 05:12:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:15.354 05:12:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:15.354 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:15.354 05:12:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:15.354 05:12:16 -- common/autotest_common.sh@10 -- # set +x 00:16:15.354 [2024-11-26 05:12:16.927014] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:15.354 [2024-11-26 05:12:16.927123] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:15.354 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.354 [2024-11-26 05:12:16.989059] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:15.354 [2024-11-26 05:12:17.078120] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:15.354 [2024-11-26 05:12:17.078278] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:15.354 [2024-11-26 05:12:17.078298] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:15.354 [2024-11-26 05:12:17.078312] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:15.354 [2024-11-26 05:12:17.078386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:15.354 [2024-11-26 05:12:17.078462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:15.354 [2024-11-26 05:12:17.078465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:16.293 05:12:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:16.293 05:12:17 -- common/autotest_common.sh@862 -- # return 0 00:16:16.293 05:12:17 -- compliance/compliance.sh@26 -- # sleep 1 00:16:17.231 05:12:18 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:17.231 05:12:18 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:17.231 05:12:18 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:17.231 05:12:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.231 05:12:18 -- common/autotest_common.sh@10 -- # set +x 00:16:17.231 05:12:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.231 05:12:18 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:17.231 05:12:18 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:17.231 05:12:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.231 05:12:18 -- common/autotest_common.sh@10 -- # set +x 00:16:17.231 malloc0 00:16:17.231 05:12:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.231 05:12:18 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:17.231 05:12:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.231 05:12:18 -- common/autotest_common.sh@10 -- # set +x 00:16:17.490 05:12:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.490 05:12:18 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:17.490 05:12:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.490 05:12:18 -- common/autotest_common.sh@10 -- # set +x 00:16:17.490 05:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.490 05:12:19 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:17.490 05:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.490 05:12:19 -- common/autotest_common.sh@10 -- # set +x 00:16:17.490 05:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.490 05:12:19 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:17.490 EAL: No free 2048 kB hugepages reported on node 1 00:16:17.490 00:16:17.490 00:16:17.490 CUnit - A unit testing framework for C - Version 2.1-3 00:16:17.490 http://cunit.sourceforge.net/ 00:16:17.490 00:16:17.490 00:16:17.490 Suite: nvme_compliance 00:16:17.490 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-26 05:12:19.158429] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:17.490 [2024-11-26 05:12:19.158472] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:17.490 [2024-11-26 05:12:19.158499] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:17.490 passed 00:16:17.750 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:17.750 Test: admin_identify_ns ...[2024-11-26 05:12:19.395719] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:17.750 [2024-11-26 05:12:19.403700] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:17.750 passed 00:16:18.013 Test: admin_get_features_mandatory_features ...passed 00:16:18.013 Test: admin_get_features_optional_features ...passed 00:16:18.271 Test: admin_set_features_number_of_queues ...passed 00:16:18.271 Test: admin_get_log_page_mandatory_logs ...passed 00:16:18.271 Test: admin_get_log_page_with_lpo ...[2024-11-26 05:12:20.025708] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:18.530 passed 00:16:18.530 Test: fabric_property_get ...passed 00:16:18.530 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-26 05:12:20.217476] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:18.530 passed 00:16:18.790 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-26 05:12:20.387711] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:18.790 [2024-11-26 05:12:20.403727] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:18.790 passed 00:16:18.790 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-26 05:12:20.490507] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:18.790 passed 00:16:19.051 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-26 05:12:20.651713] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:19.051 [2024-11-26 05:12:20.675701] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:19.051 passed 00:16:19.051 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-26 05:12:20.767999] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:19.051 [2024-11-26 05:12:20.768055] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:19.051 passed 00:16:19.312 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-26 05:12:20.946712] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:19.312 [2024-11-26 05:12:20.954724] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:19.312 [2024-11-26 05:12:20.962707] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:19.312 [2024-11-26 05:12:20.970698] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:19.312 passed 00:16:19.572 Test: admin_create_io_sq_verify_pc ...[2024-11-26 05:12:21.099725] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:19.572 passed 00:16:20.951 Test: admin_create_io_qp_max_qps ...[2024-11-26 05:12:22.306703] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:21.209 passed 00:16:21.209 Test: admin_create_io_sq_shared_cq ...[2024-11-26 05:12:22.906696] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:21.468 passed 00:16:21.468 00:16:21.468 Run Summary: Type Total Ran Passed Failed Inactive 00:16:21.468 suites 1 1 n/a 0 0 00:16:21.468 tests 18 18 18 0 0 00:16:21.468 asserts 360 360 360 0 n/a 00:16:21.468 00:16:21.468 Elapsed time = 1.571 seconds 00:16:21.468 05:12:22 -- compliance/compliance.sh@42 -- # killprocess 3277159 00:16:21.468 05:12:22 -- common/autotest_common.sh@936 -- # '[' -z 3277159 ']' 00:16:21.469 05:12:22 -- common/autotest_common.sh@940 -- # kill -0 3277159 00:16:21.469 05:12:22 -- common/autotest_common.sh@941 -- # uname 00:16:21.469 05:12:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:21.469 05:12:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3277159 00:16:21.469 05:12:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:21.469 05:12:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:21.469 05:12:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3277159' 00:16:21.469 killing process with pid 3277159 00:16:21.469 05:12:23 -- common/autotest_common.sh@955 -- # kill 3277159 00:16:21.469 05:12:23 -- common/autotest_common.sh@960 -- # wait 3277159 00:16:21.728 05:12:23 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:21.728 05:12:23 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:21.728 00:16:21.728 real 0m6.520s 00:16:21.728 user 0m18.602s 00:16:21.728 sys 0m0.586s 00:16:21.728 05:12:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:21.728 05:12:23 -- common/autotest_common.sh@10 -- # set +x 00:16:21.728 ************************************ 00:16:21.728 END TEST nvmf_vfio_user_nvme_compliance 00:16:21.728 ************************************ 00:16:21.728 05:12:23 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:21.728 05:12:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:21.728 05:12:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:21.728 05:12:23 -- common/autotest_common.sh@10 -- # set +x 00:16:21.728 ************************************ 00:16:21.728 START TEST nvmf_vfio_user_fuzz 00:16:21.728 ************************************ 00:16:21.728 05:12:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:21.728 * Looking for test storage... 00:16:21.728 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:21.728 05:12:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:21.728 05:12:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:21.728 05:12:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:21.728 05:12:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:21.728 05:12:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:21.728 05:12:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:21.728 05:12:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:21.728 05:12:23 -- scripts/common.sh@335 -- # IFS=.-: 00:16:21.728 05:12:23 -- scripts/common.sh@335 -- # read -ra ver1 00:16:21.728 05:12:23 -- scripts/common.sh@336 -- # IFS=.-: 00:16:21.729 05:12:23 -- scripts/common.sh@336 -- # read -ra ver2 00:16:21.729 05:12:23 -- scripts/common.sh@337 -- # local 'op=<' 00:16:21.729 05:12:23 -- scripts/common.sh@339 -- # ver1_l=2 00:16:21.729 05:12:23 -- scripts/common.sh@340 -- # ver2_l=1 00:16:21.729 05:12:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:21.729 05:12:23 -- scripts/common.sh@343 -- # case "$op" in 00:16:21.729 05:12:23 -- scripts/common.sh@344 -- # : 1 00:16:21.729 05:12:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:21.729 05:12:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:21.729 05:12:23 -- scripts/common.sh@364 -- # decimal 1 00:16:21.729 05:12:23 -- scripts/common.sh@352 -- # local d=1 00:16:21.729 05:12:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:21.729 05:12:23 -- scripts/common.sh@354 -- # echo 1 00:16:21.729 05:12:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:21.729 05:12:23 -- scripts/common.sh@365 -- # decimal 2 00:16:21.729 05:12:23 -- scripts/common.sh@352 -- # local d=2 00:16:21.729 05:12:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:21.729 05:12:23 -- scripts/common.sh@354 -- # echo 2 00:16:21.729 05:12:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:21.729 05:12:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:21.729 05:12:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:21.729 05:12:23 -- scripts/common.sh@367 -- # return 0 00:16:21.729 05:12:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:21.729 05:12:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:21.729 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.729 --rc genhtml_branch_coverage=1 00:16:21.729 --rc genhtml_function_coverage=1 00:16:21.729 --rc genhtml_legend=1 00:16:21.729 --rc geninfo_all_blocks=1 00:16:21.729 --rc geninfo_unexecuted_blocks=1 00:16:21.729 00:16:21.729 ' 00:16:21.729 05:12:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:21.729 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.729 --rc genhtml_branch_coverage=1 00:16:21.729 --rc genhtml_function_coverage=1 00:16:21.729 --rc genhtml_legend=1 00:16:21.729 --rc geninfo_all_blocks=1 00:16:21.729 --rc geninfo_unexecuted_blocks=1 00:16:21.729 00:16:21.729 ' 00:16:21.729 05:12:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:21.729 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.729 --rc genhtml_branch_coverage=1 00:16:21.729 --rc genhtml_function_coverage=1 00:16:21.729 --rc genhtml_legend=1 00:16:21.729 --rc geninfo_all_blocks=1 00:16:21.729 --rc geninfo_unexecuted_blocks=1 00:16:21.729 00:16:21.729 ' 00:16:21.729 05:12:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:21.729 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.729 --rc genhtml_branch_coverage=1 00:16:21.729 --rc genhtml_function_coverage=1 00:16:21.729 --rc genhtml_legend=1 00:16:21.729 --rc geninfo_all_blocks=1 00:16:21.729 --rc geninfo_unexecuted_blocks=1 00:16:21.729 00:16:21.729 ' 00:16:21.729 05:12:23 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:21.729 05:12:23 -- nvmf/common.sh@7 -- # uname -s 00:16:21.729 05:12:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:21.729 05:12:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:21.729 05:12:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:21.729 05:12:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:21.729 05:12:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:21.729 05:12:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:21.729 05:12:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:21.729 05:12:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:21.729 05:12:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:21.729 05:12:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:21.729 05:12:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:21.729 05:12:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:21.729 05:12:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:21.729 05:12:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:21.729 05:12:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:21.729 05:12:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:21.729 05:12:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:21.729 05:12:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:21.729 05:12:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:21.729 05:12:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:21.729 05:12:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:21.729 05:12:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:21.729 05:12:23 -- paths/export.sh@5 -- # export PATH 00:16:21.729 05:12:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:21.729 05:12:23 -- nvmf/common.sh@46 -- # : 0 00:16:21.729 05:12:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:21.729 05:12:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:21.729 05:12:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:21.729 05:12:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:21.729 05:12:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:21.729 05:12:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:21.729 05:12:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:21.729 05:12:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:21.729 05:12:23 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:21.729 05:12:23 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:21.729 05:12:23 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:21.729 05:12:23 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:21.729 05:12:23 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:21.729 05:12:23 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:21.729 05:12:23 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:21.729 05:12:23 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=3278034 00:16:21.729 05:12:23 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:21.729 05:12:23 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 3278034' 00:16:21.729 Process pid: 3278034 00:16:21.729 05:12:23 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:21.729 05:12:23 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 3278034 00:16:21.729 05:12:23 -- common/autotest_common.sh@829 -- # '[' -z 3278034 ']' 00:16:21.729 05:12:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:21.729 05:12:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:21.729 05:12:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:21.729 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:21.729 05:12:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:21.729 05:12:23 -- common/autotest_common.sh@10 -- # set +x 00:16:23.108 05:12:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:23.108 05:12:24 -- common/autotest_common.sh@862 -- # return 0 00:16:23.108 05:12:24 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:24.048 05:12:25 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:24.048 05:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.048 05:12:25 -- common/autotest_common.sh@10 -- # set +x 00:16:24.048 05:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.048 05:12:25 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:24.048 05:12:25 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:24.048 05:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.048 05:12:25 -- common/autotest_common.sh@10 -- # set +x 00:16:24.048 malloc0 00:16:24.048 05:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.048 05:12:25 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:24.048 05:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.048 05:12:25 -- common/autotest_common.sh@10 -- # set +x 00:16:24.048 05:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.048 05:12:25 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:24.048 05:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.048 05:12:25 -- common/autotest_common.sh@10 -- # set +x 00:16:24.048 05:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.048 05:12:25 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:24.048 05:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.048 05:12:25 -- common/autotest_common.sh@10 -- # set +x 00:16:24.048 05:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.048 05:12:25 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:24.048 05:12:25 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:16:56.199 Fuzzing completed. Shutting down the fuzz application 00:16:56.199 00:16:56.199 Dumping successful admin opcodes: 00:16:56.199 8, 9, 10, 24, 00:16:56.199 Dumping successful io opcodes: 00:16:56.199 0, 00:16:56.199 NS: 0x200003a1ef00 I/O qp, Total commands completed: 594907, total successful commands: 2298, random_seed: 4092541696 00:16:56.199 NS: 0x200003a1ef00 admin qp, Total commands completed: 147864, total successful commands: 1193, random_seed: 398570688 00:16:56.199 05:12:55 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:16:56.199 05:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:56.199 05:12:55 -- common/autotest_common.sh@10 -- # set +x 00:16:56.199 05:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:56.199 05:12:56 -- target/vfio_user_fuzz.sh@46 -- # killprocess 3278034 00:16:56.199 05:12:56 -- common/autotest_common.sh@936 -- # '[' -z 3278034 ']' 00:16:56.199 05:12:56 -- common/autotest_common.sh@940 -- # kill -0 3278034 00:16:56.200 05:12:56 -- common/autotest_common.sh@941 -- # uname 00:16:56.200 05:12:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:56.200 05:12:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3278034 00:16:56.200 05:12:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:56.200 05:12:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:56.200 05:12:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3278034' 00:16:56.200 killing process with pid 3278034 00:16:56.200 05:12:56 -- common/autotest_common.sh@955 -- # kill 3278034 00:16:56.200 05:12:56 -- common/autotest_common.sh@960 -- # wait 3278034 00:16:56.200 05:12:56 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:16:56.200 05:12:56 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:16:56.200 00:16:56.200 real 0m33.062s 00:16:56.200 user 0m34.955s 00:16:56.200 sys 0m26.537s 00:16:56.200 05:12:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:56.200 05:12:56 -- common/autotest_common.sh@10 -- # set +x 00:16:56.200 ************************************ 00:16:56.200 END TEST nvmf_vfio_user_fuzz 00:16:56.200 ************************************ 00:16:56.200 05:12:56 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:56.200 05:12:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:56.200 05:12:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:56.200 05:12:56 -- common/autotest_common.sh@10 -- # set +x 00:16:56.200 ************************************ 00:16:56.200 START TEST nvmf_host_management 00:16:56.200 ************************************ 00:16:56.200 05:12:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:56.200 * Looking for test storage... 00:16:56.200 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:56.200 05:12:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:56.200 05:12:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:56.200 05:12:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:56.200 05:12:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:56.200 05:12:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:56.200 05:12:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:56.200 05:12:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:56.200 05:12:56 -- scripts/common.sh@335 -- # IFS=.-: 00:16:56.200 05:12:56 -- scripts/common.sh@335 -- # read -ra ver1 00:16:56.200 05:12:56 -- scripts/common.sh@336 -- # IFS=.-: 00:16:56.200 05:12:56 -- scripts/common.sh@336 -- # read -ra ver2 00:16:56.200 05:12:56 -- scripts/common.sh@337 -- # local 'op=<' 00:16:56.200 05:12:56 -- scripts/common.sh@339 -- # ver1_l=2 00:16:56.200 05:12:56 -- scripts/common.sh@340 -- # ver2_l=1 00:16:56.200 05:12:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:56.200 05:12:56 -- scripts/common.sh@343 -- # case "$op" in 00:16:56.200 05:12:56 -- scripts/common.sh@344 -- # : 1 00:16:56.200 05:12:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:56.200 05:12:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:56.200 05:12:56 -- scripts/common.sh@364 -- # decimal 1 00:16:56.200 05:12:56 -- scripts/common.sh@352 -- # local d=1 00:16:56.200 05:12:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:56.200 05:12:56 -- scripts/common.sh@354 -- # echo 1 00:16:56.200 05:12:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:56.200 05:12:56 -- scripts/common.sh@365 -- # decimal 2 00:16:56.200 05:12:56 -- scripts/common.sh@352 -- # local d=2 00:16:56.200 05:12:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:56.200 05:12:56 -- scripts/common.sh@354 -- # echo 2 00:16:56.200 05:12:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:56.200 05:12:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:56.200 05:12:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:56.200 05:12:56 -- scripts/common.sh@367 -- # return 0 00:16:56.200 05:12:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:56.200 05:12:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:56.200 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:56.200 --rc genhtml_branch_coverage=1 00:16:56.200 --rc genhtml_function_coverage=1 00:16:56.200 --rc genhtml_legend=1 00:16:56.200 --rc geninfo_all_blocks=1 00:16:56.200 --rc geninfo_unexecuted_blocks=1 00:16:56.200 00:16:56.200 ' 00:16:56.200 05:12:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:56.200 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:56.200 --rc genhtml_branch_coverage=1 00:16:56.200 --rc genhtml_function_coverage=1 00:16:56.200 --rc genhtml_legend=1 00:16:56.200 --rc geninfo_all_blocks=1 00:16:56.200 --rc geninfo_unexecuted_blocks=1 00:16:56.200 00:16:56.200 ' 00:16:56.200 05:12:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:56.200 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:56.200 --rc genhtml_branch_coverage=1 00:16:56.200 --rc genhtml_function_coverage=1 00:16:56.200 --rc genhtml_legend=1 00:16:56.200 --rc geninfo_all_blocks=1 00:16:56.200 --rc geninfo_unexecuted_blocks=1 00:16:56.200 00:16:56.200 ' 00:16:56.200 05:12:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:56.200 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:56.200 --rc genhtml_branch_coverage=1 00:16:56.200 --rc genhtml_function_coverage=1 00:16:56.200 --rc genhtml_legend=1 00:16:56.200 --rc geninfo_all_blocks=1 00:16:56.200 --rc geninfo_unexecuted_blocks=1 00:16:56.200 00:16:56.200 ' 00:16:56.200 05:12:56 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:56.200 05:12:56 -- nvmf/common.sh@7 -- # uname -s 00:16:56.200 05:12:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:56.200 05:12:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:56.200 05:12:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:56.200 05:12:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:56.200 05:12:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:56.200 05:12:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:56.200 05:12:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:56.200 05:12:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:56.200 05:12:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:56.200 05:12:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:56.200 05:12:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:56.200 05:12:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:56.200 05:12:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:56.200 05:12:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:56.200 05:12:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:56.200 05:12:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:56.200 05:12:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:56.200 05:12:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:56.200 05:12:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:56.200 05:12:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:56.201 05:12:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:56.201 05:12:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:56.201 05:12:56 -- paths/export.sh@5 -- # export PATH 00:16:56.201 05:12:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:56.201 05:12:56 -- nvmf/common.sh@46 -- # : 0 00:16:56.201 05:12:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:56.201 05:12:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:56.201 05:12:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:56.201 05:12:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:56.201 05:12:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:56.201 05:12:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:56.201 05:12:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:56.201 05:12:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:56.201 05:12:56 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:56.201 05:12:56 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:56.201 05:12:56 -- target/host_management.sh@104 -- # nvmftestinit 00:16:56.201 05:12:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:56.201 05:12:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:56.201 05:12:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:56.201 05:12:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:56.201 05:12:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:56.201 05:12:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:56.201 05:12:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:56.201 05:12:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:56.201 05:12:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:56.201 05:12:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:56.201 05:12:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:56.201 05:12:56 -- common/autotest_common.sh@10 -- # set +x 00:16:56.768 05:12:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:56.768 05:12:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:56.768 05:12:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:56.769 05:12:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:56.769 05:12:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:56.769 05:12:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:56.769 05:12:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:56.769 05:12:58 -- nvmf/common.sh@294 -- # net_devs=() 00:16:56.769 05:12:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:56.769 05:12:58 -- nvmf/common.sh@295 -- # e810=() 00:16:56.769 05:12:58 -- nvmf/common.sh@295 -- # local -ga e810 00:16:56.769 05:12:58 -- nvmf/common.sh@296 -- # x722=() 00:16:56.769 05:12:58 -- nvmf/common.sh@296 -- # local -ga x722 00:16:56.769 05:12:58 -- nvmf/common.sh@297 -- # mlx=() 00:16:56.769 05:12:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:56.769 05:12:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:56.769 05:12:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:56.769 05:12:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:56.769 05:12:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:56.769 05:12:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:56.769 05:12:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:56.769 05:12:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:56.769 05:12:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:56.769 05:12:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:56.769 05:12:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:56.769 05:12:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:56.769 05:12:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:56.769 05:12:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:56.769 05:12:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:56.769 05:12:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:56.769 05:12:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:56.769 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:56.769 05:12:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:56.769 05:12:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:56.769 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:56.769 05:12:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:56.769 05:12:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:56.769 05:12:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:56.769 05:12:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:56.769 05:12:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:56.769 05:12:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:56.769 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:56.769 05:12:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:56.769 05:12:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:56.769 05:12:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:56.769 05:12:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:56.769 05:12:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:56.769 05:12:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:56.769 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:56.769 05:12:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:56.769 05:12:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:56.769 05:12:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:56.769 05:12:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:56.769 05:12:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:56.769 05:12:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:56.769 05:12:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:56.769 05:12:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:56.769 05:12:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:56.769 05:12:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:56.769 05:12:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:56.769 05:12:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:56.769 05:12:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:56.769 05:12:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:56.769 05:12:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:56.769 05:12:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:56.769 05:12:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:56.769 05:12:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:56.769 05:12:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:56.769 05:12:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:56.769 05:12:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:56.769 05:12:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:57.030 05:12:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:57.030 05:12:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:57.030 05:12:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:57.030 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:57.030 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:16:57.030 00:16:57.030 --- 10.0.0.2 ping statistics --- 00:16:57.030 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:57.030 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:16:57.030 05:12:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:57.030 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:57.030 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.174 ms 00:16:57.030 00:16:57.030 --- 10.0.0.1 ping statistics --- 00:16:57.030 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:57.030 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:16:57.030 05:12:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:57.030 05:12:58 -- nvmf/common.sh@410 -- # return 0 00:16:57.030 05:12:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:57.030 05:12:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:57.030 05:12:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:57.030 05:12:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:57.030 05:12:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:57.030 05:12:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:57.030 05:12:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:57.030 05:12:58 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:16:57.030 05:12:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:16:57.030 05:12:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:57.030 05:12:58 -- common/autotest_common.sh@10 -- # set +x 00:16:57.030 ************************************ 00:16:57.030 START TEST nvmf_host_management 00:16:57.030 ************************************ 00:16:57.030 05:12:58 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:16:57.030 05:12:58 -- target/host_management.sh@69 -- # starttarget 00:16:57.030 05:12:58 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:16:57.030 05:12:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:57.030 05:12:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:57.030 05:12:58 -- common/autotest_common.sh@10 -- # set +x 00:16:57.030 05:12:58 -- nvmf/common.sh@469 -- # nvmfpid=3283742 00:16:57.030 05:12:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:16:57.030 05:12:58 -- nvmf/common.sh@470 -- # waitforlisten 3283742 00:16:57.030 05:12:58 -- common/autotest_common.sh@829 -- # '[' -z 3283742 ']' 00:16:57.030 05:12:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:57.030 05:12:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:57.030 05:12:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:57.030 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:57.030 05:12:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:57.030 05:12:58 -- common/autotest_common.sh@10 -- # set +x 00:16:57.030 [2024-11-26 05:12:58.646552] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:57.030 [2024-11-26 05:12:58.646641] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:57.030 EAL: No free 2048 kB hugepages reported on node 1 00:16:57.030 [2024-11-26 05:12:58.712882] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:57.290 [2024-11-26 05:12:58.802143] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:57.290 [2024-11-26 05:12:58.802306] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:57.290 [2024-11-26 05:12:58.802324] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:57.290 [2024-11-26 05:12:58.802351] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:57.290 [2024-11-26 05:12:58.802457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:57.290 [2024-11-26 05:12:58.804705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:57.290 [2024-11-26 05:12:58.804768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:57.290 [2024-11-26 05:12:58.804772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:58.227 05:12:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:58.227 05:12:59 -- common/autotest_common.sh@862 -- # return 0 00:16:58.227 05:12:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:58.227 05:12:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:58.227 05:12:59 -- common/autotest_common.sh@10 -- # set +x 00:16:58.227 05:12:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:58.227 05:12:59 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:58.227 05:12:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:58.227 05:12:59 -- common/autotest_common.sh@10 -- # set +x 00:16:58.227 [2024-11-26 05:12:59.664355] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:58.227 05:12:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:58.227 05:12:59 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:16:58.227 05:12:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:58.227 05:12:59 -- common/autotest_common.sh@10 -- # set +x 00:16:58.227 05:12:59 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:58.227 05:12:59 -- target/host_management.sh@23 -- # cat 00:16:58.227 05:12:59 -- target/host_management.sh@30 -- # rpc_cmd 00:16:58.227 05:12:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:58.227 05:12:59 -- common/autotest_common.sh@10 -- # set +x 00:16:58.227 Malloc0 00:16:58.227 [2024-11-26 05:12:59.723411] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:58.227 05:12:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:58.227 05:12:59 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:16:58.227 05:12:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:58.227 05:12:59 -- common/autotest_common.sh@10 -- # set +x 00:16:58.227 05:12:59 -- target/host_management.sh@73 -- # perfpid=3283922 00:16:58.227 05:12:59 -- target/host_management.sh@74 -- # waitforlisten 3283922 /var/tmp/bdevperf.sock 00:16:58.227 05:12:59 -- common/autotest_common.sh@829 -- # '[' -z 3283922 ']' 00:16:58.227 05:12:59 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:16:58.227 05:12:59 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:16:58.227 05:12:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:58.227 05:12:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:58.227 05:12:59 -- nvmf/common.sh@520 -- # config=() 00:16:58.227 05:12:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:58.227 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:58.227 05:12:59 -- nvmf/common.sh@520 -- # local subsystem config 00:16:58.227 05:12:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:58.227 05:12:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:58.227 05:12:59 -- common/autotest_common.sh@10 -- # set +x 00:16:58.227 05:12:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:58.227 { 00:16:58.227 "params": { 00:16:58.227 "name": "Nvme$subsystem", 00:16:58.227 "trtype": "$TEST_TRANSPORT", 00:16:58.227 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:58.227 "adrfam": "ipv4", 00:16:58.227 "trsvcid": "$NVMF_PORT", 00:16:58.227 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:58.227 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:58.227 "hdgst": ${hdgst:-false}, 00:16:58.227 "ddgst": ${ddgst:-false} 00:16:58.227 }, 00:16:58.227 "method": "bdev_nvme_attach_controller" 00:16:58.227 } 00:16:58.227 EOF 00:16:58.227 )") 00:16:58.227 05:12:59 -- nvmf/common.sh@542 -- # cat 00:16:58.227 05:12:59 -- nvmf/common.sh@544 -- # jq . 00:16:58.227 05:12:59 -- nvmf/common.sh@545 -- # IFS=, 00:16:58.227 05:12:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:58.227 "params": { 00:16:58.227 "name": "Nvme0", 00:16:58.227 "trtype": "tcp", 00:16:58.227 "traddr": "10.0.0.2", 00:16:58.227 "adrfam": "ipv4", 00:16:58.227 "trsvcid": "4420", 00:16:58.227 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:58.227 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:58.227 "hdgst": false, 00:16:58.227 "ddgst": false 00:16:58.227 }, 00:16:58.227 "method": "bdev_nvme_attach_controller" 00:16:58.227 }' 00:16:58.227 [2024-11-26 05:12:59.792615] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:58.227 [2024-11-26 05:12:59.792716] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3283922 ] 00:16:58.227 EAL: No free 2048 kB hugepages reported on node 1 00:16:58.227 [2024-11-26 05:12:59.855585] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:58.227 [2024-11-26 05:12:59.940371] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:58.488 Running I/O for 10 seconds... 00:16:59.056 05:13:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:59.056 05:13:00 -- common/autotest_common.sh@862 -- # return 0 00:16:59.056 05:13:00 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:16:59.056 05:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:59.056 05:13:00 -- common/autotest_common.sh@10 -- # set +x 00:16:59.056 05:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:59.056 05:13:00 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:59.056 05:13:00 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:16:59.056 05:13:00 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:16:59.056 05:13:00 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:16:59.056 05:13:00 -- target/host_management.sh@52 -- # local ret=1 00:16:59.056 05:13:00 -- target/host_management.sh@53 -- # local i 00:16:59.056 05:13:00 -- target/host_management.sh@54 -- # (( i = 10 )) 00:16:59.056 05:13:00 -- target/host_management.sh@54 -- # (( i != 0 )) 00:16:59.056 05:13:00 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:16:59.056 05:13:00 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:16:59.056 05:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:59.056 05:13:00 -- common/autotest_common.sh@10 -- # set +x 00:16:59.056 05:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:59.314 05:13:00 -- target/host_management.sh@55 -- # read_io_count=2656 00:16:59.314 05:13:00 -- target/host_management.sh@58 -- # '[' 2656 -ge 100 ']' 00:16:59.314 05:13:00 -- target/host_management.sh@59 -- # ret=0 00:16:59.314 05:13:00 -- target/host_management.sh@60 -- # break 00:16:59.314 05:13:00 -- target/host_management.sh@64 -- # return 0 00:16:59.314 05:13:00 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:59.314 05:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:59.314 05:13:00 -- common/autotest_common.sh@10 -- # set +x 00:16:59.314 [2024-11-26 05:13:00.827536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.827999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.828010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.828023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.828034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.828054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.828067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.828094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.828108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b16f40 is same with the state(5) to be set 00:16:59.314 [2024-11-26 05:13:00.828294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:99200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.314 [2024-11-26 05:13:00.828337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.314 [2024-11-26 05:13:00.828366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:99456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.314 [2024-11-26 05:13:00.828384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.314 [2024-11-26 05:13:00.828401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:99584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.314 [2024-11-26 05:13:00.828417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.314 [2024-11-26 05:13:00.828434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:99712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.314 [2024-11-26 05:13:00.828449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.314 [2024-11-26 05:13:00.828464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:99840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.314 [2024-11-26 05:13:00.828479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.314 [2024-11-26 05:13:00.828512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:99968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.314 [2024-11-26 05:13:00.828527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.314 [2024-11-26 05:13:00.828543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:100096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.314 [2024-11-26 05:13:00.828557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.314 [2024-11-26 05:13:00.828572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:100480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.314 [2024-11-26 05:13:00.828586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.314 [2024-11-26 05:13:00.828607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:100608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.828622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.828637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:100736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.828651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.828681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:100864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.828709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.828738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:94592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.828753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.828769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:94848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.828783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.828800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:95360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.828814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.828830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:100992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.828845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.828861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:101120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.828875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.828893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:101248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.828910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.828927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:101376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.828942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.828959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:101504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.828973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:101632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:101760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:101888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:102016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:102144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:102272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:102400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:102528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:102656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:102784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:102912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:103040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:103168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:103296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:95488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:103424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:103552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:95872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:96384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:96768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:96896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:103680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:103808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:97024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:97152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:103936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:104064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:104192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:97408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.829969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:97536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.829983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:97664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:97920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:98176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:104320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:98304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:104448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:104576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:104704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:98432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:104832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:104960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:105088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:105216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:98560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:98688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:59.315 [2024-11-26 05:13:00.830471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830565] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1facf30 was disconnected and freed. reset controller. 00:16:59.315 [2024-11-26 05:13:00.830650] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:16:59.315 [2024-11-26 05:13:00.830675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830701] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:16:59.315 [2024-11-26 05:13:00.830729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830745] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:16:59.315 [2024-11-26 05:13:00.830760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830776] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:16:59.315 [2024-11-26 05:13:00.830790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:59.315 [2024-11-26 05:13:00.830805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1faf870 is same with the state(5) to be set 00:16:59.315 05:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:59.315 05:13:00 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:59.315 [2024-11-26 05:13:00.831959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:16:59.315 05:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:59.315 05:13:00 -- common/autotest_common.sh@10 -- # set +x 00:16:59.315 task offset: 99200 on job bdev=Nvme0n1 fails 00:16:59.315 00:16:59.315 Latency(us) 00:16:59.315 [2024-11-26T04:13:01.083Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:59.315 [2024-11-26T04:13:01.083Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:59.315 [2024-11-26T04:13:01.083Z] Job: Nvme0n1 ended in about 0.71 seconds with error 00:16:59.315 Verification LBA range: start 0x0 length 0x400 00:16:59.315 Nvme0n1 : 0.71 3937.78 246.11 89.78 0.00 15655.92 2900.57 23204.60 00:16:59.315 [2024-11-26T04:13:01.083Z] =================================================================================================================== 00:16:59.315 [2024-11-26T04:13:01.083Z] Total : 3937.78 246.11 89.78 0.00 15655.92 2900.57 23204.60 00:16:59.315 [2024-11-26 05:13:00.833859] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:16:59.315 [2024-11-26 05:13:00.833888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1faf870 (9): Bad file descriptor 00:16:59.315 05:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:59.315 05:13:00 -- target/host_management.sh@87 -- # sleep 1 00:16:59.315 [2024-11-26 05:13:00.884815] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:00.256 05:13:01 -- target/host_management.sh@91 -- # kill -9 3283922 00:17:00.256 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3283922) - No such process 00:17:00.256 05:13:01 -- target/host_management.sh@91 -- # true 00:17:00.256 05:13:01 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:00.256 05:13:01 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:00.256 05:13:01 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:00.256 05:13:01 -- nvmf/common.sh@520 -- # config=() 00:17:00.256 05:13:01 -- nvmf/common.sh@520 -- # local subsystem config 00:17:00.256 05:13:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:00.256 05:13:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:00.256 { 00:17:00.256 "params": { 00:17:00.256 "name": "Nvme$subsystem", 00:17:00.256 "trtype": "$TEST_TRANSPORT", 00:17:00.256 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:00.256 "adrfam": "ipv4", 00:17:00.256 "trsvcid": "$NVMF_PORT", 00:17:00.256 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:00.256 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:00.256 "hdgst": ${hdgst:-false}, 00:17:00.256 "ddgst": ${ddgst:-false} 00:17:00.256 }, 00:17:00.256 "method": "bdev_nvme_attach_controller" 00:17:00.256 } 00:17:00.256 EOF 00:17:00.256 )") 00:17:00.257 05:13:01 -- nvmf/common.sh@542 -- # cat 00:17:00.257 05:13:01 -- nvmf/common.sh@544 -- # jq . 00:17:00.257 05:13:01 -- nvmf/common.sh@545 -- # IFS=, 00:17:00.257 05:13:01 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:00.257 "params": { 00:17:00.257 "name": "Nvme0", 00:17:00.257 "trtype": "tcp", 00:17:00.257 "traddr": "10.0.0.2", 00:17:00.257 "adrfam": "ipv4", 00:17:00.257 "trsvcid": "4420", 00:17:00.257 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:00.257 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:00.257 "hdgst": false, 00:17:00.257 "ddgst": false 00:17:00.257 }, 00:17:00.257 "method": "bdev_nvme_attach_controller" 00:17:00.257 }' 00:17:00.257 [2024-11-26 05:13:01.886389] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:00.257 [2024-11-26 05:13:01.886474] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3284206 ] 00:17:00.257 EAL: No free 2048 kB hugepages reported on node 1 00:17:00.257 [2024-11-26 05:13:01.948377] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:00.522 [2024-11-26 05:13:02.034441] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:00.781 Running I/O for 1 seconds... 00:17:01.722 00:17:01.722 Latency(us) 00:17:01.722 [2024-11-26T04:13:03.490Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:01.722 [2024-11-26T04:13:03.490Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:01.722 Verification LBA range: start 0x0 length 0x400 00:17:01.722 Nvme0n1 : 1.05 3870.62 241.91 0.00 0.00 15661.88 2815.62 43690.67 00:17:01.722 [2024-11-26T04:13:03.490Z] =================================================================================================================== 00:17:01.722 [2024-11-26T04:13:03.490Z] Total : 3870.62 241.91 0.00 0.00 15661.88 2815.62 43690.67 00:17:01.981 05:13:03 -- target/host_management.sh@101 -- # stoptarget 00:17:01.981 05:13:03 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:01.981 05:13:03 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:01.981 05:13:03 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:01.981 05:13:03 -- target/host_management.sh@40 -- # nvmftestfini 00:17:01.981 05:13:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:01.981 05:13:03 -- nvmf/common.sh@116 -- # sync 00:17:01.981 05:13:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:01.981 05:13:03 -- nvmf/common.sh@119 -- # set +e 00:17:01.981 05:13:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:01.981 05:13:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:01.981 rmmod nvme_tcp 00:17:01.981 rmmod nvme_fabrics 00:17:01.981 rmmod nvme_keyring 00:17:01.981 05:13:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:01.981 05:13:03 -- nvmf/common.sh@123 -- # set -e 00:17:01.981 05:13:03 -- nvmf/common.sh@124 -- # return 0 00:17:01.981 05:13:03 -- nvmf/common.sh@477 -- # '[' -n 3283742 ']' 00:17:01.981 05:13:03 -- nvmf/common.sh@478 -- # killprocess 3283742 00:17:01.981 05:13:03 -- common/autotest_common.sh@936 -- # '[' -z 3283742 ']' 00:17:01.981 05:13:03 -- common/autotest_common.sh@940 -- # kill -0 3283742 00:17:01.981 05:13:03 -- common/autotest_common.sh@941 -- # uname 00:17:01.981 05:13:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:01.981 05:13:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3283742 00:17:01.981 05:13:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:01.981 05:13:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:01.981 05:13:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3283742' 00:17:01.981 killing process with pid 3283742 00:17:01.981 05:13:03 -- common/autotest_common.sh@955 -- # kill 3283742 00:17:01.981 05:13:03 -- common/autotest_common.sh@960 -- # wait 3283742 00:17:02.241 [2024-11-26 05:13:03.926372] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:02.241 05:13:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:02.241 05:13:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:02.241 05:13:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:02.241 05:13:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:02.241 05:13:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:02.241 05:13:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:02.241 05:13:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:02.241 05:13:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:04.782 05:13:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:04.782 00:17:04.782 real 0m7.395s 00:17:04.782 user 0m23.301s 00:17:04.782 sys 0m1.399s 00:17:04.782 05:13:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:04.782 05:13:05 -- common/autotest_common.sh@10 -- # set +x 00:17:04.782 ************************************ 00:17:04.782 END TEST nvmf_host_management 00:17:04.782 ************************************ 00:17:04.782 05:13:06 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:17:04.782 00:17:04.782 real 0m9.642s 00:17:04.782 user 0m24.114s 00:17:04.782 sys 0m2.864s 00:17:04.782 05:13:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:04.782 05:13:06 -- common/autotest_common.sh@10 -- # set +x 00:17:04.782 ************************************ 00:17:04.782 END TEST nvmf_host_management 00:17:04.782 ************************************ 00:17:04.782 05:13:06 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:04.782 05:13:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:04.782 05:13:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:04.782 05:13:06 -- common/autotest_common.sh@10 -- # set +x 00:17:04.782 ************************************ 00:17:04.782 START TEST nvmf_lvol 00:17:04.782 ************************************ 00:17:04.782 05:13:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:04.782 * Looking for test storage... 00:17:04.782 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:04.782 05:13:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:04.782 05:13:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:04.782 05:13:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:04.782 05:13:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:04.782 05:13:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:04.782 05:13:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:04.782 05:13:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:04.782 05:13:06 -- scripts/common.sh@335 -- # IFS=.-: 00:17:04.782 05:13:06 -- scripts/common.sh@335 -- # read -ra ver1 00:17:04.782 05:13:06 -- scripts/common.sh@336 -- # IFS=.-: 00:17:04.782 05:13:06 -- scripts/common.sh@336 -- # read -ra ver2 00:17:04.782 05:13:06 -- scripts/common.sh@337 -- # local 'op=<' 00:17:04.782 05:13:06 -- scripts/common.sh@339 -- # ver1_l=2 00:17:04.782 05:13:06 -- scripts/common.sh@340 -- # ver2_l=1 00:17:04.782 05:13:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:04.782 05:13:06 -- scripts/common.sh@343 -- # case "$op" in 00:17:04.782 05:13:06 -- scripts/common.sh@344 -- # : 1 00:17:04.782 05:13:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:04.782 05:13:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:04.782 05:13:06 -- scripts/common.sh@364 -- # decimal 1 00:17:04.782 05:13:06 -- scripts/common.sh@352 -- # local d=1 00:17:04.782 05:13:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:04.782 05:13:06 -- scripts/common.sh@354 -- # echo 1 00:17:04.782 05:13:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:04.782 05:13:06 -- scripts/common.sh@365 -- # decimal 2 00:17:04.782 05:13:06 -- scripts/common.sh@352 -- # local d=2 00:17:04.782 05:13:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:04.782 05:13:06 -- scripts/common.sh@354 -- # echo 2 00:17:04.782 05:13:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:04.782 05:13:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:04.782 05:13:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:04.782 05:13:06 -- scripts/common.sh@367 -- # return 0 00:17:04.782 05:13:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:04.782 05:13:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:04.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.782 --rc genhtml_branch_coverage=1 00:17:04.782 --rc genhtml_function_coverage=1 00:17:04.782 --rc genhtml_legend=1 00:17:04.782 --rc geninfo_all_blocks=1 00:17:04.782 --rc geninfo_unexecuted_blocks=1 00:17:04.782 00:17:04.782 ' 00:17:04.782 05:13:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:04.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.782 --rc genhtml_branch_coverage=1 00:17:04.782 --rc genhtml_function_coverage=1 00:17:04.782 --rc genhtml_legend=1 00:17:04.782 --rc geninfo_all_blocks=1 00:17:04.782 --rc geninfo_unexecuted_blocks=1 00:17:04.782 00:17:04.782 ' 00:17:04.782 05:13:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:04.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.782 --rc genhtml_branch_coverage=1 00:17:04.782 --rc genhtml_function_coverage=1 00:17:04.782 --rc genhtml_legend=1 00:17:04.782 --rc geninfo_all_blocks=1 00:17:04.782 --rc geninfo_unexecuted_blocks=1 00:17:04.782 00:17:04.782 ' 00:17:04.782 05:13:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:04.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.782 --rc genhtml_branch_coverage=1 00:17:04.782 --rc genhtml_function_coverage=1 00:17:04.782 --rc genhtml_legend=1 00:17:04.782 --rc geninfo_all_blocks=1 00:17:04.782 --rc geninfo_unexecuted_blocks=1 00:17:04.782 00:17:04.782 ' 00:17:04.782 05:13:06 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:04.782 05:13:06 -- nvmf/common.sh@7 -- # uname -s 00:17:04.782 05:13:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:04.782 05:13:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:04.782 05:13:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:04.782 05:13:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:04.782 05:13:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:04.782 05:13:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:04.782 05:13:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:04.782 05:13:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:04.782 05:13:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:04.782 05:13:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:04.782 05:13:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:04.782 05:13:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:04.782 05:13:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:04.782 05:13:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:04.783 05:13:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:04.783 05:13:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:04.783 05:13:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:04.783 05:13:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:04.783 05:13:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:04.783 05:13:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.783 05:13:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.783 05:13:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.783 05:13:06 -- paths/export.sh@5 -- # export PATH 00:17:04.783 05:13:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.783 05:13:06 -- nvmf/common.sh@46 -- # : 0 00:17:04.783 05:13:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:04.783 05:13:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:04.783 05:13:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:04.783 05:13:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:04.783 05:13:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:04.783 05:13:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:04.783 05:13:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:04.783 05:13:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:04.783 05:13:06 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:04.783 05:13:06 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:04.783 05:13:06 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:04.783 05:13:06 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:04.783 05:13:06 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:04.783 05:13:06 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:04.783 05:13:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:04.783 05:13:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:04.783 05:13:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:04.783 05:13:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:04.783 05:13:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:04.783 05:13:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:04.783 05:13:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:04.783 05:13:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:04.783 05:13:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:04.783 05:13:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:04.783 05:13:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:04.783 05:13:06 -- common/autotest_common.sh@10 -- # set +x 00:17:06.686 05:13:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:06.686 05:13:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:06.686 05:13:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:06.686 05:13:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:06.686 05:13:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:06.686 05:13:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:06.686 05:13:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:06.686 05:13:08 -- nvmf/common.sh@294 -- # net_devs=() 00:17:06.686 05:13:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:06.686 05:13:08 -- nvmf/common.sh@295 -- # e810=() 00:17:06.686 05:13:08 -- nvmf/common.sh@295 -- # local -ga e810 00:17:06.686 05:13:08 -- nvmf/common.sh@296 -- # x722=() 00:17:06.686 05:13:08 -- nvmf/common.sh@296 -- # local -ga x722 00:17:06.686 05:13:08 -- nvmf/common.sh@297 -- # mlx=() 00:17:06.686 05:13:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:06.686 05:13:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:06.686 05:13:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:06.686 05:13:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:06.686 05:13:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:06.686 05:13:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:06.686 05:13:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:06.686 05:13:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:06.686 05:13:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:06.686 05:13:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:06.686 05:13:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:06.686 05:13:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:06.686 05:13:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:06.686 05:13:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:06.686 05:13:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:06.686 05:13:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:06.686 05:13:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:06.686 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:06.686 05:13:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:06.686 05:13:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:06.686 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:06.686 05:13:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:06.686 05:13:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:06.686 05:13:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:06.686 05:13:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:06.686 05:13:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:06.686 05:13:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:06.687 05:13:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:06.687 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:06.687 05:13:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:06.687 05:13:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:06.687 05:13:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:06.687 05:13:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:06.687 05:13:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:06.687 05:13:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:06.687 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:06.687 05:13:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:06.687 05:13:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:06.687 05:13:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:06.687 05:13:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:06.687 05:13:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:06.687 05:13:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:06.687 05:13:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:06.687 05:13:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:06.687 05:13:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:06.687 05:13:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:06.687 05:13:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:06.687 05:13:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:06.687 05:13:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:06.687 05:13:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:06.687 05:13:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:06.687 05:13:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:06.687 05:13:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:06.687 05:13:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:06.687 05:13:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:06.687 05:13:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:06.687 05:13:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:06.687 05:13:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:06.687 05:13:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:06.687 05:13:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:06.687 05:13:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:06.687 05:13:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:06.687 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:06.687 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:17:06.687 00:17:06.687 --- 10.0.0.2 ping statistics --- 00:17:06.687 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:06.687 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:17:06.687 05:13:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:06.687 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:06.687 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:17:06.687 00:17:06.687 --- 10.0.0.1 ping statistics --- 00:17:06.687 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:06.687 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:17:06.687 05:13:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:06.687 05:13:08 -- nvmf/common.sh@410 -- # return 0 00:17:06.687 05:13:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:06.687 05:13:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:06.687 05:13:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:06.687 05:13:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:06.687 05:13:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:06.687 05:13:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:06.687 05:13:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:06.687 05:13:08 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:06.687 05:13:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:06.687 05:13:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:06.687 05:13:08 -- common/autotest_common.sh@10 -- # set +x 00:17:06.687 05:13:08 -- nvmf/common.sh@469 -- # nvmfpid=3286326 00:17:06.687 05:13:08 -- nvmf/common.sh@470 -- # waitforlisten 3286326 00:17:06.687 05:13:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:06.687 05:13:08 -- common/autotest_common.sh@829 -- # '[' -z 3286326 ']' 00:17:06.687 05:13:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:06.687 05:13:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:06.687 05:13:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:06.687 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:06.687 05:13:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:06.687 05:13:08 -- common/autotest_common.sh@10 -- # set +x 00:17:06.687 [2024-11-26 05:13:08.356557] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:06.687 [2024-11-26 05:13:08.356630] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:06.687 EAL: No free 2048 kB hugepages reported on node 1 00:17:06.687 [2024-11-26 05:13:08.420122] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:06.947 [2024-11-26 05:13:08.503412] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:06.947 [2024-11-26 05:13:08.503574] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:06.947 [2024-11-26 05:13:08.503593] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:06.947 [2024-11-26 05:13:08.503606] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:06.947 [2024-11-26 05:13:08.503677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:06.947 [2024-11-26 05:13:08.507706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:06.947 [2024-11-26 05:13:08.507718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:07.884 05:13:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:07.884 05:13:09 -- common/autotest_common.sh@862 -- # return 0 00:17:07.884 05:13:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:07.884 05:13:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:07.884 05:13:09 -- common/autotest_common.sh@10 -- # set +x 00:17:07.884 05:13:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:07.884 05:13:09 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:07.884 [2024-11-26 05:13:09.622417] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:07.884 05:13:09 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:08.452 05:13:09 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:08.452 05:13:09 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:08.452 05:13:10 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:08.452 05:13:10 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:08.710 05:13:10 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:09.278 05:13:10 -- target/nvmf_lvol.sh@29 -- # lvs=07f5b935-4a76-48b8-a625-c0ba4ed017a6 00:17:09.278 05:13:10 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 07f5b935-4a76-48b8-a625-c0ba4ed017a6 lvol 20 00:17:09.278 05:13:10 -- target/nvmf_lvol.sh@32 -- # lvol=e0eba9c3-f587-42ac-8a02-9f4c3011062c 00:17:09.278 05:13:10 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:09.537 05:13:11 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 e0eba9c3-f587-42ac-8a02-9f4c3011062c 00:17:09.795 05:13:11 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:10.081 [2024-11-26 05:13:11.734578] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:10.081 05:13:11 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:10.340 05:13:12 -- target/nvmf_lvol.sh@42 -- # perf_pid=3286892 00:17:10.340 05:13:12 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:10.340 05:13:12 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:10.340 EAL: No free 2048 kB hugepages reported on node 1 00:17:11.277 05:13:13 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot e0eba9c3-f587-42ac-8a02-9f4c3011062c MY_SNAPSHOT 00:17:11.847 05:13:13 -- target/nvmf_lvol.sh@47 -- # snapshot=53bc24f1-fbce-4f2f-a3ed-7e5a52b9590b 00:17:11.847 05:13:13 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize e0eba9c3-f587-42ac-8a02-9f4c3011062c 30 00:17:12.106 05:13:13 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 53bc24f1-fbce-4f2f-a3ed-7e5a52b9590b MY_CLONE 00:17:12.365 05:13:13 -- target/nvmf_lvol.sh@49 -- # clone=6019acef-b2aa-4624-81b4-9e6cc8cdc518 00:17:12.365 05:13:13 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 6019acef-b2aa-4624-81b4-9e6cc8cdc518 00:17:12.932 05:13:14 -- target/nvmf_lvol.sh@53 -- # wait 3286892 00:17:21.053 Initializing NVMe Controllers 00:17:21.054 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:21.054 Controller IO queue size 128, less than required. 00:17:21.054 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:21.054 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:21.054 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:21.054 Initialization complete. Launching workers. 00:17:21.054 ======================================================== 00:17:21.054 Latency(us) 00:17:21.054 Device Information : IOPS MiB/s Average min max 00:17:21.054 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10257.00 40.07 12487.23 2110.85 74982.06 00:17:21.054 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10868.80 42.46 11785.56 1911.13 57704.91 00:17:21.054 ======================================================== 00:17:21.054 Total : 21125.80 82.52 12126.23 1911.13 74982.06 00:17:21.054 00:17:21.054 05:13:22 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:21.054 05:13:22 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete e0eba9c3-f587-42ac-8a02-9f4c3011062c 00:17:21.312 05:13:23 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 07f5b935-4a76-48b8-a625-c0ba4ed017a6 00:17:21.570 05:13:23 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:21.570 05:13:23 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:21.570 05:13:23 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:21.570 05:13:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:21.570 05:13:23 -- nvmf/common.sh@116 -- # sync 00:17:21.570 05:13:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:21.570 05:13:23 -- nvmf/common.sh@119 -- # set +e 00:17:21.570 05:13:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:21.570 05:13:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:21.570 rmmod nvme_tcp 00:17:21.570 rmmod nvme_fabrics 00:17:21.570 rmmod nvme_keyring 00:17:21.831 05:13:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:21.831 05:13:23 -- nvmf/common.sh@123 -- # set -e 00:17:21.831 05:13:23 -- nvmf/common.sh@124 -- # return 0 00:17:21.831 05:13:23 -- nvmf/common.sh@477 -- # '[' -n 3286326 ']' 00:17:21.831 05:13:23 -- nvmf/common.sh@478 -- # killprocess 3286326 00:17:21.831 05:13:23 -- common/autotest_common.sh@936 -- # '[' -z 3286326 ']' 00:17:21.831 05:13:23 -- common/autotest_common.sh@940 -- # kill -0 3286326 00:17:21.831 05:13:23 -- common/autotest_common.sh@941 -- # uname 00:17:21.831 05:13:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:21.831 05:13:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3286326 00:17:21.831 05:13:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:21.831 05:13:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:21.831 05:13:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3286326' 00:17:21.831 killing process with pid 3286326 00:17:21.831 05:13:23 -- common/autotest_common.sh@955 -- # kill 3286326 00:17:21.831 05:13:23 -- common/autotest_common.sh@960 -- # wait 3286326 00:17:22.091 05:13:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:22.091 05:13:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:22.091 05:13:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:22.091 05:13:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:22.091 05:13:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:22.091 05:13:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:22.091 05:13:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:22.091 05:13:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:23.998 05:13:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:23.998 00:17:23.998 real 0m19.645s 00:17:23.998 user 1m6.624s 00:17:23.998 sys 0m5.627s 00:17:23.998 05:13:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:23.998 05:13:25 -- common/autotest_common.sh@10 -- # set +x 00:17:23.998 ************************************ 00:17:23.998 END TEST nvmf_lvol 00:17:23.998 ************************************ 00:17:23.998 05:13:25 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:23.998 05:13:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:23.998 05:13:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:23.998 05:13:25 -- common/autotest_common.sh@10 -- # set +x 00:17:23.998 ************************************ 00:17:23.998 START TEST nvmf_lvs_grow 00:17:23.998 ************************************ 00:17:23.998 05:13:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:23.998 * Looking for test storage... 00:17:24.257 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:24.257 05:13:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:24.257 05:13:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:24.257 05:13:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:24.257 05:13:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:24.257 05:13:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:24.257 05:13:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:24.257 05:13:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:24.257 05:13:25 -- scripts/common.sh@335 -- # IFS=.-: 00:17:24.257 05:13:25 -- scripts/common.sh@335 -- # read -ra ver1 00:17:24.257 05:13:25 -- scripts/common.sh@336 -- # IFS=.-: 00:17:24.257 05:13:25 -- scripts/common.sh@336 -- # read -ra ver2 00:17:24.257 05:13:25 -- scripts/common.sh@337 -- # local 'op=<' 00:17:24.257 05:13:25 -- scripts/common.sh@339 -- # ver1_l=2 00:17:24.257 05:13:25 -- scripts/common.sh@340 -- # ver2_l=1 00:17:24.257 05:13:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:24.257 05:13:25 -- scripts/common.sh@343 -- # case "$op" in 00:17:24.257 05:13:25 -- scripts/common.sh@344 -- # : 1 00:17:24.257 05:13:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:24.257 05:13:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:24.257 05:13:25 -- scripts/common.sh@364 -- # decimal 1 00:17:24.257 05:13:25 -- scripts/common.sh@352 -- # local d=1 00:17:24.257 05:13:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:24.257 05:13:25 -- scripts/common.sh@354 -- # echo 1 00:17:24.257 05:13:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:24.257 05:13:25 -- scripts/common.sh@365 -- # decimal 2 00:17:24.257 05:13:25 -- scripts/common.sh@352 -- # local d=2 00:17:24.257 05:13:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:24.257 05:13:25 -- scripts/common.sh@354 -- # echo 2 00:17:24.257 05:13:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:24.257 05:13:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:24.257 05:13:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:24.257 05:13:25 -- scripts/common.sh@367 -- # return 0 00:17:24.257 05:13:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:24.257 05:13:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:24.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:24.257 --rc genhtml_branch_coverage=1 00:17:24.257 --rc genhtml_function_coverage=1 00:17:24.257 --rc genhtml_legend=1 00:17:24.257 --rc geninfo_all_blocks=1 00:17:24.257 --rc geninfo_unexecuted_blocks=1 00:17:24.257 00:17:24.257 ' 00:17:24.257 05:13:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:24.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:24.257 --rc genhtml_branch_coverage=1 00:17:24.257 --rc genhtml_function_coverage=1 00:17:24.257 --rc genhtml_legend=1 00:17:24.257 --rc geninfo_all_blocks=1 00:17:24.258 --rc geninfo_unexecuted_blocks=1 00:17:24.258 00:17:24.258 ' 00:17:24.258 05:13:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:24.258 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:24.258 --rc genhtml_branch_coverage=1 00:17:24.258 --rc genhtml_function_coverage=1 00:17:24.258 --rc genhtml_legend=1 00:17:24.258 --rc geninfo_all_blocks=1 00:17:24.258 --rc geninfo_unexecuted_blocks=1 00:17:24.258 00:17:24.258 ' 00:17:24.258 05:13:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:24.258 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:24.258 --rc genhtml_branch_coverage=1 00:17:24.258 --rc genhtml_function_coverage=1 00:17:24.258 --rc genhtml_legend=1 00:17:24.258 --rc geninfo_all_blocks=1 00:17:24.258 --rc geninfo_unexecuted_blocks=1 00:17:24.258 00:17:24.258 ' 00:17:24.258 05:13:25 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:24.258 05:13:25 -- nvmf/common.sh@7 -- # uname -s 00:17:24.258 05:13:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:24.258 05:13:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:24.258 05:13:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:24.258 05:13:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:24.258 05:13:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:24.258 05:13:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:24.258 05:13:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:24.258 05:13:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:24.258 05:13:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:24.258 05:13:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:24.258 05:13:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:24.258 05:13:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:24.258 05:13:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:24.258 05:13:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:24.258 05:13:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:24.258 05:13:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:24.258 05:13:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:24.258 05:13:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:24.258 05:13:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:24.258 05:13:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:24.258 05:13:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:24.258 05:13:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:24.258 05:13:25 -- paths/export.sh@5 -- # export PATH 00:17:24.258 05:13:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:24.258 05:13:25 -- nvmf/common.sh@46 -- # : 0 00:17:24.258 05:13:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:24.258 05:13:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:24.258 05:13:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:24.258 05:13:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:24.258 05:13:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:24.258 05:13:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:24.258 05:13:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:24.258 05:13:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:24.258 05:13:25 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:24.258 05:13:25 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:24.258 05:13:25 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:24.258 05:13:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:24.258 05:13:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:24.258 05:13:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:24.258 05:13:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:24.258 05:13:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:24.258 05:13:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:24.258 05:13:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:24.258 05:13:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:24.258 05:13:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:24.258 05:13:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:24.258 05:13:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:24.258 05:13:25 -- common/autotest_common.sh@10 -- # set +x 00:17:26.164 05:13:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:26.164 05:13:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:26.164 05:13:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:26.164 05:13:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:26.164 05:13:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:26.164 05:13:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:26.164 05:13:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:26.164 05:13:27 -- nvmf/common.sh@294 -- # net_devs=() 00:17:26.164 05:13:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:26.164 05:13:27 -- nvmf/common.sh@295 -- # e810=() 00:17:26.164 05:13:27 -- nvmf/common.sh@295 -- # local -ga e810 00:17:26.164 05:13:27 -- nvmf/common.sh@296 -- # x722=() 00:17:26.164 05:13:27 -- nvmf/common.sh@296 -- # local -ga x722 00:17:26.164 05:13:27 -- nvmf/common.sh@297 -- # mlx=() 00:17:26.164 05:13:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:26.164 05:13:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:26.164 05:13:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:26.164 05:13:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:26.164 05:13:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:26.164 05:13:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:26.164 05:13:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:26.164 05:13:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:26.164 05:13:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:26.164 05:13:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:26.164 05:13:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:26.164 05:13:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:26.164 05:13:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:26.164 05:13:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:26.164 05:13:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:26.164 05:13:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:26.164 05:13:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:26.164 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:26.164 05:13:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:26.164 05:13:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:26.164 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:26.164 05:13:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:26.164 05:13:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:26.164 05:13:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:26.164 05:13:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:26.164 05:13:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:26.164 05:13:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:26.164 05:13:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:26.164 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:26.164 05:13:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:26.164 05:13:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:26.164 05:13:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:26.165 05:13:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:26.165 05:13:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:26.165 05:13:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:26.165 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:26.165 05:13:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:26.165 05:13:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:26.165 05:13:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:26.165 05:13:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:26.165 05:13:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:26.165 05:13:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:26.165 05:13:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:26.165 05:13:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:26.165 05:13:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:26.165 05:13:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:26.165 05:13:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:26.165 05:13:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:26.165 05:13:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:26.165 05:13:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:26.165 05:13:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:26.165 05:13:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:26.165 05:13:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:26.165 05:13:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:26.165 05:13:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:26.165 05:13:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:26.165 05:13:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:26.425 05:13:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:26.425 05:13:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:26.425 05:13:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:26.425 05:13:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:26.425 05:13:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:26.425 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:26.425 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:17:26.425 00:17:26.425 --- 10.0.0.2 ping statistics --- 00:17:26.425 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:26.425 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:17:26.425 05:13:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:26.425 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:26.425 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:17:26.425 00:17:26.425 --- 10.0.0.1 ping statistics --- 00:17:26.425 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:26.425 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:17:26.425 05:13:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:26.425 05:13:27 -- nvmf/common.sh@410 -- # return 0 00:17:26.425 05:13:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:26.425 05:13:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:26.425 05:13:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:26.425 05:13:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:26.425 05:13:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:26.425 05:13:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:26.425 05:13:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:26.425 05:13:28 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:26.425 05:13:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:26.425 05:13:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:26.425 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:17:26.425 05:13:28 -- nvmf/common.sh@469 -- # nvmfpid=3290224 00:17:26.425 05:13:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:26.425 05:13:28 -- nvmf/common.sh@470 -- # waitforlisten 3290224 00:17:26.425 05:13:28 -- common/autotest_common.sh@829 -- # '[' -z 3290224 ']' 00:17:26.425 05:13:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:26.425 05:13:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:26.425 05:13:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:26.425 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:26.425 05:13:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:26.425 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:17:26.425 [2024-11-26 05:13:28.050192] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:26.426 [2024-11-26 05:13:28.050273] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:26.426 EAL: No free 2048 kB hugepages reported on node 1 00:17:26.426 [2024-11-26 05:13:28.114064] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:26.686 [2024-11-26 05:13:28.200976] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:26.686 [2024-11-26 05:13:28.201137] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:26.686 [2024-11-26 05:13:28.201154] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:26.686 [2024-11-26 05:13:28.201167] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:26.686 [2024-11-26 05:13:28.201219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:27.622 05:13:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:27.622 05:13:29 -- common/autotest_common.sh@862 -- # return 0 00:17:27.622 05:13:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:27.622 05:13:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:27.622 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:17:27.622 05:13:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:27.622 05:13:29 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:27.622 [2024-11-26 05:13:29.335919] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:27.622 05:13:29 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:27.622 05:13:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:27.622 05:13:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:27.622 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:17:27.622 ************************************ 00:17:27.622 START TEST lvs_grow_clean 00:17:27.622 ************************************ 00:17:27.622 05:13:29 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:27.622 05:13:29 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:27.622 05:13:29 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:27.622 05:13:29 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:27.622 05:13:29 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:27.622 05:13:29 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:27.622 05:13:29 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:27.622 05:13:29 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:27.622 05:13:29 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:27.622 05:13:29 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:28.188 05:13:29 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:28.188 05:13:29 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:28.448 05:13:29 -- target/nvmf_lvs_grow.sh@28 -- # lvs=f2cf9b59-9a22-4ea4-b5db-edf46294f653 00:17:28.448 05:13:29 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f2cf9b59-9a22-4ea4-b5db-edf46294f653 00:17:28.448 05:13:29 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:28.708 05:13:30 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:28.708 05:13:30 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:28.708 05:13:30 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u f2cf9b59-9a22-4ea4-b5db-edf46294f653 lvol 150 00:17:28.967 05:13:30 -- target/nvmf_lvs_grow.sh@33 -- # lvol=f44aa0cd-54ce-49f2-aabd-a998f438388f 00:17:28.967 05:13:30 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:28.967 05:13:30 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:28.967 [2024-11-26 05:13:30.730142] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:28.967 [2024-11-26 05:13:30.730238] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:29.225 true 00:17:29.225 05:13:30 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f2cf9b59-9a22-4ea4-b5db-edf46294f653 00:17:29.225 05:13:30 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:29.489 05:13:30 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:29.489 05:13:30 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:29.773 05:13:31 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 f44aa0cd-54ce-49f2-aabd-a998f438388f 00:17:29.773 05:13:31 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:30.049 [2024-11-26 05:13:31.757357] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:30.049 05:13:31 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:30.314 05:13:32 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3290686 00:17:30.314 05:13:32 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:30.314 05:13:32 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:30.314 05:13:32 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3290686 /var/tmp/bdevperf.sock 00:17:30.314 05:13:32 -- common/autotest_common.sh@829 -- # '[' -z 3290686 ']' 00:17:30.314 05:13:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:30.314 05:13:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:30.314 05:13:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:30.314 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:30.314 05:13:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:30.314 05:13:32 -- common/autotest_common.sh@10 -- # set +x 00:17:30.314 [2024-11-26 05:13:32.071300] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:30.314 [2024-11-26 05:13:32.071376] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3290686 ] 00:17:30.575 EAL: No free 2048 kB hugepages reported on node 1 00:17:30.575 [2024-11-26 05:13:32.132852] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:30.575 [2024-11-26 05:13:32.218692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:31.511 05:13:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:31.511 05:13:33 -- common/autotest_common.sh@862 -- # return 0 00:17:31.511 05:13:33 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:31.769 Nvme0n1 00:17:31.769 05:13:33 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:32.026 [ 00:17:32.026 { 00:17:32.026 "name": "Nvme0n1", 00:17:32.026 "aliases": [ 00:17:32.026 "f44aa0cd-54ce-49f2-aabd-a998f438388f" 00:17:32.026 ], 00:17:32.026 "product_name": "NVMe disk", 00:17:32.026 "block_size": 4096, 00:17:32.026 "num_blocks": 38912, 00:17:32.026 "uuid": "f44aa0cd-54ce-49f2-aabd-a998f438388f", 00:17:32.026 "assigned_rate_limits": { 00:17:32.026 "rw_ios_per_sec": 0, 00:17:32.026 "rw_mbytes_per_sec": 0, 00:17:32.026 "r_mbytes_per_sec": 0, 00:17:32.026 "w_mbytes_per_sec": 0 00:17:32.026 }, 00:17:32.026 "claimed": false, 00:17:32.026 "zoned": false, 00:17:32.026 "supported_io_types": { 00:17:32.026 "read": true, 00:17:32.026 "write": true, 00:17:32.026 "unmap": true, 00:17:32.026 "write_zeroes": true, 00:17:32.026 "flush": true, 00:17:32.026 "reset": true, 00:17:32.026 "compare": true, 00:17:32.026 "compare_and_write": true, 00:17:32.026 "abort": true, 00:17:32.026 "nvme_admin": true, 00:17:32.026 "nvme_io": true 00:17:32.026 }, 00:17:32.026 "driver_specific": { 00:17:32.026 "nvme": [ 00:17:32.026 { 00:17:32.026 "trid": { 00:17:32.026 "trtype": "TCP", 00:17:32.026 "adrfam": "IPv4", 00:17:32.026 "traddr": "10.0.0.2", 00:17:32.026 "trsvcid": "4420", 00:17:32.026 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:32.026 }, 00:17:32.026 "ctrlr_data": { 00:17:32.026 "cntlid": 1, 00:17:32.026 "vendor_id": "0x8086", 00:17:32.026 "model_number": "SPDK bdev Controller", 00:17:32.026 "serial_number": "SPDK0", 00:17:32.026 "firmware_revision": "24.01.1", 00:17:32.026 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:32.026 "oacs": { 00:17:32.026 "security": 0, 00:17:32.026 "format": 0, 00:17:32.026 "firmware": 0, 00:17:32.026 "ns_manage": 0 00:17:32.026 }, 00:17:32.026 "multi_ctrlr": true, 00:17:32.026 "ana_reporting": false 00:17:32.026 }, 00:17:32.026 "vs": { 00:17:32.026 "nvme_version": "1.3" 00:17:32.026 }, 00:17:32.026 "ns_data": { 00:17:32.026 "id": 1, 00:17:32.026 "can_share": true 00:17:32.026 } 00:17:32.026 } 00:17:32.026 ], 00:17:32.026 "mp_policy": "active_passive" 00:17:32.026 } 00:17:32.026 } 00:17:32.026 ] 00:17:32.026 05:13:33 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3290956 00:17:32.026 05:13:33 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:32.026 05:13:33 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:32.285 Running I/O for 10 seconds... 00:17:33.221 Latency(us) 00:17:33.221 [2024-11-26T04:13:34.989Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:33.221 [2024-11-26T04:13:34.989Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:33.221 Nvme0n1 : 1.00 14686.00 57.37 0.00 0.00 0.00 0.00 0.00 00:17:33.221 [2024-11-26T04:13:34.989Z] =================================================================================================================== 00:17:33.221 [2024-11-26T04:13:34.989Z] Total : 14686.00 57.37 0.00 0.00 0.00 0.00 0.00 00:17:33.221 00:17:34.149 05:13:35 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u f2cf9b59-9a22-4ea4-b5db-edf46294f653 00:17:34.149 [2024-11-26T04:13:35.917Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:34.149 Nvme0n1 : 2.00 14751.00 57.62 0.00 0.00 0.00 0.00 0.00 00:17:34.149 [2024-11-26T04:13:35.917Z] =================================================================================================================== 00:17:34.149 [2024-11-26T04:13:35.917Z] Total : 14751.00 57.62 0.00 0.00 0.00 0.00 0.00 00:17:34.149 00:17:34.404 true 00:17:34.404 05:13:35 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f2cf9b59-9a22-4ea4-b5db-edf46294f653 00:17:34.404 05:13:35 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:34.661 05:13:36 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:34.662 05:13:36 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:34.662 05:13:36 -- target/nvmf_lvs_grow.sh@65 -- # wait 3290956 00:17:35.227 [2024-11-26T04:13:36.995Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:35.227 Nvme0n1 : 3.00 14811.00 57.86 0.00 0.00 0.00 0.00 0.00 00:17:35.227 [2024-11-26T04:13:36.995Z] =================================================================================================================== 00:17:35.227 [2024-11-26T04:13:36.995Z] Total : 14811.00 57.86 0.00 0.00 0.00 0.00 0.00 00:17:35.227 00:17:36.174 [2024-11-26T04:13:37.942Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:36.174 Nvme0n1 : 4.00 14889.75 58.16 0.00 0.00 0.00 0.00 0.00 00:17:36.174 [2024-11-26T04:13:37.942Z] =================================================================================================================== 00:17:36.174 [2024-11-26T04:13:37.942Z] Total : 14889.75 58.16 0.00 0.00 0.00 0.00 0.00 00:17:36.174 00:17:37.114 [2024-11-26T04:13:38.882Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:37.114 Nvme0n1 : 5.00 15028.40 58.70 0.00 0.00 0.00 0.00 0.00 00:17:37.114 [2024-11-26T04:13:38.882Z] =================================================================================================================== 00:17:37.114 [2024-11-26T04:13:38.882Z] Total : 15028.40 58.70 0.00 0.00 0.00 0.00 0.00 00:17:37.114 00:17:38.491 [2024-11-26T04:13:40.259Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:38.491 Nvme0n1 : 6.00 15075.50 58.89 0.00 0.00 0.00 0.00 0.00 00:17:38.491 [2024-11-26T04:13:40.259Z] =================================================================================================================== 00:17:38.491 [2024-11-26T04:13:40.259Z] Total : 15075.50 58.89 0.00 0.00 0.00 0.00 0.00 00:17:38.491 00:17:39.432 [2024-11-26T04:13:41.200Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:39.432 Nvme0n1 : 7.00 15092.29 58.95 0.00 0.00 0.00 0.00 0.00 00:17:39.432 [2024-11-26T04:13:41.200Z] =================================================================================================================== 00:17:39.432 [2024-11-26T04:13:41.200Z] Total : 15092.29 58.95 0.00 0.00 0.00 0.00 0.00 00:17:39.432 00:17:40.371 [2024-11-26T04:13:42.139Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.371 Nvme0n1 : 8.00 15119.50 59.06 0.00 0.00 0.00 0.00 0.00 00:17:40.371 [2024-11-26T04:13:42.139Z] =================================================================================================================== 00:17:40.371 [2024-11-26T04:13:42.139Z] Total : 15119.50 59.06 0.00 0.00 0.00 0.00 0.00 00:17:40.371 00:17:41.309 [2024-11-26T04:13:43.077Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:41.309 Nvme0n1 : 9.00 15132.78 59.11 0.00 0.00 0.00 0.00 0.00 00:17:41.309 [2024-11-26T04:13:43.077Z] =================================================================================================================== 00:17:41.309 [2024-11-26T04:13:43.077Z] Total : 15132.78 59.11 0.00 0.00 0.00 0.00 0.00 00:17:41.309 00:17:42.249 [2024-11-26T04:13:44.017Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:42.249 Nvme0n1 : 10.00 15157.10 59.21 0.00 0.00 0.00 0.00 0.00 00:17:42.249 [2024-11-26T04:13:44.017Z] =================================================================================================================== 00:17:42.249 [2024-11-26T04:13:44.017Z] Total : 15157.10 59.21 0.00 0.00 0.00 0.00 0.00 00:17:42.249 00:17:42.249 00:17:42.249 Latency(us) 00:17:42.249 [2024-11-26T04:13:44.017Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:42.249 [2024-11-26T04:13:44.017Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:42.249 Nvme0n1 : 10.01 15157.11 59.21 0.00 0.00 8440.23 4757.43 17961.72 00:17:42.249 [2024-11-26T04:13:44.017Z] =================================================================================================================== 00:17:42.249 [2024-11-26T04:13:44.017Z] Total : 15157.11 59.21 0.00 0.00 8440.23 4757.43 17961.72 00:17:42.249 0 00:17:42.249 05:13:43 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3290686 00:17:42.249 05:13:43 -- common/autotest_common.sh@936 -- # '[' -z 3290686 ']' 00:17:42.249 05:13:43 -- common/autotest_common.sh@940 -- # kill -0 3290686 00:17:42.249 05:13:43 -- common/autotest_common.sh@941 -- # uname 00:17:42.249 05:13:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:42.249 05:13:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3290686 00:17:42.249 05:13:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:42.249 05:13:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:42.249 05:13:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3290686' 00:17:42.249 killing process with pid 3290686 00:17:42.249 05:13:43 -- common/autotest_common.sh@955 -- # kill 3290686 00:17:42.249 Received shutdown signal, test time was about 10.000000 seconds 00:17:42.249 00:17:42.249 Latency(us) 00:17:42.249 [2024-11-26T04:13:44.017Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:42.249 [2024-11-26T04:13:44.017Z] =================================================================================================================== 00:17:42.249 [2024-11-26T04:13:44.017Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:42.249 05:13:43 -- common/autotest_common.sh@960 -- # wait 3290686 00:17:42.508 05:13:44 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:42.767 05:13:44 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f2cf9b59-9a22-4ea4-b5db-edf46294f653 00:17:42.767 05:13:44 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:43.025 05:13:44 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:43.025 05:13:44 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:43.025 05:13:44 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:43.285 [2024-11-26 05:13:44.920484] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:43.285 05:13:44 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f2cf9b59-9a22-4ea4-b5db-edf46294f653 00:17:43.285 05:13:44 -- common/autotest_common.sh@650 -- # local es=0 00:17:43.285 05:13:44 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f2cf9b59-9a22-4ea4-b5db-edf46294f653 00:17:43.285 05:13:44 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:43.285 05:13:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:43.285 05:13:44 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:43.285 05:13:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:43.285 05:13:44 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:43.285 05:13:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:43.285 05:13:44 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:43.285 05:13:44 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:43.285 05:13:44 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f2cf9b59-9a22-4ea4-b5db-edf46294f653 00:17:43.545 request: 00:17:43.545 { 00:17:43.545 "uuid": "f2cf9b59-9a22-4ea4-b5db-edf46294f653", 00:17:43.545 "method": "bdev_lvol_get_lvstores", 00:17:43.545 "req_id": 1 00:17:43.545 } 00:17:43.545 Got JSON-RPC error response 00:17:43.545 response: 00:17:43.545 { 00:17:43.545 "code": -19, 00:17:43.545 "message": "No such device" 00:17:43.545 } 00:17:43.545 05:13:45 -- common/autotest_common.sh@653 -- # es=1 00:17:43.545 05:13:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:43.545 05:13:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:43.545 05:13:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:43.545 05:13:45 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:43.806 aio_bdev 00:17:43.806 05:13:45 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev f44aa0cd-54ce-49f2-aabd-a998f438388f 00:17:43.806 05:13:45 -- common/autotest_common.sh@897 -- # local bdev_name=f44aa0cd-54ce-49f2-aabd-a998f438388f 00:17:43.806 05:13:45 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:43.806 05:13:45 -- common/autotest_common.sh@899 -- # local i 00:17:43.806 05:13:45 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:43.806 05:13:45 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:43.806 05:13:45 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:44.064 05:13:45 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b f44aa0cd-54ce-49f2-aabd-a998f438388f -t 2000 00:17:44.323 [ 00:17:44.323 { 00:17:44.323 "name": "f44aa0cd-54ce-49f2-aabd-a998f438388f", 00:17:44.323 "aliases": [ 00:17:44.323 "lvs/lvol" 00:17:44.323 ], 00:17:44.323 "product_name": "Logical Volume", 00:17:44.323 "block_size": 4096, 00:17:44.323 "num_blocks": 38912, 00:17:44.323 "uuid": "f44aa0cd-54ce-49f2-aabd-a998f438388f", 00:17:44.323 "assigned_rate_limits": { 00:17:44.323 "rw_ios_per_sec": 0, 00:17:44.323 "rw_mbytes_per_sec": 0, 00:17:44.323 "r_mbytes_per_sec": 0, 00:17:44.323 "w_mbytes_per_sec": 0 00:17:44.323 }, 00:17:44.324 "claimed": false, 00:17:44.324 "zoned": false, 00:17:44.324 "supported_io_types": { 00:17:44.324 "read": true, 00:17:44.324 "write": true, 00:17:44.324 "unmap": true, 00:17:44.324 "write_zeroes": true, 00:17:44.324 "flush": false, 00:17:44.324 "reset": true, 00:17:44.324 "compare": false, 00:17:44.324 "compare_and_write": false, 00:17:44.324 "abort": false, 00:17:44.324 "nvme_admin": false, 00:17:44.324 "nvme_io": false 00:17:44.324 }, 00:17:44.324 "driver_specific": { 00:17:44.324 "lvol": { 00:17:44.324 "lvol_store_uuid": "f2cf9b59-9a22-4ea4-b5db-edf46294f653", 00:17:44.324 "base_bdev": "aio_bdev", 00:17:44.324 "thin_provision": false, 00:17:44.324 "snapshot": false, 00:17:44.324 "clone": false, 00:17:44.324 "esnap_clone": false 00:17:44.324 } 00:17:44.324 } 00:17:44.324 } 00:17:44.324 ] 00:17:44.324 05:13:45 -- common/autotest_common.sh@905 -- # return 0 00:17:44.324 05:13:45 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f2cf9b59-9a22-4ea4-b5db-edf46294f653 00:17:44.324 05:13:45 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:44.584 05:13:46 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:44.584 05:13:46 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f2cf9b59-9a22-4ea4-b5db-edf46294f653 00:17:44.584 05:13:46 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:44.845 05:13:46 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:44.845 05:13:46 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete f44aa0cd-54ce-49f2-aabd-a998f438388f 00:17:45.105 05:13:46 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u f2cf9b59-9a22-4ea4-b5db-edf46294f653 00:17:45.366 05:13:47 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:45.625 05:13:47 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:45.625 00:17:45.625 real 0m17.947s 00:17:45.625 user 0m17.718s 00:17:45.625 sys 0m1.835s 00:17:45.625 05:13:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:45.625 05:13:47 -- common/autotest_common.sh@10 -- # set +x 00:17:45.625 ************************************ 00:17:45.625 END TEST lvs_grow_clean 00:17:45.625 ************************************ 00:17:45.625 05:13:47 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:45.625 05:13:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:45.625 05:13:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:45.625 05:13:47 -- common/autotest_common.sh@10 -- # set +x 00:17:45.625 ************************************ 00:17:45.625 START TEST lvs_grow_dirty 00:17:45.625 ************************************ 00:17:45.625 05:13:47 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:17:45.625 05:13:47 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:45.625 05:13:47 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:45.625 05:13:47 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:45.625 05:13:47 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:45.625 05:13:47 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:45.625 05:13:47 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:45.625 05:13:47 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:45.625 05:13:47 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:45.625 05:13:47 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:46.193 05:13:47 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:46.193 05:13:47 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:46.193 05:13:47 -- target/nvmf_lvs_grow.sh@28 -- # lvs=7d182246-c7b6-4340-a89d-f292db4a392a 00:17:46.193 05:13:47 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7d182246-c7b6-4340-a89d-f292db4a392a 00:17:46.193 05:13:47 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:46.454 05:13:48 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:46.454 05:13:48 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:46.454 05:13:48 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 7d182246-c7b6-4340-a89d-f292db4a392a lvol 150 00:17:46.715 05:13:48 -- target/nvmf_lvs_grow.sh@33 -- # lvol=40f89e8f-c038-40c8-bfe0-6f580c56d254 00:17:46.715 05:13:48 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:46.715 05:13:48 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:46.975 [2024-11-26 05:13:48.663036] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:46.975 [2024-11-26 05:13:48.663124] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:46.975 true 00:17:46.975 05:13:48 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7d182246-c7b6-4340-a89d-f292db4a392a 00:17:46.975 05:13:48 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:47.234 05:13:48 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:47.234 05:13:48 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:47.492 05:13:49 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 40f89e8f-c038-40c8-bfe0-6f580c56d254 00:17:47.751 05:13:49 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:48.010 05:13:49 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:48.269 05:13:49 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3292921 00:17:48.269 05:13:49 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:48.269 05:13:49 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:48.269 05:13:49 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3292921 /var/tmp/bdevperf.sock 00:17:48.269 05:13:49 -- common/autotest_common.sh@829 -- # '[' -z 3292921 ']' 00:17:48.269 05:13:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:48.269 05:13:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:48.269 05:13:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:48.269 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:48.269 05:13:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:48.269 05:13:49 -- common/autotest_common.sh@10 -- # set +x 00:17:48.269 [2024-11-26 05:13:49.982573] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:48.269 [2024-11-26 05:13:49.982648] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3292921 ] 00:17:48.269 EAL: No free 2048 kB hugepages reported on node 1 00:17:48.527 [2024-11-26 05:13:50.049071] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:48.527 [2024-11-26 05:13:50.138885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:48.527 05:13:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:48.527 05:13:50 -- common/autotest_common.sh@862 -- # return 0 00:17:48.527 05:13:50 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:49.093 Nvme0n1 00:17:49.093 05:13:50 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:49.093 [ 00:17:49.093 { 00:17:49.093 "name": "Nvme0n1", 00:17:49.093 "aliases": [ 00:17:49.093 "40f89e8f-c038-40c8-bfe0-6f580c56d254" 00:17:49.093 ], 00:17:49.093 "product_name": "NVMe disk", 00:17:49.093 "block_size": 4096, 00:17:49.093 "num_blocks": 38912, 00:17:49.093 "uuid": "40f89e8f-c038-40c8-bfe0-6f580c56d254", 00:17:49.093 "assigned_rate_limits": { 00:17:49.093 "rw_ios_per_sec": 0, 00:17:49.093 "rw_mbytes_per_sec": 0, 00:17:49.093 "r_mbytes_per_sec": 0, 00:17:49.093 "w_mbytes_per_sec": 0 00:17:49.093 }, 00:17:49.093 "claimed": false, 00:17:49.093 "zoned": false, 00:17:49.093 "supported_io_types": { 00:17:49.093 "read": true, 00:17:49.093 "write": true, 00:17:49.093 "unmap": true, 00:17:49.093 "write_zeroes": true, 00:17:49.093 "flush": true, 00:17:49.093 "reset": true, 00:17:49.094 "compare": true, 00:17:49.094 "compare_and_write": true, 00:17:49.094 "abort": true, 00:17:49.094 "nvme_admin": true, 00:17:49.094 "nvme_io": true 00:17:49.094 }, 00:17:49.094 "driver_specific": { 00:17:49.094 "nvme": [ 00:17:49.094 { 00:17:49.094 "trid": { 00:17:49.094 "trtype": "TCP", 00:17:49.094 "adrfam": "IPv4", 00:17:49.094 "traddr": "10.0.0.2", 00:17:49.094 "trsvcid": "4420", 00:17:49.094 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:49.094 }, 00:17:49.094 "ctrlr_data": { 00:17:49.094 "cntlid": 1, 00:17:49.094 "vendor_id": "0x8086", 00:17:49.094 "model_number": "SPDK bdev Controller", 00:17:49.094 "serial_number": "SPDK0", 00:17:49.094 "firmware_revision": "24.01.1", 00:17:49.094 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:49.094 "oacs": { 00:17:49.094 "security": 0, 00:17:49.094 "format": 0, 00:17:49.094 "firmware": 0, 00:17:49.094 "ns_manage": 0 00:17:49.094 }, 00:17:49.094 "multi_ctrlr": true, 00:17:49.094 "ana_reporting": false 00:17:49.094 }, 00:17:49.094 "vs": { 00:17:49.094 "nvme_version": "1.3" 00:17:49.094 }, 00:17:49.094 "ns_data": { 00:17:49.094 "id": 1, 00:17:49.094 "can_share": true 00:17:49.094 } 00:17:49.094 } 00:17:49.094 ], 00:17:49.094 "mp_policy": "active_passive" 00:17:49.094 } 00:17:49.094 } 00:17:49.094 ] 00:17:49.355 05:13:50 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3293061 00:17:49.355 05:13:50 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:49.355 05:13:50 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:49.355 Running I/O for 10 seconds... 00:17:50.294 Latency(us) 00:17:50.294 [2024-11-26T04:13:52.062Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:50.294 [2024-11-26T04:13:52.062Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:50.294 Nvme0n1 : 1.00 14348.00 56.05 0.00 0.00 0.00 0.00 0.00 00:17:50.294 [2024-11-26T04:13:52.062Z] =================================================================================================================== 00:17:50.294 [2024-11-26T04:13:52.062Z] Total : 14348.00 56.05 0.00 0.00 0.00 0.00 0.00 00:17:50.294 00:17:51.227 05:13:52 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 7d182246-c7b6-4340-a89d-f292db4a392a 00:17:51.227 [2024-11-26T04:13:52.995Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:51.227 Nvme0n1 : 2.00 14610.50 57.07 0.00 0.00 0.00 0.00 0.00 00:17:51.227 [2024-11-26T04:13:52.995Z] =================================================================================================================== 00:17:51.227 [2024-11-26T04:13:52.995Z] Total : 14610.50 57.07 0.00 0.00 0.00 0.00 0.00 00:17:51.227 00:17:51.484 true 00:17:51.484 05:13:53 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7d182246-c7b6-4340-a89d-f292db4a392a 00:17:51.484 05:13:53 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:51.741 05:13:53 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:51.741 05:13:53 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:51.741 05:13:53 -- target/nvmf_lvs_grow.sh@65 -- # wait 3293061 00:17:52.309 [2024-11-26T04:13:54.077Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:52.309 Nvme0n1 : 3.00 14708.33 57.45 0.00 0.00 0.00 0.00 0.00 00:17:52.309 [2024-11-26T04:13:54.077Z] =================================================================================================================== 00:17:52.309 [2024-11-26T04:13:54.077Z] Total : 14708.33 57.45 0.00 0.00 0.00 0.00 0.00 00:17:52.309 00:17:53.247 [2024-11-26T04:13:55.015Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:53.247 Nvme0n1 : 4.00 14789.00 57.77 0.00 0.00 0.00 0.00 0.00 00:17:53.247 [2024-11-26T04:13:55.015Z] =================================================================================================================== 00:17:53.247 [2024-11-26T04:13:55.015Z] Total : 14789.00 57.77 0.00 0.00 0.00 0.00 0.00 00:17:53.248 00:17:54.628 [2024-11-26T04:13:56.396Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:54.628 Nvme0n1 : 5.00 14868.80 58.08 0.00 0.00 0.00 0.00 0.00 00:17:54.628 [2024-11-26T04:13:56.396Z] =================================================================================================================== 00:17:54.628 [2024-11-26T04:13:56.396Z] Total : 14868.80 58.08 0.00 0.00 0.00 0.00 0.00 00:17:54.628 00:17:55.569 [2024-11-26T04:13:57.337Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:55.569 Nvme0n1 : 6.00 15005.50 58.62 0.00 0.00 0.00 0.00 0.00 00:17:55.569 [2024-11-26T04:13:57.337Z] =================================================================================================================== 00:17:55.569 [2024-11-26T04:13:57.337Z] Total : 15005.50 58.62 0.00 0.00 0.00 0.00 0.00 00:17:55.569 00:17:56.506 [2024-11-26T04:13:58.274Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:56.506 Nvme0n1 : 7.00 15059.86 58.83 0.00 0.00 0.00 0.00 0.00 00:17:56.506 [2024-11-26T04:13:58.274Z] =================================================================================================================== 00:17:56.506 [2024-11-26T04:13:58.274Z] Total : 15059.86 58.83 0.00 0.00 0.00 0.00 0.00 00:17:56.506 00:17:57.444 [2024-11-26T04:13:59.212Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:57.444 Nvme0n1 : 8.00 15061.00 58.83 0.00 0.00 0.00 0.00 0.00 00:17:57.444 [2024-11-26T04:13:59.212Z] =================================================================================================================== 00:17:57.444 [2024-11-26T04:13:59.212Z] Total : 15061.00 58.83 0.00 0.00 0.00 0.00 0.00 00:17:57.444 00:17:58.378 [2024-11-26T04:14:00.146Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:58.378 Nvme0n1 : 9.00 15096.44 58.97 0.00 0.00 0.00 0.00 0.00 00:17:58.378 [2024-11-26T04:14:00.146Z] =================================================================================================================== 00:17:58.378 [2024-11-26T04:14:00.146Z] Total : 15096.44 58.97 0.00 0.00 0.00 0.00 0.00 00:17:58.378 00:17:59.318 [2024-11-26T04:14:01.086Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:59.318 Nvme0n1 : 10.00 15102.50 58.99 0.00 0.00 0.00 0.00 0.00 00:17:59.318 [2024-11-26T04:14:01.086Z] =================================================================================================================== 00:17:59.318 [2024-11-26T04:14:01.086Z] Total : 15102.50 58.99 0.00 0.00 0.00 0.00 0.00 00:17:59.318 00:17:59.318 00:17:59.318 Latency(us) 00:17:59.318 [2024-11-26T04:14:01.086Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:59.318 [2024-11-26T04:14:01.086Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:59.318 Nvme0n1 : 10.01 15101.51 58.99 0.00 0.00 8471.51 4587.52 17379.18 00:17:59.318 [2024-11-26T04:14:01.086Z] =================================================================================================================== 00:17:59.318 [2024-11-26T04:14:01.086Z] Total : 15101.51 58.99 0.00 0.00 8471.51 4587.52 17379.18 00:17:59.318 0 00:17:59.318 05:14:01 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3292921 00:17:59.318 05:14:01 -- common/autotest_common.sh@936 -- # '[' -z 3292921 ']' 00:17:59.318 05:14:01 -- common/autotest_common.sh@940 -- # kill -0 3292921 00:17:59.318 05:14:01 -- common/autotest_common.sh@941 -- # uname 00:17:59.318 05:14:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:59.318 05:14:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3292921 00:17:59.318 05:14:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:59.318 05:14:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:59.318 05:14:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3292921' 00:17:59.318 killing process with pid 3292921 00:17:59.318 05:14:01 -- common/autotest_common.sh@955 -- # kill 3292921 00:17:59.318 Received shutdown signal, test time was about 10.000000 seconds 00:17:59.318 00:17:59.318 Latency(us) 00:17:59.318 [2024-11-26T04:14:01.086Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:59.318 [2024-11-26T04:14:01.086Z] =================================================================================================================== 00:17:59.318 [2024-11-26T04:14:01.086Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:59.318 05:14:01 -- common/autotest_common.sh@960 -- # wait 3292921 00:17:59.576 05:14:01 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:59.833 05:14:01 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7d182246-c7b6-4340-a89d-f292db4a392a 00:17:59.833 05:14:01 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:00.091 05:14:01 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:00.091 05:14:01 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:00.091 05:14:01 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3290224 00:18:00.091 05:14:01 -- target/nvmf_lvs_grow.sh@74 -- # wait 3290224 00:18:00.091 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3290224 Killed "${NVMF_APP[@]}" "$@" 00:18:00.091 05:14:01 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:00.091 05:14:01 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:00.091 05:14:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:00.091 05:14:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:00.091 05:14:01 -- common/autotest_common.sh@10 -- # set +x 00:18:00.091 05:14:01 -- nvmf/common.sh@469 -- # nvmfpid=3294419 00:18:00.091 05:14:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:00.091 05:14:01 -- nvmf/common.sh@470 -- # waitforlisten 3294419 00:18:00.091 05:14:01 -- common/autotest_common.sh@829 -- # '[' -z 3294419 ']' 00:18:00.091 05:14:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:00.091 05:14:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:00.091 05:14:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:00.091 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:00.091 05:14:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:00.091 05:14:01 -- common/autotest_common.sh@10 -- # set +x 00:18:00.350 [2024-11-26 05:14:01.871351] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:00.350 [2024-11-26 05:14:01.871442] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:00.350 EAL: No free 2048 kB hugepages reported on node 1 00:18:00.350 [2024-11-26 05:14:01.943628] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:00.350 [2024-11-26 05:14:02.035660] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:00.350 [2024-11-26 05:14:02.035848] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:00.350 [2024-11-26 05:14:02.035868] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:00.350 [2024-11-26 05:14:02.035880] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:00.350 [2024-11-26 05:14:02.035915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:01.383 05:14:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:01.383 05:14:02 -- common/autotest_common.sh@862 -- # return 0 00:18:01.383 05:14:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:01.383 05:14:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:01.383 05:14:02 -- common/autotest_common.sh@10 -- # set +x 00:18:01.383 05:14:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:01.383 05:14:02 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:01.643 [2024-11-26 05:14:03.135524] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:01.643 [2024-11-26 05:14:03.135667] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:01.643 [2024-11-26 05:14:03.135822] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:01.643 05:14:03 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:01.643 05:14:03 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 40f89e8f-c038-40c8-bfe0-6f580c56d254 00:18:01.643 05:14:03 -- common/autotest_common.sh@897 -- # local bdev_name=40f89e8f-c038-40c8-bfe0-6f580c56d254 00:18:01.643 05:14:03 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:01.643 05:14:03 -- common/autotest_common.sh@899 -- # local i 00:18:01.643 05:14:03 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:01.643 05:14:03 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:01.643 05:14:03 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:01.643 05:14:03 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 40f89e8f-c038-40c8-bfe0-6f580c56d254 -t 2000 00:18:01.902 [ 00:18:01.902 { 00:18:01.902 "name": "40f89e8f-c038-40c8-bfe0-6f580c56d254", 00:18:01.902 "aliases": [ 00:18:01.902 "lvs/lvol" 00:18:01.902 ], 00:18:01.902 "product_name": "Logical Volume", 00:18:01.902 "block_size": 4096, 00:18:01.902 "num_blocks": 38912, 00:18:01.902 "uuid": "40f89e8f-c038-40c8-bfe0-6f580c56d254", 00:18:01.902 "assigned_rate_limits": { 00:18:01.902 "rw_ios_per_sec": 0, 00:18:01.902 "rw_mbytes_per_sec": 0, 00:18:01.902 "r_mbytes_per_sec": 0, 00:18:01.902 "w_mbytes_per_sec": 0 00:18:01.902 }, 00:18:01.902 "claimed": false, 00:18:01.902 "zoned": false, 00:18:01.902 "supported_io_types": { 00:18:01.902 "read": true, 00:18:01.902 "write": true, 00:18:01.902 "unmap": true, 00:18:01.902 "write_zeroes": true, 00:18:01.902 "flush": false, 00:18:01.902 "reset": true, 00:18:01.902 "compare": false, 00:18:01.902 "compare_and_write": false, 00:18:01.902 "abort": false, 00:18:01.902 "nvme_admin": false, 00:18:01.902 "nvme_io": false 00:18:01.902 }, 00:18:01.902 "driver_specific": { 00:18:01.902 "lvol": { 00:18:01.902 "lvol_store_uuid": "7d182246-c7b6-4340-a89d-f292db4a392a", 00:18:01.902 "base_bdev": "aio_bdev", 00:18:01.902 "thin_provision": false, 00:18:01.902 "snapshot": false, 00:18:01.902 "clone": false, 00:18:01.902 "esnap_clone": false 00:18:01.902 } 00:18:01.902 } 00:18:01.902 } 00:18:01.902 ] 00:18:01.902 05:14:03 -- common/autotest_common.sh@905 -- # return 0 00:18:01.902 05:14:03 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7d182246-c7b6-4340-a89d-f292db4a392a 00:18:01.902 05:14:03 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:02.161 05:14:03 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:02.161 05:14:03 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7d182246-c7b6-4340-a89d-f292db4a392a 00:18:02.161 05:14:03 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:02.420 05:14:04 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:02.420 05:14:04 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:02.988 [2024-11-26 05:14:04.448533] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:02.988 05:14:04 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7d182246-c7b6-4340-a89d-f292db4a392a 00:18:02.988 05:14:04 -- common/autotest_common.sh@650 -- # local es=0 00:18:02.988 05:14:04 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7d182246-c7b6-4340-a89d-f292db4a392a 00:18:02.988 05:14:04 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:02.988 05:14:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:02.988 05:14:04 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:02.988 05:14:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:02.988 05:14:04 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:02.988 05:14:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:02.988 05:14:04 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:02.988 05:14:04 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:02.988 05:14:04 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7d182246-c7b6-4340-a89d-f292db4a392a 00:18:02.988 request: 00:18:02.988 { 00:18:02.988 "uuid": "7d182246-c7b6-4340-a89d-f292db4a392a", 00:18:02.988 "method": "bdev_lvol_get_lvstores", 00:18:02.988 "req_id": 1 00:18:02.988 } 00:18:02.988 Got JSON-RPC error response 00:18:02.988 response: 00:18:02.988 { 00:18:02.988 "code": -19, 00:18:02.988 "message": "No such device" 00:18:02.988 } 00:18:03.247 05:14:04 -- common/autotest_common.sh@653 -- # es=1 00:18:03.247 05:14:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:03.247 05:14:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:03.247 05:14:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:03.247 05:14:04 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:03.506 aio_bdev 00:18:03.506 05:14:05 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 40f89e8f-c038-40c8-bfe0-6f580c56d254 00:18:03.506 05:14:05 -- common/autotest_common.sh@897 -- # local bdev_name=40f89e8f-c038-40c8-bfe0-6f580c56d254 00:18:03.506 05:14:05 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:03.506 05:14:05 -- common/autotest_common.sh@899 -- # local i 00:18:03.506 05:14:05 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:03.506 05:14:05 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:03.506 05:14:05 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:03.764 05:14:05 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 40f89e8f-c038-40c8-bfe0-6f580c56d254 -t 2000 00:18:04.022 [ 00:18:04.022 { 00:18:04.022 "name": "40f89e8f-c038-40c8-bfe0-6f580c56d254", 00:18:04.022 "aliases": [ 00:18:04.022 "lvs/lvol" 00:18:04.022 ], 00:18:04.022 "product_name": "Logical Volume", 00:18:04.022 "block_size": 4096, 00:18:04.022 "num_blocks": 38912, 00:18:04.022 "uuid": "40f89e8f-c038-40c8-bfe0-6f580c56d254", 00:18:04.022 "assigned_rate_limits": { 00:18:04.022 "rw_ios_per_sec": 0, 00:18:04.022 "rw_mbytes_per_sec": 0, 00:18:04.022 "r_mbytes_per_sec": 0, 00:18:04.022 "w_mbytes_per_sec": 0 00:18:04.022 }, 00:18:04.022 "claimed": false, 00:18:04.022 "zoned": false, 00:18:04.022 "supported_io_types": { 00:18:04.022 "read": true, 00:18:04.022 "write": true, 00:18:04.022 "unmap": true, 00:18:04.022 "write_zeroes": true, 00:18:04.022 "flush": false, 00:18:04.022 "reset": true, 00:18:04.022 "compare": false, 00:18:04.022 "compare_and_write": false, 00:18:04.022 "abort": false, 00:18:04.022 "nvme_admin": false, 00:18:04.022 "nvme_io": false 00:18:04.022 }, 00:18:04.022 "driver_specific": { 00:18:04.022 "lvol": { 00:18:04.022 "lvol_store_uuid": "7d182246-c7b6-4340-a89d-f292db4a392a", 00:18:04.022 "base_bdev": "aio_bdev", 00:18:04.022 "thin_provision": false, 00:18:04.022 "snapshot": false, 00:18:04.022 "clone": false, 00:18:04.022 "esnap_clone": false 00:18:04.022 } 00:18:04.022 } 00:18:04.022 } 00:18:04.022 ] 00:18:04.022 05:14:05 -- common/autotest_common.sh@905 -- # return 0 00:18:04.022 05:14:05 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7d182246-c7b6-4340-a89d-f292db4a392a 00:18:04.022 05:14:05 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:04.280 05:14:05 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:04.280 05:14:05 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7d182246-c7b6-4340-a89d-f292db4a392a 00:18:04.280 05:14:05 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:04.538 05:14:06 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:04.538 05:14:06 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 40f89e8f-c038-40c8-bfe0-6f580c56d254 00:18:04.797 05:14:06 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 7d182246-c7b6-4340-a89d-f292db4a392a 00:18:05.056 05:14:06 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:05.314 05:14:06 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:05.314 00:18:05.314 real 0m19.609s 00:18:05.314 user 0m49.240s 00:18:05.314 sys 0m4.699s 00:18:05.315 05:14:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:05.315 05:14:06 -- common/autotest_common.sh@10 -- # set +x 00:18:05.315 ************************************ 00:18:05.315 END TEST lvs_grow_dirty 00:18:05.315 ************************************ 00:18:05.315 05:14:06 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:05.315 05:14:06 -- common/autotest_common.sh@806 -- # type=--id 00:18:05.315 05:14:06 -- common/autotest_common.sh@807 -- # id=0 00:18:05.315 05:14:06 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:05.315 05:14:06 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:05.315 05:14:06 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:05.315 05:14:06 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:05.315 05:14:06 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:05.315 05:14:06 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:05.315 nvmf_trace.0 00:18:05.315 05:14:06 -- common/autotest_common.sh@821 -- # return 0 00:18:05.315 05:14:06 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:05.315 05:14:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:05.315 05:14:06 -- nvmf/common.sh@116 -- # sync 00:18:05.315 05:14:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:05.315 05:14:06 -- nvmf/common.sh@119 -- # set +e 00:18:05.315 05:14:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:05.315 05:14:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:05.315 rmmod nvme_tcp 00:18:05.315 rmmod nvme_fabrics 00:18:05.315 rmmod nvme_keyring 00:18:05.315 05:14:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:05.315 05:14:07 -- nvmf/common.sh@123 -- # set -e 00:18:05.315 05:14:07 -- nvmf/common.sh@124 -- # return 0 00:18:05.315 05:14:07 -- nvmf/common.sh@477 -- # '[' -n 3294419 ']' 00:18:05.315 05:14:07 -- nvmf/common.sh@478 -- # killprocess 3294419 00:18:05.315 05:14:07 -- common/autotest_common.sh@936 -- # '[' -z 3294419 ']' 00:18:05.315 05:14:07 -- common/autotest_common.sh@940 -- # kill -0 3294419 00:18:05.315 05:14:07 -- common/autotest_common.sh@941 -- # uname 00:18:05.315 05:14:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:05.315 05:14:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3294419 00:18:05.573 05:14:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:05.573 05:14:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:05.573 05:14:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3294419' 00:18:05.573 killing process with pid 3294419 00:18:05.573 05:14:07 -- common/autotest_common.sh@955 -- # kill 3294419 00:18:05.573 05:14:07 -- common/autotest_common.sh@960 -- # wait 3294419 00:18:05.573 05:14:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:05.574 05:14:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:05.574 05:14:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:05.574 05:14:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:05.574 05:14:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:05.574 05:14:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:05.574 05:14:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:05.574 05:14:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:08.112 05:14:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:08.112 00:18:08.112 real 0m43.654s 00:18:08.112 user 1m13.877s 00:18:08.112 sys 0m8.401s 00:18:08.112 05:14:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:08.112 05:14:09 -- common/autotest_common.sh@10 -- # set +x 00:18:08.112 ************************************ 00:18:08.112 END TEST nvmf_lvs_grow 00:18:08.112 ************************************ 00:18:08.112 05:14:09 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:08.112 05:14:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:08.112 05:14:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:08.112 05:14:09 -- common/autotest_common.sh@10 -- # set +x 00:18:08.112 ************************************ 00:18:08.112 START TEST nvmf_bdev_io_wait 00:18:08.112 ************************************ 00:18:08.112 05:14:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:08.112 * Looking for test storage... 00:18:08.112 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:08.113 05:14:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:08.113 05:14:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:08.113 05:14:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:08.113 05:14:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:08.113 05:14:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:08.113 05:14:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:08.113 05:14:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:08.113 05:14:09 -- scripts/common.sh@335 -- # IFS=.-: 00:18:08.113 05:14:09 -- scripts/common.sh@335 -- # read -ra ver1 00:18:08.113 05:14:09 -- scripts/common.sh@336 -- # IFS=.-: 00:18:08.113 05:14:09 -- scripts/common.sh@336 -- # read -ra ver2 00:18:08.113 05:14:09 -- scripts/common.sh@337 -- # local 'op=<' 00:18:08.113 05:14:09 -- scripts/common.sh@339 -- # ver1_l=2 00:18:08.113 05:14:09 -- scripts/common.sh@340 -- # ver2_l=1 00:18:08.113 05:14:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:08.113 05:14:09 -- scripts/common.sh@343 -- # case "$op" in 00:18:08.113 05:14:09 -- scripts/common.sh@344 -- # : 1 00:18:08.113 05:14:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:08.113 05:14:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:08.113 05:14:09 -- scripts/common.sh@364 -- # decimal 1 00:18:08.113 05:14:09 -- scripts/common.sh@352 -- # local d=1 00:18:08.113 05:14:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:08.113 05:14:09 -- scripts/common.sh@354 -- # echo 1 00:18:08.113 05:14:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:08.113 05:14:09 -- scripts/common.sh@365 -- # decimal 2 00:18:08.113 05:14:09 -- scripts/common.sh@352 -- # local d=2 00:18:08.113 05:14:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:08.113 05:14:09 -- scripts/common.sh@354 -- # echo 2 00:18:08.113 05:14:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:08.113 05:14:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:08.113 05:14:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:08.113 05:14:09 -- scripts/common.sh@367 -- # return 0 00:18:08.113 05:14:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:08.113 05:14:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:08.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:08.113 --rc genhtml_branch_coverage=1 00:18:08.113 --rc genhtml_function_coverage=1 00:18:08.113 --rc genhtml_legend=1 00:18:08.113 --rc geninfo_all_blocks=1 00:18:08.113 --rc geninfo_unexecuted_blocks=1 00:18:08.113 00:18:08.113 ' 00:18:08.113 05:14:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:08.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:08.113 --rc genhtml_branch_coverage=1 00:18:08.113 --rc genhtml_function_coverage=1 00:18:08.113 --rc genhtml_legend=1 00:18:08.113 --rc geninfo_all_blocks=1 00:18:08.113 --rc geninfo_unexecuted_blocks=1 00:18:08.113 00:18:08.113 ' 00:18:08.113 05:14:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:08.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:08.113 --rc genhtml_branch_coverage=1 00:18:08.113 --rc genhtml_function_coverage=1 00:18:08.113 --rc genhtml_legend=1 00:18:08.113 --rc geninfo_all_blocks=1 00:18:08.113 --rc geninfo_unexecuted_blocks=1 00:18:08.113 00:18:08.113 ' 00:18:08.113 05:14:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:08.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:08.113 --rc genhtml_branch_coverage=1 00:18:08.113 --rc genhtml_function_coverage=1 00:18:08.113 --rc genhtml_legend=1 00:18:08.113 --rc geninfo_all_blocks=1 00:18:08.113 --rc geninfo_unexecuted_blocks=1 00:18:08.113 00:18:08.113 ' 00:18:08.113 05:14:09 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:08.113 05:14:09 -- nvmf/common.sh@7 -- # uname -s 00:18:08.113 05:14:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:08.113 05:14:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:08.113 05:14:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:08.113 05:14:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:08.113 05:14:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:08.113 05:14:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:08.113 05:14:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:08.113 05:14:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:08.113 05:14:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:08.113 05:14:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:08.113 05:14:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:08.113 05:14:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:08.113 05:14:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:08.113 05:14:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:08.113 05:14:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:08.113 05:14:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:08.113 05:14:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:08.113 05:14:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:08.113 05:14:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:08.113 05:14:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:08.113 05:14:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:08.113 05:14:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:08.113 05:14:09 -- paths/export.sh@5 -- # export PATH 00:18:08.113 05:14:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:08.113 05:14:09 -- nvmf/common.sh@46 -- # : 0 00:18:08.113 05:14:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:08.113 05:14:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:08.113 05:14:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:08.113 05:14:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:08.113 05:14:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:08.113 05:14:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:08.113 05:14:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:08.113 05:14:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:08.113 05:14:09 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:08.113 05:14:09 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:08.113 05:14:09 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:08.113 05:14:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:08.113 05:14:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:08.113 05:14:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:08.113 05:14:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:08.113 05:14:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:08.113 05:14:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:08.113 05:14:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:08.113 05:14:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:08.113 05:14:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:08.113 05:14:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:08.113 05:14:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:08.113 05:14:09 -- common/autotest_common.sh@10 -- # set +x 00:18:10.017 05:14:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:10.017 05:14:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:10.017 05:14:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:10.017 05:14:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:10.017 05:14:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:10.017 05:14:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:10.017 05:14:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:10.017 05:14:11 -- nvmf/common.sh@294 -- # net_devs=() 00:18:10.017 05:14:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:10.017 05:14:11 -- nvmf/common.sh@295 -- # e810=() 00:18:10.017 05:14:11 -- nvmf/common.sh@295 -- # local -ga e810 00:18:10.017 05:14:11 -- nvmf/common.sh@296 -- # x722=() 00:18:10.017 05:14:11 -- nvmf/common.sh@296 -- # local -ga x722 00:18:10.017 05:14:11 -- nvmf/common.sh@297 -- # mlx=() 00:18:10.017 05:14:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:10.017 05:14:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:10.017 05:14:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:10.017 05:14:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:10.017 05:14:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:10.017 05:14:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:10.017 05:14:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:10.017 05:14:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:10.017 05:14:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:10.017 05:14:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:10.017 05:14:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:10.017 05:14:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:10.017 05:14:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:10.017 05:14:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:10.017 05:14:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:10.017 05:14:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:10.017 05:14:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:10.017 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:10.017 05:14:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:10.017 05:14:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:10.017 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:10.017 05:14:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:10.017 05:14:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:10.017 05:14:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:10.017 05:14:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:10.017 05:14:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:10.017 05:14:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:10.017 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:10.017 05:14:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:10.017 05:14:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:10.017 05:14:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:10.017 05:14:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:10.017 05:14:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:10.017 05:14:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:10.017 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:10.017 05:14:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:10.017 05:14:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:10.017 05:14:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:10.017 05:14:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:10.017 05:14:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:10.017 05:14:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:10.017 05:14:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:10.017 05:14:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:10.017 05:14:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:10.017 05:14:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:10.017 05:14:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:10.017 05:14:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:10.017 05:14:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:10.017 05:14:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:10.017 05:14:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:10.017 05:14:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:10.017 05:14:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:10.017 05:14:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:10.017 05:14:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:10.017 05:14:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:10.017 05:14:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:10.017 05:14:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:10.018 05:14:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:10.018 05:14:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:10.018 05:14:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:10.276 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:10.276 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:18:10.276 00:18:10.276 --- 10.0.0.2 ping statistics --- 00:18:10.276 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:10.276 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:18:10.276 05:14:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:10.276 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:10.276 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.054 ms 00:18:10.276 00:18:10.276 --- 10.0.0.1 ping statistics --- 00:18:10.276 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:10.276 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:18:10.276 05:14:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:10.276 05:14:11 -- nvmf/common.sh@410 -- # return 0 00:18:10.276 05:14:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:10.276 05:14:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:10.276 05:14:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:10.276 05:14:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:10.276 05:14:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:10.276 05:14:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:10.276 05:14:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:10.276 05:14:11 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:10.276 05:14:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:10.276 05:14:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:10.276 05:14:11 -- common/autotest_common.sh@10 -- # set +x 00:18:10.276 05:14:11 -- nvmf/common.sh@469 -- # nvmfpid=3296998 00:18:10.276 05:14:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:10.276 05:14:11 -- nvmf/common.sh@470 -- # waitforlisten 3296998 00:18:10.276 05:14:11 -- common/autotest_common.sh@829 -- # '[' -z 3296998 ']' 00:18:10.276 05:14:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:10.276 05:14:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:10.276 05:14:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:10.276 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:10.276 05:14:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:10.276 05:14:11 -- common/autotest_common.sh@10 -- # set +x 00:18:10.276 [2024-11-26 05:14:11.861228] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:10.276 [2024-11-26 05:14:11.861309] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:10.276 EAL: No free 2048 kB hugepages reported on node 1 00:18:10.276 [2024-11-26 05:14:11.928358] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:10.276 [2024-11-26 05:14:12.015404] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:10.276 [2024-11-26 05:14:12.015573] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:10.276 [2024-11-26 05:14:12.015590] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:10.276 [2024-11-26 05:14:12.015602] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:10.276 [2024-11-26 05:14:12.015668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:10.276 [2024-11-26 05:14:12.015735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:10.276 [2024-11-26 05:14:12.015802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:10.276 [2024-11-26 05:14:12.015805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:10.535 05:14:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:10.535 05:14:12 -- common/autotest_common.sh@862 -- # return 0 00:18:10.535 05:14:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:10.535 05:14:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:10.535 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:18:10.535 05:14:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:10.535 05:14:12 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:10.535 05:14:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:10.535 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:18:10.535 05:14:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:10.535 05:14:12 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:10.535 05:14:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:10.535 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:18:10.536 05:14:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:10.536 05:14:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:10.536 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:18:10.536 [2024-11-26 05:14:12.185205] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:10.536 05:14:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:10.536 05:14:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:10.536 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:18:10.536 Malloc0 00:18:10.536 05:14:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:10.536 05:14:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:10.536 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:18:10.536 05:14:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:10.536 05:14:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:10.536 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:18:10.536 05:14:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:10.536 05:14:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:10.536 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:18:10.536 [2024-11-26 05:14:12.244072] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:10.536 05:14:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3297145 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:10.536 05:14:12 -- nvmf/common.sh@520 -- # config=() 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@30 -- # READ_PID=3297147 00:18:10.536 05:14:12 -- nvmf/common.sh@520 -- # local subsystem config 00:18:10.536 05:14:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:10.536 05:14:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:10.536 { 00:18:10.536 "params": { 00:18:10.536 "name": "Nvme$subsystem", 00:18:10.536 "trtype": "$TEST_TRANSPORT", 00:18:10.536 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:10.536 "adrfam": "ipv4", 00:18:10.536 "trsvcid": "$NVMF_PORT", 00:18:10.536 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:10.536 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:10.536 "hdgst": ${hdgst:-false}, 00:18:10.536 "ddgst": ${ddgst:-false} 00:18:10.536 }, 00:18:10.536 "method": "bdev_nvme_attach_controller" 00:18:10.536 } 00:18:10.536 EOF 00:18:10.536 )") 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3297149 00:18:10.536 05:14:12 -- nvmf/common.sh@520 -- # config=() 00:18:10.536 05:14:12 -- nvmf/common.sh@520 -- # local subsystem config 00:18:10.536 05:14:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:10.536 05:14:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:10.536 { 00:18:10.536 "params": { 00:18:10.536 "name": "Nvme$subsystem", 00:18:10.536 "trtype": "$TEST_TRANSPORT", 00:18:10.536 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:10.536 "adrfam": "ipv4", 00:18:10.536 "trsvcid": "$NVMF_PORT", 00:18:10.536 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:10.536 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:10.536 "hdgst": ${hdgst:-false}, 00:18:10.536 "ddgst": ${ddgst:-false} 00:18:10.536 }, 00:18:10.536 "method": "bdev_nvme_attach_controller" 00:18:10.536 } 00:18:10.536 EOF 00:18:10.536 )") 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:10.536 05:14:12 -- nvmf/common.sh@542 -- # cat 00:18:10.536 05:14:12 -- nvmf/common.sh@520 -- # config=() 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3297153 00:18:10.536 05:14:12 -- nvmf/common.sh@520 -- # local subsystem config 00:18:10.536 05:14:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@35 -- # sync 00:18:10.536 05:14:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:10.536 { 00:18:10.536 "params": { 00:18:10.536 "name": "Nvme$subsystem", 00:18:10.536 "trtype": "$TEST_TRANSPORT", 00:18:10.536 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:10.536 "adrfam": "ipv4", 00:18:10.536 "trsvcid": "$NVMF_PORT", 00:18:10.536 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:10.536 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:10.536 "hdgst": ${hdgst:-false}, 00:18:10.536 "ddgst": ${ddgst:-false} 00:18:10.536 }, 00:18:10.536 "method": "bdev_nvme_attach_controller" 00:18:10.536 } 00:18:10.536 EOF 00:18:10.536 )") 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:10.536 05:14:12 -- nvmf/common.sh@520 -- # config=() 00:18:10.536 05:14:12 -- nvmf/common.sh@542 -- # cat 00:18:10.536 05:14:12 -- nvmf/common.sh@520 -- # local subsystem config 00:18:10.536 05:14:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:10.536 05:14:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:10.536 { 00:18:10.536 "params": { 00:18:10.536 "name": "Nvme$subsystem", 00:18:10.536 "trtype": "$TEST_TRANSPORT", 00:18:10.536 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:10.536 "adrfam": "ipv4", 00:18:10.536 "trsvcid": "$NVMF_PORT", 00:18:10.536 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:10.536 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:10.536 "hdgst": ${hdgst:-false}, 00:18:10.536 "ddgst": ${ddgst:-false} 00:18:10.536 }, 00:18:10.536 "method": "bdev_nvme_attach_controller" 00:18:10.536 } 00:18:10.536 EOF 00:18:10.536 )") 00:18:10.536 05:14:12 -- nvmf/common.sh@542 -- # cat 00:18:10.536 05:14:12 -- target/bdev_io_wait.sh@37 -- # wait 3297145 00:18:10.536 05:14:12 -- nvmf/common.sh@542 -- # cat 00:18:10.536 05:14:12 -- nvmf/common.sh@544 -- # jq . 00:18:10.536 05:14:12 -- nvmf/common.sh@544 -- # jq . 00:18:10.536 05:14:12 -- nvmf/common.sh@544 -- # jq . 00:18:10.536 05:14:12 -- nvmf/common.sh@545 -- # IFS=, 00:18:10.536 05:14:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:10.536 "params": { 00:18:10.536 "name": "Nvme1", 00:18:10.536 "trtype": "tcp", 00:18:10.536 "traddr": "10.0.0.2", 00:18:10.536 "adrfam": "ipv4", 00:18:10.536 "trsvcid": "4420", 00:18:10.536 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:10.536 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:10.536 "hdgst": false, 00:18:10.536 "ddgst": false 00:18:10.536 }, 00:18:10.536 "method": "bdev_nvme_attach_controller" 00:18:10.536 }' 00:18:10.536 05:14:12 -- nvmf/common.sh@544 -- # jq . 00:18:10.536 05:14:12 -- nvmf/common.sh@545 -- # IFS=, 00:18:10.536 05:14:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:10.536 "params": { 00:18:10.536 "name": "Nvme1", 00:18:10.536 "trtype": "tcp", 00:18:10.536 "traddr": "10.0.0.2", 00:18:10.536 "adrfam": "ipv4", 00:18:10.536 "trsvcid": "4420", 00:18:10.536 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:10.536 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:10.536 "hdgst": false, 00:18:10.536 "ddgst": false 00:18:10.536 }, 00:18:10.536 "method": "bdev_nvme_attach_controller" 00:18:10.536 }' 00:18:10.536 05:14:12 -- nvmf/common.sh@545 -- # IFS=, 00:18:10.536 05:14:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:10.536 "params": { 00:18:10.536 "name": "Nvme1", 00:18:10.536 "trtype": "tcp", 00:18:10.536 "traddr": "10.0.0.2", 00:18:10.536 "adrfam": "ipv4", 00:18:10.536 "trsvcid": "4420", 00:18:10.536 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:10.536 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:10.536 "hdgst": false, 00:18:10.536 "ddgst": false 00:18:10.536 }, 00:18:10.536 "method": "bdev_nvme_attach_controller" 00:18:10.536 }' 00:18:10.536 05:14:12 -- nvmf/common.sh@545 -- # IFS=, 00:18:10.536 05:14:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:10.536 "params": { 00:18:10.536 "name": "Nvme1", 00:18:10.536 "trtype": "tcp", 00:18:10.536 "traddr": "10.0.0.2", 00:18:10.536 "adrfam": "ipv4", 00:18:10.536 "trsvcid": "4420", 00:18:10.536 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:10.536 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:10.536 "hdgst": false, 00:18:10.536 "ddgst": false 00:18:10.536 }, 00:18:10.536 "method": "bdev_nvme_attach_controller" 00:18:10.536 }' 00:18:10.536 [2024-11-26 05:14:12.287098] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:10.536 [2024-11-26 05:14:12.287098] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:10.536 [2024-11-26 05:14:12.287098] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:10.536 [2024-11-26 05:14:12.287184] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-26 05:14:12.287184] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-26 05:14:12.287185] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:10.537 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:10.537 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:10.537 [2024-11-26 05:14:12.287774] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:10.537 [2024-11-26 05:14:12.287832] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:10.795 EAL: No free 2048 kB hugepages reported on node 1 00:18:10.795 EAL: No free 2048 kB hugepages reported on node 1 00:18:10.795 [2024-11-26 05:14:12.455858] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:10.795 EAL: No free 2048 kB hugepages reported on node 1 00:18:10.795 [2024-11-26 05:14:12.529439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:10.795 [2024-11-26 05:14:12.554624] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:11.054 EAL: No free 2048 kB hugepages reported on node 1 00:18:11.054 [2024-11-26 05:14:12.628200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:11.054 [2024-11-26 05:14:12.654946] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:11.054 [2024-11-26 05:14:12.728162] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:11.054 [2024-11-26 05:14:12.757404] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:11.313 [2024-11-26 05:14:12.834303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:11.313 Running I/O for 1 seconds... 00:18:11.313 Running I/O for 1 seconds... 00:18:11.313 Running I/O for 1 seconds... 00:18:11.313 Running I/O for 1 seconds... 00:18:12.250 00:18:12.250 Latency(us) 00:18:12.250 [2024-11-26T04:14:14.018Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:12.250 [2024-11-26T04:14:14.018Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:12.250 Nvme1n1 : 1.00 173726.50 678.62 0.00 0.00 734.03 276.10 995.18 00:18:12.250 [2024-11-26T04:14:14.018Z] =================================================================================================================== 00:18:12.250 [2024-11-26T04:14:14.018Z] Total : 173726.50 678.62 0.00 0.00 734.03 276.10 995.18 00:18:12.250 00:18:12.250 Latency(us) 00:18:12.250 [2024-11-26T04:14:14.018Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:12.250 [2024-11-26T04:14:14.018Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:12.250 Nvme1n1 : 1.01 10963.86 42.83 0.00 0.00 11626.18 7330.32 20680.25 00:18:12.250 [2024-11-26T04:14:14.018Z] =================================================================================================================== 00:18:12.250 [2024-11-26T04:14:14.018Z] Total : 10963.86 42.83 0.00 0.00 11626.18 7330.32 20680.25 00:18:12.250 00:18:12.250 Latency(us) 00:18:12.250 [2024-11-26T04:14:14.019Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:12.251 [2024-11-26T04:14:14.019Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:12.251 Nvme1n1 : 1.01 8714.31 34.04 0.00 0.00 14624.24 7475.96 25437.68 00:18:12.251 [2024-11-26T04:14:14.019Z] =================================================================================================================== 00:18:12.251 [2024-11-26T04:14:14.019Z] Total : 8714.31 34.04 0.00 0.00 14624.24 7475.96 25437.68 00:18:12.510 00:18:12.510 Latency(us) 00:18:12.510 [2024-11-26T04:14:14.278Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:12.510 [2024-11-26T04:14:14.278Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:12.510 Nvme1n1 : 1.01 7768.29 30.34 0.00 0.00 16391.86 6359.42 26796.94 00:18:12.510 [2024-11-26T04:14:14.278Z] =================================================================================================================== 00:18:12.510 [2024-11-26T04:14:14.278Z] Total : 7768.29 30.34 0.00 0.00 16391.86 6359.42 26796.94 00:18:12.770 05:14:14 -- target/bdev_io_wait.sh@38 -- # wait 3297147 00:18:12.770 05:14:14 -- target/bdev_io_wait.sh@39 -- # wait 3297149 00:18:12.770 05:14:14 -- target/bdev_io_wait.sh@40 -- # wait 3297153 00:18:12.770 05:14:14 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:12.770 05:14:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:12.770 05:14:14 -- common/autotest_common.sh@10 -- # set +x 00:18:12.770 05:14:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:12.770 05:14:14 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:12.770 05:14:14 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:12.770 05:14:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:12.770 05:14:14 -- nvmf/common.sh@116 -- # sync 00:18:12.770 05:14:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:12.770 05:14:14 -- nvmf/common.sh@119 -- # set +e 00:18:12.770 05:14:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:12.770 05:14:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:12.770 rmmod nvme_tcp 00:18:12.770 rmmod nvme_fabrics 00:18:12.770 rmmod nvme_keyring 00:18:12.770 05:14:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:12.770 05:14:14 -- nvmf/common.sh@123 -- # set -e 00:18:12.770 05:14:14 -- nvmf/common.sh@124 -- # return 0 00:18:12.770 05:14:14 -- nvmf/common.sh@477 -- # '[' -n 3296998 ']' 00:18:12.770 05:14:14 -- nvmf/common.sh@478 -- # killprocess 3296998 00:18:12.770 05:14:14 -- common/autotest_common.sh@936 -- # '[' -z 3296998 ']' 00:18:12.770 05:14:14 -- common/autotest_common.sh@940 -- # kill -0 3296998 00:18:12.770 05:14:14 -- common/autotest_common.sh@941 -- # uname 00:18:12.770 05:14:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:12.770 05:14:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3296998 00:18:12.770 05:14:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:12.770 05:14:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:12.770 05:14:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3296998' 00:18:12.770 killing process with pid 3296998 00:18:12.770 05:14:14 -- common/autotest_common.sh@955 -- # kill 3296998 00:18:12.770 05:14:14 -- common/autotest_common.sh@960 -- # wait 3296998 00:18:13.029 05:14:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:13.029 05:14:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:13.029 05:14:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:13.029 05:14:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:13.029 05:14:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:13.029 05:14:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:13.029 05:14:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:13.029 05:14:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:15.568 05:14:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:15.568 00:18:15.568 real 0m7.348s 00:18:15.568 user 0m15.475s 00:18:15.568 sys 0m3.974s 00:18:15.568 05:14:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:15.568 05:14:16 -- common/autotest_common.sh@10 -- # set +x 00:18:15.568 ************************************ 00:18:15.568 END TEST nvmf_bdev_io_wait 00:18:15.568 ************************************ 00:18:15.568 05:14:16 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:15.568 05:14:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:15.568 05:14:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:15.568 05:14:16 -- common/autotest_common.sh@10 -- # set +x 00:18:15.568 ************************************ 00:18:15.568 START TEST nvmf_queue_depth 00:18:15.568 ************************************ 00:18:15.568 05:14:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:15.568 * Looking for test storage... 00:18:15.568 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:15.568 05:14:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:15.568 05:14:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:15.568 05:14:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:15.568 05:14:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:15.568 05:14:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:15.568 05:14:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:15.568 05:14:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:15.568 05:14:16 -- scripts/common.sh@335 -- # IFS=.-: 00:18:15.568 05:14:16 -- scripts/common.sh@335 -- # read -ra ver1 00:18:15.568 05:14:16 -- scripts/common.sh@336 -- # IFS=.-: 00:18:15.568 05:14:16 -- scripts/common.sh@336 -- # read -ra ver2 00:18:15.568 05:14:16 -- scripts/common.sh@337 -- # local 'op=<' 00:18:15.568 05:14:16 -- scripts/common.sh@339 -- # ver1_l=2 00:18:15.568 05:14:16 -- scripts/common.sh@340 -- # ver2_l=1 00:18:15.568 05:14:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:15.568 05:14:16 -- scripts/common.sh@343 -- # case "$op" in 00:18:15.568 05:14:16 -- scripts/common.sh@344 -- # : 1 00:18:15.568 05:14:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:15.568 05:14:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:15.568 05:14:16 -- scripts/common.sh@364 -- # decimal 1 00:18:15.568 05:14:16 -- scripts/common.sh@352 -- # local d=1 00:18:15.568 05:14:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:15.568 05:14:16 -- scripts/common.sh@354 -- # echo 1 00:18:15.568 05:14:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:15.568 05:14:16 -- scripts/common.sh@365 -- # decimal 2 00:18:15.568 05:14:16 -- scripts/common.sh@352 -- # local d=2 00:18:15.568 05:14:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:15.568 05:14:16 -- scripts/common.sh@354 -- # echo 2 00:18:15.568 05:14:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:15.568 05:14:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:15.569 05:14:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:15.569 05:14:16 -- scripts/common.sh@367 -- # return 0 00:18:15.569 05:14:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:15.569 05:14:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:15.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:15.569 --rc genhtml_branch_coverage=1 00:18:15.569 --rc genhtml_function_coverage=1 00:18:15.569 --rc genhtml_legend=1 00:18:15.569 --rc geninfo_all_blocks=1 00:18:15.569 --rc geninfo_unexecuted_blocks=1 00:18:15.569 00:18:15.569 ' 00:18:15.569 05:14:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:15.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:15.569 --rc genhtml_branch_coverage=1 00:18:15.569 --rc genhtml_function_coverage=1 00:18:15.569 --rc genhtml_legend=1 00:18:15.569 --rc geninfo_all_blocks=1 00:18:15.569 --rc geninfo_unexecuted_blocks=1 00:18:15.569 00:18:15.569 ' 00:18:15.569 05:14:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:15.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:15.569 --rc genhtml_branch_coverage=1 00:18:15.569 --rc genhtml_function_coverage=1 00:18:15.569 --rc genhtml_legend=1 00:18:15.569 --rc geninfo_all_blocks=1 00:18:15.569 --rc geninfo_unexecuted_blocks=1 00:18:15.569 00:18:15.569 ' 00:18:15.569 05:14:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:15.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:15.569 --rc genhtml_branch_coverage=1 00:18:15.569 --rc genhtml_function_coverage=1 00:18:15.569 --rc genhtml_legend=1 00:18:15.569 --rc geninfo_all_blocks=1 00:18:15.569 --rc geninfo_unexecuted_blocks=1 00:18:15.569 00:18:15.569 ' 00:18:15.569 05:14:16 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:15.569 05:14:16 -- nvmf/common.sh@7 -- # uname -s 00:18:15.569 05:14:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:15.569 05:14:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:15.569 05:14:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:15.569 05:14:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:15.569 05:14:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:15.569 05:14:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:15.569 05:14:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:15.569 05:14:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:15.569 05:14:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:15.569 05:14:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:15.569 05:14:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:15.569 05:14:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:15.569 05:14:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:15.569 05:14:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:15.569 05:14:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:15.569 05:14:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:15.569 05:14:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:15.569 05:14:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:15.569 05:14:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:15.569 05:14:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.569 05:14:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.569 05:14:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.569 05:14:16 -- paths/export.sh@5 -- # export PATH 00:18:15.569 05:14:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.569 05:14:16 -- nvmf/common.sh@46 -- # : 0 00:18:15.569 05:14:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:15.569 05:14:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:15.569 05:14:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:15.569 05:14:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:15.569 05:14:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:15.569 05:14:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:15.569 05:14:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:15.569 05:14:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:15.569 05:14:16 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:15.569 05:14:16 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:15.569 05:14:16 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:15.569 05:14:16 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:15.569 05:14:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:15.569 05:14:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:15.569 05:14:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:15.569 05:14:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:15.569 05:14:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:15.569 05:14:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:15.569 05:14:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:15.569 05:14:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:15.569 05:14:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:15.569 05:14:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:15.569 05:14:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:15.569 05:14:16 -- common/autotest_common.sh@10 -- # set +x 00:18:17.473 05:14:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:17.473 05:14:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:17.473 05:14:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:17.473 05:14:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:17.473 05:14:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:17.473 05:14:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:17.473 05:14:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:17.473 05:14:18 -- nvmf/common.sh@294 -- # net_devs=() 00:18:17.473 05:14:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:17.473 05:14:18 -- nvmf/common.sh@295 -- # e810=() 00:18:17.473 05:14:18 -- nvmf/common.sh@295 -- # local -ga e810 00:18:17.473 05:14:18 -- nvmf/common.sh@296 -- # x722=() 00:18:17.473 05:14:18 -- nvmf/common.sh@296 -- # local -ga x722 00:18:17.473 05:14:18 -- nvmf/common.sh@297 -- # mlx=() 00:18:17.473 05:14:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:17.473 05:14:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:17.473 05:14:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:17.473 05:14:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:17.473 05:14:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:17.473 05:14:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:17.473 05:14:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:17.473 05:14:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:17.473 05:14:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:17.473 05:14:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:17.473 05:14:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:17.473 05:14:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:17.473 05:14:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:17.473 05:14:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:17.473 05:14:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:17.473 05:14:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:17.473 05:14:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:17.473 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:17.473 05:14:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:17.473 05:14:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:17.473 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:17.473 05:14:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:17.473 05:14:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:17.473 05:14:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:17.473 05:14:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:17.473 05:14:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:17.473 05:14:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:17.473 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:17.473 05:14:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:17.473 05:14:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:17.473 05:14:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:17.473 05:14:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:17.473 05:14:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:17.473 05:14:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:17.473 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:17.473 05:14:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:17.473 05:14:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:17.473 05:14:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:17.473 05:14:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:17.473 05:14:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:17.473 05:14:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:17.473 05:14:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:17.473 05:14:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:17.473 05:14:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:17.473 05:14:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:17.473 05:14:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:17.473 05:14:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:17.473 05:14:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:17.473 05:14:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:17.473 05:14:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:17.473 05:14:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:17.473 05:14:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:17.473 05:14:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:17.474 05:14:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:17.474 05:14:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:17.474 05:14:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:17.474 05:14:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:17.474 05:14:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:17.474 05:14:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:17.474 05:14:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:17.474 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:17.474 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.287 ms 00:18:17.474 00:18:17.474 --- 10.0.0.2 ping statistics --- 00:18:17.474 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:17.474 rtt min/avg/max/mdev = 0.287/0.287/0.287/0.000 ms 00:18:17.474 05:14:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:17.474 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:17.474 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:18:17.474 00:18:17.474 --- 10.0.0.1 ping statistics --- 00:18:17.474 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:17.474 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:18:17.474 05:14:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:17.474 05:14:19 -- nvmf/common.sh@410 -- # return 0 00:18:17.474 05:14:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:17.474 05:14:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:17.474 05:14:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:17.474 05:14:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:17.474 05:14:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:17.474 05:14:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:17.474 05:14:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:17.474 05:14:19 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:17.474 05:14:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:17.474 05:14:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:17.474 05:14:19 -- common/autotest_common.sh@10 -- # set +x 00:18:17.474 05:14:19 -- nvmf/common.sh@469 -- # nvmfpid=3299386 00:18:17.474 05:14:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:17.474 05:14:19 -- nvmf/common.sh@470 -- # waitforlisten 3299386 00:18:17.474 05:14:19 -- common/autotest_common.sh@829 -- # '[' -z 3299386 ']' 00:18:17.474 05:14:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:17.474 05:14:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:17.474 05:14:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:17.474 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:17.474 05:14:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:17.474 05:14:19 -- common/autotest_common.sh@10 -- # set +x 00:18:17.474 [2024-11-26 05:14:19.228366] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:17.474 [2024-11-26 05:14:19.228441] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:17.734 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.734 [2024-11-26 05:14:19.303449] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:17.734 [2024-11-26 05:14:19.389899] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:17.734 [2024-11-26 05:14:19.390060] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:17.734 [2024-11-26 05:14:19.390078] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:17.734 [2024-11-26 05:14:19.390091] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:17.734 [2024-11-26 05:14:19.390125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:18.674 05:14:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:18.674 05:14:20 -- common/autotest_common.sh@862 -- # return 0 00:18:18.674 05:14:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:18.674 05:14:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:18.674 05:14:20 -- common/autotest_common.sh@10 -- # set +x 00:18:18.674 05:14:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:18.674 05:14:20 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:18.674 05:14:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.674 05:14:20 -- common/autotest_common.sh@10 -- # set +x 00:18:18.674 [2024-11-26 05:14:20.294973] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:18.674 05:14:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.674 05:14:20 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:18.674 05:14:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.674 05:14:20 -- common/autotest_common.sh@10 -- # set +x 00:18:18.674 Malloc0 00:18:18.674 05:14:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.674 05:14:20 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:18.674 05:14:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.674 05:14:20 -- common/autotest_common.sh@10 -- # set +x 00:18:18.674 05:14:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.674 05:14:20 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:18.674 05:14:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.674 05:14:20 -- common/autotest_common.sh@10 -- # set +x 00:18:18.674 05:14:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.674 05:14:20 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:18.674 05:14:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.674 05:14:20 -- common/autotest_common.sh@10 -- # set +x 00:18:18.674 [2024-11-26 05:14:20.361373] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:18.674 05:14:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.674 05:14:20 -- target/queue_depth.sh@30 -- # bdevperf_pid=3299550 00:18:18.674 05:14:20 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:18.674 05:14:20 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:18.674 05:14:20 -- target/queue_depth.sh@33 -- # waitforlisten 3299550 /var/tmp/bdevperf.sock 00:18:18.674 05:14:20 -- common/autotest_common.sh@829 -- # '[' -z 3299550 ']' 00:18:18.674 05:14:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:18.674 05:14:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:18.674 05:14:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:18.674 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:18.674 05:14:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:18.674 05:14:20 -- common/autotest_common.sh@10 -- # set +x 00:18:18.674 [2024-11-26 05:14:20.406556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:18.674 [2024-11-26 05:14:20.406617] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3299550 ] 00:18:18.674 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.935 [2024-11-26 05:14:20.469151] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.935 [2024-11-26 05:14:20.557610] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:19.872 05:14:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:19.872 05:14:21 -- common/autotest_common.sh@862 -- # return 0 00:18:19.872 05:14:21 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:19.872 05:14:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:19.872 05:14:21 -- common/autotest_common.sh@10 -- # set +x 00:18:19.872 NVMe0n1 00:18:19.872 05:14:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:19.872 05:14:21 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:19.872 Running I/O for 10 seconds... 00:18:32.089 00:18:32.090 Latency(us) 00:18:32.090 [2024-11-26T04:14:33.858Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:32.090 [2024-11-26T04:14:33.858Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:32.090 Verification LBA range: start 0x0 length 0x4000 00:18:32.090 NVMe0n1 : 10.07 12321.35 48.13 0.00 0.00 82792.78 15146.10 62526.20 00:18:32.090 [2024-11-26T04:14:33.858Z] =================================================================================================================== 00:18:32.090 [2024-11-26T04:14:33.858Z] Total : 12321.35 48.13 0.00 0.00 82792.78 15146.10 62526.20 00:18:32.090 0 00:18:32.090 05:14:31 -- target/queue_depth.sh@39 -- # killprocess 3299550 00:18:32.090 05:14:31 -- common/autotest_common.sh@936 -- # '[' -z 3299550 ']' 00:18:32.090 05:14:31 -- common/autotest_common.sh@940 -- # kill -0 3299550 00:18:32.090 05:14:31 -- common/autotest_common.sh@941 -- # uname 00:18:32.090 05:14:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:32.090 05:14:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3299550 00:18:32.090 05:14:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:32.090 05:14:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:32.090 05:14:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3299550' 00:18:32.090 killing process with pid 3299550 00:18:32.090 05:14:31 -- common/autotest_common.sh@955 -- # kill 3299550 00:18:32.090 Received shutdown signal, test time was about 10.000000 seconds 00:18:32.090 00:18:32.090 Latency(us) 00:18:32.090 [2024-11-26T04:14:33.858Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:32.090 [2024-11-26T04:14:33.858Z] =================================================================================================================== 00:18:32.090 [2024-11-26T04:14:33.858Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:32.090 05:14:31 -- common/autotest_common.sh@960 -- # wait 3299550 00:18:32.090 05:14:31 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:32.090 05:14:31 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:32.090 05:14:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:32.090 05:14:31 -- nvmf/common.sh@116 -- # sync 00:18:32.090 05:14:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:32.090 05:14:31 -- nvmf/common.sh@119 -- # set +e 00:18:32.090 05:14:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:32.090 05:14:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:32.090 rmmod nvme_tcp 00:18:32.090 rmmod nvme_fabrics 00:18:32.090 rmmod nvme_keyring 00:18:32.090 05:14:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:32.090 05:14:32 -- nvmf/common.sh@123 -- # set -e 00:18:32.090 05:14:32 -- nvmf/common.sh@124 -- # return 0 00:18:32.090 05:14:32 -- nvmf/common.sh@477 -- # '[' -n 3299386 ']' 00:18:32.090 05:14:32 -- nvmf/common.sh@478 -- # killprocess 3299386 00:18:32.090 05:14:32 -- common/autotest_common.sh@936 -- # '[' -z 3299386 ']' 00:18:32.090 05:14:32 -- common/autotest_common.sh@940 -- # kill -0 3299386 00:18:32.090 05:14:32 -- common/autotest_common.sh@941 -- # uname 00:18:32.090 05:14:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:32.090 05:14:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3299386 00:18:32.090 05:14:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:32.090 05:14:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:32.090 05:14:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3299386' 00:18:32.090 killing process with pid 3299386 00:18:32.090 05:14:32 -- common/autotest_common.sh@955 -- # kill 3299386 00:18:32.090 05:14:32 -- common/autotest_common.sh@960 -- # wait 3299386 00:18:32.090 05:14:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:32.090 05:14:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:32.090 05:14:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:32.090 05:14:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:32.090 05:14:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:32.090 05:14:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:32.090 05:14:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:32.090 05:14:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:32.660 05:14:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:32.660 00:18:32.660 real 0m17.614s 00:18:32.660 user 0m25.110s 00:18:32.660 sys 0m3.236s 00:18:32.660 05:14:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:32.660 05:14:34 -- common/autotest_common.sh@10 -- # set +x 00:18:32.660 ************************************ 00:18:32.660 END TEST nvmf_queue_depth 00:18:32.660 ************************************ 00:18:32.660 05:14:34 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:32.660 05:14:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:32.660 05:14:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:32.660 05:14:34 -- common/autotest_common.sh@10 -- # set +x 00:18:32.660 ************************************ 00:18:32.660 START TEST nvmf_multipath 00:18:32.660 ************************************ 00:18:32.660 05:14:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:32.919 * Looking for test storage... 00:18:32.919 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:32.919 05:14:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:32.919 05:14:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:32.919 05:14:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:32.919 05:14:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:32.919 05:14:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:32.919 05:14:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:32.919 05:14:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:32.919 05:14:34 -- scripts/common.sh@335 -- # IFS=.-: 00:18:32.919 05:14:34 -- scripts/common.sh@335 -- # read -ra ver1 00:18:32.919 05:14:34 -- scripts/common.sh@336 -- # IFS=.-: 00:18:32.919 05:14:34 -- scripts/common.sh@336 -- # read -ra ver2 00:18:32.919 05:14:34 -- scripts/common.sh@337 -- # local 'op=<' 00:18:32.919 05:14:34 -- scripts/common.sh@339 -- # ver1_l=2 00:18:32.919 05:14:34 -- scripts/common.sh@340 -- # ver2_l=1 00:18:32.919 05:14:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:32.919 05:14:34 -- scripts/common.sh@343 -- # case "$op" in 00:18:32.919 05:14:34 -- scripts/common.sh@344 -- # : 1 00:18:32.919 05:14:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:32.919 05:14:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:32.919 05:14:34 -- scripts/common.sh@364 -- # decimal 1 00:18:32.919 05:14:34 -- scripts/common.sh@352 -- # local d=1 00:18:32.919 05:14:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:32.919 05:14:34 -- scripts/common.sh@354 -- # echo 1 00:18:32.919 05:14:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:32.919 05:14:34 -- scripts/common.sh@365 -- # decimal 2 00:18:32.919 05:14:34 -- scripts/common.sh@352 -- # local d=2 00:18:32.919 05:14:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:32.919 05:14:34 -- scripts/common.sh@354 -- # echo 2 00:18:32.919 05:14:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:32.919 05:14:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:32.919 05:14:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:32.919 05:14:34 -- scripts/common.sh@367 -- # return 0 00:18:32.920 05:14:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:32.920 05:14:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:32.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:32.920 --rc genhtml_branch_coverage=1 00:18:32.920 --rc genhtml_function_coverage=1 00:18:32.920 --rc genhtml_legend=1 00:18:32.920 --rc geninfo_all_blocks=1 00:18:32.920 --rc geninfo_unexecuted_blocks=1 00:18:32.920 00:18:32.920 ' 00:18:32.920 05:14:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:32.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:32.920 --rc genhtml_branch_coverage=1 00:18:32.920 --rc genhtml_function_coverage=1 00:18:32.920 --rc genhtml_legend=1 00:18:32.920 --rc geninfo_all_blocks=1 00:18:32.920 --rc geninfo_unexecuted_blocks=1 00:18:32.920 00:18:32.920 ' 00:18:32.920 05:14:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:32.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:32.920 --rc genhtml_branch_coverage=1 00:18:32.920 --rc genhtml_function_coverage=1 00:18:32.920 --rc genhtml_legend=1 00:18:32.920 --rc geninfo_all_blocks=1 00:18:32.920 --rc geninfo_unexecuted_blocks=1 00:18:32.920 00:18:32.920 ' 00:18:32.920 05:14:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:32.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:32.920 --rc genhtml_branch_coverage=1 00:18:32.920 --rc genhtml_function_coverage=1 00:18:32.920 --rc genhtml_legend=1 00:18:32.920 --rc geninfo_all_blocks=1 00:18:32.920 --rc geninfo_unexecuted_blocks=1 00:18:32.920 00:18:32.920 ' 00:18:32.920 05:14:34 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:32.920 05:14:34 -- nvmf/common.sh@7 -- # uname -s 00:18:32.920 05:14:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:32.920 05:14:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:32.920 05:14:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:32.920 05:14:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:32.920 05:14:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:32.920 05:14:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:32.920 05:14:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:32.920 05:14:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:32.920 05:14:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:32.920 05:14:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:32.920 05:14:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:32.920 05:14:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:32.920 05:14:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:32.920 05:14:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:32.920 05:14:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:32.920 05:14:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:32.920 05:14:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:32.920 05:14:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:32.920 05:14:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:32.920 05:14:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:32.920 05:14:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:32.920 05:14:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:32.920 05:14:34 -- paths/export.sh@5 -- # export PATH 00:18:32.920 05:14:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:32.920 05:14:34 -- nvmf/common.sh@46 -- # : 0 00:18:32.920 05:14:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:32.920 05:14:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:32.920 05:14:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:32.920 05:14:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:32.920 05:14:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:32.920 05:14:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:32.920 05:14:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:32.920 05:14:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:32.920 05:14:34 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:32.920 05:14:34 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:32.920 05:14:34 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:32.920 05:14:34 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:32.920 05:14:34 -- target/multipath.sh@43 -- # nvmftestinit 00:18:32.920 05:14:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:32.920 05:14:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:32.920 05:14:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:32.920 05:14:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:32.920 05:14:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:32.920 05:14:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:32.920 05:14:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:32.920 05:14:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:32.920 05:14:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:32.920 05:14:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:32.920 05:14:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:32.920 05:14:34 -- common/autotest_common.sh@10 -- # set +x 00:18:35.458 05:14:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:35.458 05:14:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:35.458 05:14:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:35.458 05:14:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:35.458 05:14:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:35.458 05:14:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:35.458 05:14:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:35.458 05:14:36 -- nvmf/common.sh@294 -- # net_devs=() 00:18:35.458 05:14:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:35.458 05:14:36 -- nvmf/common.sh@295 -- # e810=() 00:18:35.458 05:14:36 -- nvmf/common.sh@295 -- # local -ga e810 00:18:35.458 05:14:36 -- nvmf/common.sh@296 -- # x722=() 00:18:35.458 05:14:36 -- nvmf/common.sh@296 -- # local -ga x722 00:18:35.458 05:14:36 -- nvmf/common.sh@297 -- # mlx=() 00:18:35.458 05:14:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:35.458 05:14:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:35.458 05:14:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:35.458 05:14:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:35.458 05:14:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:35.458 05:14:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:35.458 05:14:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:35.458 05:14:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:35.458 05:14:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:35.458 05:14:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:35.458 05:14:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:35.458 05:14:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:35.458 05:14:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:35.458 05:14:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:35.458 05:14:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:35.458 05:14:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:35.458 05:14:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:35.458 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:35.458 05:14:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:35.458 05:14:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:35.458 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:35.458 05:14:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:35.458 05:14:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:35.458 05:14:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:35.458 05:14:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:35.458 05:14:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:35.458 05:14:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:35.458 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:35.458 05:14:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:35.458 05:14:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:35.458 05:14:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:35.458 05:14:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:35.458 05:14:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:35.458 05:14:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:35.458 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:35.458 05:14:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:35.458 05:14:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:35.458 05:14:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:35.458 05:14:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:35.458 05:14:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:35.458 05:14:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:35.458 05:14:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:35.458 05:14:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:35.458 05:14:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:35.458 05:14:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:35.458 05:14:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:35.458 05:14:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:35.458 05:14:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:35.458 05:14:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:35.458 05:14:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:35.458 05:14:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:35.458 05:14:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:35.458 05:14:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:35.458 05:14:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:35.458 05:14:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:35.458 05:14:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:35.458 05:14:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:35.458 05:14:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:35.458 05:14:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:35.458 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:35.458 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:18:35.458 00:18:35.458 --- 10.0.0.2 ping statistics --- 00:18:35.458 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:35.458 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:18:35.458 05:14:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:35.458 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:35.458 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:18:35.458 00:18:35.458 --- 10.0.0.1 ping statistics --- 00:18:35.458 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:35.458 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:18:35.458 05:14:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:35.458 05:14:36 -- nvmf/common.sh@410 -- # return 0 00:18:35.458 05:14:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:35.458 05:14:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:35.458 05:14:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:35.458 05:14:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:35.458 05:14:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:35.458 05:14:36 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:35.458 05:14:36 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:35.458 only one NIC for nvmf test 00:18:35.458 05:14:36 -- target/multipath.sh@47 -- # nvmftestfini 00:18:35.458 05:14:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:35.458 05:14:36 -- nvmf/common.sh@116 -- # sync 00:18:35.458 05:14:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:35.458 05:14:36 -- nvmf/common.sh@119 -- # set +e 00:18:35.458 05:14:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:35.458 05:14:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:35.458 rmmod nvme_tcp 00:18:35.458 rmmod nvme_fabrics 00:18:35.458 rmmod nvme_keyring 00:18:35.458 05:14:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:35.458 05:14:36 -- nvmf/common.sh@123 -- # set -e 00:18:35.458 05:14:36 -- nvmf/common.sh@124 -- # return 0 00:18:35.458 05:14:36 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:35.458 05:14:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:35.458 05:14:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:35.458 05:14:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:35.459 05:14:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:35.459 05:14:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:35.459 05:14:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:35.459 05:14:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:35.459 05:14:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:37.367 05:14:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:37.367 05:14:38 -- target/multipath.sh@48 -- # exit 0 00:18:37.367 05:14:38 -- target/multipath.sh@1 -- # nvmftestfini 00:18:37.367 05:14:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:37.367 05:14:38 -- nvmf/common.sh@116 -- # sync 00:18:37.367 05:14:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:37.367 05:14:38 -- nvmf/common.sh@119 -- # set +e 00:18:37.367 05:14:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:37.367 05:14:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:37.367 05:14:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:37.367 05:14:38 -- nvmf/common.sh@123 -- # set -e 00:18:37.367 05:14:38 -- nvmf/common.sh@124 -- # return 0 00:18:37.367 05:14:38 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:37.367 05:14:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:37.367 05:14:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:37.367 05:14:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:37.367 05:14:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:37.367 05:14:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:37.367 05:14:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:37.367 05:14:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:37.367 05:14:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:37.367 05:14:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:37.367 00:18:37.367 real 0m4.459s 00:18:37.368 user 0m0.884s 00:18:37.368 sys 0m1.573s 00:18:37.368 05:14:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:37.368 05:14:38 -- common/autotest_common.sh@10 -- # set +x 00:18:37.368 ************************************ 00:18:37.368 END TEST nvmf_multipath 00:18:37.368 ************************************ 00:18:37.368 05:14:38 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:37.368 05:14:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:37.368 05:14:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:37.368 05:14:38 -- common/autotest_common.sh@10 -- # set +x 00:18:37.368 ************************************ 00:18:37.368 START TEST nvmf_zcopy 00:18:37.368 ************************************ 00:18:37.368 05:14:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:37.368 * Looking for test storage... 00:18:37.368 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:37.368 05:14:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:37.368 05:14:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:37.368 05:14:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:37.368 05:14:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:37.368 05:14:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:37.368 05:14:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:37.368 05:14:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:37.368 05:14:39 -- scripts/common.sh@335 -- # IFS=.-: 00:18:37.368 05:14:39 -- scripts/common.sh@335 -- # read -ra ver1 00:18:37.368 05:14:39 -- scripts/common.sh@336 -- # IFS=.-: 00:18:37.368 05:14:39 -- scripts/common.sh@336 -- # read -ra ver2 00:18:37.368 05:14:39 -- scripts/common.sh@337 -- # local 'op=<' 00:18:37.368 05:14:39 -- scripts/common.sh@339 -- # ver1_l=2 00:18:37.368 05:14:39 -- scripts/common.sh@340 -- # ver2_l=1 00:18:37.368 05:14:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:37.368 05:14:39 -- scripts/common.sh@343 -- # case "$op" in 00:18:37.368 05:14:39 -- scripts/common.sh@344 -- # : 1 00:18:37.368 05:14:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:37.368 05:14:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:37.368 05:14:39 -- scripts/common.sh@364 -- # decimal 1 00:18:37.368 05:14:39 -- scripts/common.sh@352 -- # local d=1 00:18:37.368 05:14:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:37.368 05:14:39 -- scripts/common.sh@354 -- # echo 1 00:18:37.368 05:14:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:37.368 05:14:39 -- scripts/common.sh@365 -- # decimal 2 00:18:37.368 05:14:39 -- scripts/common.sh@352 -- # local d=2 00:18:37.368 05:14:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:37.368 05:14:39 -- scripts/common.sh@354 -- # echo 2 00:18:37.368 05:14:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:37.368 05:14:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:37.368 05:14:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:37.368 05:14:39 -- scripts/common.sh@367 -- # return 0 00:18:37.368 05:14:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:37.368 05:14:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:37.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:37.368 --rc genhtml_branch_coverage=1 00:18:37.368 --rc genhtml_function_coverage=1 00:18:37.368 --rc genhtml_legend=1 00:18:37.368 --rc geninfo_all_blocks=1 00:18:37.368 --rc geninfo_unexecuted_blocks=1 00:18:37.368 00:18:37.368 ' 00:18:37.368 05:14:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:37.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:37.368 --rc genhtml_branch_coverage=1 00:18:37.368 --rc genhtml_function_coverage=1 00:18:37.368 --rc genhtml_legend=1 00:18:37.368 --rc geninfo_all_blocks=1 00:18:37.368 --rc geninfo_unexecuted_blocks=1 00:18:37.368 00:18:37.368 ' 00:18:37.368 05:14:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:37.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:37.368 --rc genhtml_branch_coverage=1 00:18:37.368 --rc genhtml_function_coverage=1 00:18:37.368 --rc genhtml_legend=1 00:18:37.368 --rc geninfo_all_blocks=1 00:18:37.368 --rc geninfo_unexecuted_blocks=1 00:18:37.368 00:18:37.368 ' 00:18:37.368 05:14:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:37.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:37.368 --rc genhtml_branch_coverage=1 00:18:37.368 --rc genhtml_function_coverage=1 00:18:37.368 --rc genhtml_legend=1 00:18:37.368 --rc geninfo_all_blocks=1 00:18:37.368 --rc geninfo_unexecuted_blocks=1 00:18:37.368 00:18:37.368 ' 00:18:37.368 05:14:39 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:37.368 05:14:39 -- nvmf/common.sh@7 -- # uname -s 00:18:37.368 05:14:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:37.368 05:14:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:37.368 05:14:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:37.368 05:14:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:37.368 05:14:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:37.368 05:14:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:37.368 05:14:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:37.368 05:14:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:37.368 05:14:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:37.368 05:14:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:37.368 05:14:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:37.368 05:14:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:37.368 05:14:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:37.368 05:14:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:37.368 05:14:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:37.368 05:14:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:37.368 05:14:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:37.368 05:14:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:37.368 05:14:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:37.368 05:14:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.368 05:14:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.368 05:14:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.368 05:14:39 -- paths/export.sh@5 -- # export PATH 00:18:37.369 05:14:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.369 05:14:39 -- nvmf/common.sh@46 -- # : 0 00:18:37.369 05:14:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:37.369 05:14:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:37.369 05:14:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:37.369 05:14:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:37.369 05:14:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:37.369 05:14:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:37.369 05:14:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:37.369 05:14:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:37.369 05:14:39 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:37.369 05:14:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:37.369 05:14:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:37.369 05:14:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:37.369 05:14:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:37.369 05:14:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:37.369 05:14:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:37.369 05:14:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:37.369 05:14:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:37.369 05:14:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:37.369 05:14:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:37.369 05:14:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:37.369 05:14:39 -- common/autotest_common.sh@10 -- # set +x 00:18:39.292 05:14:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:39.292 05:14:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:39.292 05:14:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:39.292 05:14:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:39.292 05:14:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:39.292 05:14:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:39.292 05:14:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:39.292 05:14:41 -- nvmf/common.sh@294 -- # net_devs=() 00:18:39.292 05:14:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:39.292 05:14:41 -- nvmf/common.sh@295 -- # e810=() 00:18:39.292 05:14:41 -- nvmf/common.sh@295 -- # local -ga e810 00:18:39.292 05:14:41 -- nvmf/common.sh@296 -- # x722=() 00:18:39.292 05:14:41 -- nvmf/common.sh@296 -- # local -ga x722 00:18:39.292 05:14:41 -- nvmf/common.sh@297 -- # mlx=() 00:18:39.292 05:14:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:39.292 05:14:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:39.292 05:14:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:39.292 05:14:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:39.292 05:14:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:39.292 05:14:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:39.292 05:14:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:39.292 05:14:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:39.292 05:14:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:39.292 05:14:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:39.292 05:14:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:39.292 05:14:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:39.292 05:14:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:39.292 05:14:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:39.292 05:14:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:39.292 05:14:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:39.292 05:14:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:39.292 05:14:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:39.292 05:14:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:39.292 05:14:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:39.292 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:39.292 05:14:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:39.292 05:14:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:39.292 05:14:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:39.293 05:14:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:39.293 05:14:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:39.293 05:14:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:39.293 05:14:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:39.293 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:39.293 05:14:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:39.293 05:14:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:39.293 05:14:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:39.293 05:14:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:39.293 05:14:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:39.293 05:14:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:39.293 05:14:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:39.293 05:14:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:39.293 05:14:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:39.293 05:14:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:39.293 05:14:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:39.293 05:14:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:39.293 05:14:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:39.293 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:39.293 05:14:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:39.293 05:14:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:39.293 05:14:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:39.293 05:14:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:39.293 05:14:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:39.293 05:14:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:39.293 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:39.293 05:14:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:39.293 05:14:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:39.293 05:14:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:39.293 05:14:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:39.293 05:14:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:39.293 05:14:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:39.293 05:14:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:39.293 05:14:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:39.293 05:14:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:39.293 05:14:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:39.293 05:14:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:39.293 05:14:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:39.293 05:14:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:39.293 05:14:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:39.293 05:14:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:39.293 05:14:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:39.293 05:14:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:39.293 05:14:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:39.552 05:14:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:39.552 05:14:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:39.552 05:14:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:39.552 05:14:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:39.552 05:14:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:39.552 05:14:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:39.552 05:14:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:39.552 05:14:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:39.552 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:39.552 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.193 ms 00:18:39.552 00:18:39.552 --- 10.0.0.2 ping statistics --- 00:18:39.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:39.552 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:18:39.552 05:14:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:39.552 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:39.552 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:18:39.552 00:18:39.552 --- 10.0.0.1 ping statistics --- 00:18:39.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:39.552 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:18:39.552 05:14:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:39.552 05:14:41 -- nvmf/common.sh@410 -- # return 0 00:18:39.552 05:14:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:39.552 05:14:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:39.552 05:14:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:39.552 05:14:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:39.552 05:14:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:39.552 05:14:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:39.552 05:14:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:39.552 05:14:41 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:39.552 05:14:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:39.552 05:14:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:39.552 05:14:41 -- common/autotest_common.sh@10 -- # set +x 00:18:39.552 05:14:41 -- nvmf/common.sh@469 -- # nvmfpid=3304813 00:18:39.552 05:14:41 -- nvmf/common.sh@470 -- # waitforlisten 3304813 00:18:39.552 05:14:41 -- common/autotest_common.sh@829 -- # '[' -z 3304813 ']' 00:18:39.552 05:14:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:39.552 05:14:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:39.552 05:14:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:39.552 05:14:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:39.552 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:39.552 05:14:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:39.552 05:14:41 -- common/autotest_common.sh@10 -- # set +x 00:18:39.813 [2024-11-26 05:14:41.328641] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:39.813 [2024-11-26 05:14:41.328753] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:39.813 EAL: No free 2048 kB hugepages reported on node 1 00:18:39.813 [2024-11-26 05:14:41.400286] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:39.813 [2024-11-26 05:14:41.484067] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:39.813 [2024-11-26 05:14:41.484231] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:39.813 [2024-11-26 05:14:41.484248] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:39.813 [2024-11-26 05:14:41.484260] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:39.813 [2024-11-26 05:14:41.484291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:40.752 05:14:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:40.752 05:14:42 -- common/autotest_common.sh@862 -- # return 0 00:18:40.752 05:14:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:40.752 05:14:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:40.752 05:14:42 -- common/autotest_common.sh@10 -- # set +x 00:18:40.752 05:14:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:40.752 05:14:42 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:40.752 05:14:42 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:40.752 05:14:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:40.752 05:14:42 -- common/autotest_common.sh@10 -- # set +x 00:18:40.752 [2024-11-26 05:14:42.344518] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:40.752 05:14:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:40.752 05:14:42 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:40.752 05:14:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:40.752 05:14:42 -- common/autotest_common.sh@10 -- # set +x 00:18:40.752 05:14:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:40.752 05:14:42 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:40.752 05:14:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:40.752 05:14:42 -- common/autotest_common.sh@10 -- # set +x 00:18:40.752 [2024-11-26 05:14:42.360763] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:40.752 05:14:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:40.752 05:14:42 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:40.752 05:14:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:40.752 05:14:42 -- common/autotest_common.sh@10 -- # set +x 00:18:40.752 05:14:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:40.752 05:14:42 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:40.752 05:14:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:40.752 05:14:42 -- common/autotest_common.sh@10 -- # set +x 00:18:40.752 malloc0 00:18:40.752 05:14:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:40.752 05:14:42 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:40.752 05:14:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:40.752 05:14:42 -- common/autotest_common.sh@10 -- # set +x 00:18:40.752 05:14:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:40.752 05:14:42 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:40.752 05:14:42 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:40.752 05:14:42 -- nvmf/common.sh@520 -- # config=() 00:18:40.752 05:14:42 -- nvmf/common.sh@520 -- # local subsystem config 00:18:40.752 05:14:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:40.752 05:14:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:40.752 { 00:18:40.752 "params": { 00:18:40.752 "name": "Nvme$subsystem", 00:18:40.752 "trtype": "$TEST_TRANSPORT", 00:18:40.752 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:40.752 "adrfam": "ipv4", 00:18:40.752 "trsvcid": "$NVMF_PORT", 00:18:40.752 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:40.752 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:40.752 "hdgst": ${hdgst:-false}, 00:18:40.752 "ddgst": ${ddgst:-false} 00:18:40.752 }, 00:18:40.752 "method": "bdev_nvme_attach_controller" 00:18:40.752 } 00:18:40.752 EOF 00:18:40.752 )") 00:18:40.752 05:14:42 -- nvmf/common.sh@542 -- # cat 00:18:40.752 05:14:42 -- nvmf/common.sh@544 -- # jq . 00:18:40.752 05:14:42 -- nvmf/common.sh@545 -- # IFS=, 00:18:40.752 05:14:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:40.752 "params": { 00:18:40.752 "name": "Nvme1", 00:18:40.752 "trtype": "tcp", 00:18:40.752 "traddr": "10.0.0.2", 00:18:40.752 "adrfam": "ipv4", 00:18:40.752 "trsvcid": "4420", 00:18:40.752 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:40.752 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:40.752 "hdgst": false, 00:18:40.752 "ddgst": false 00:18:40.752 }, 00:18:40.752 "method": "bdev_nvme_attach_controller" 00:18:40.752 }' 00:18:40.752 [2024-11-26 05:14:42.434095] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:40.753 [2024-11-26 05:14:42.434186] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3304970 ] 00:18:40.753 EAL: No free 2048 kB hugepages reported on node 1 00:18:40.753 [2024-11-26 05:14:42.498483] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:41.013 [2024-11-26 05:14:42.591112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:41.273 Running I/O for 10 seconds... 00:18:51.321 00:18:51.321 Latency(us) 00:18:51.321 [2024-11-26T04:14:53.089Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:51.321 [2024-11-26T04:14:53.089Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:51.321 Verification LBA range: start 0x0 length 0x1000 00:18:51.321 Nvme1n1 : 10.01 8598.55 67.18 0.00 0.00 14850.02 1832.58 22816.24 00:18:51.321 [2024-11-26T04:14:53.089Z] =================================================================================================================== 00:18:51.321 [2024-11-26T04:14:53.089Z] Total : 8598.55 67.18 0.00 0.00 14850.02 1832.58 22816.24 00:18:51.579 05:14:53 -- target/zcopy.sh@39 -- # perfpid=3306325 00:18:51.579 05:14:53 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:51.579 05:14:53 -- common/autotest_common.sh@10 -- # set +x 00:18:51.579 05:14:53 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:51.579 05:14:53 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:51.579 05:14:53 -- nvmf/common.sh@520 -- # config=() 00:18:51.579 05:14:53 -- nvmf/common.sh@520 -- # local subsystem config 00:18:51.579 05:14:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:51.579 05:14:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:51.579 { 00:18:51.579 "params": { 00:18:51.579 "name": "Nvme$subsystem", 00:18:51.579 "trtype": "$TEST_TRANSPORT", 00:18:51.579 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:51.579 "adrfam": "ipv4", 00:18:51.579 "trsvcid": "$NVMF_PORT", 00:18:51.579 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:51.579 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:51.579 "hdgst": ${hdgst:-false}, 00:18:51.579 "ddgst": ${ddgst:-false} 00:18:51.579 }, 00:18:51.579 "method": "bdev_nvme_attach_controller" 00:18:51.579 } 00:18:51.579 EOF 00:18:51.579 )") 00:18:51.579 05:14:53 -- nvmf/common.sh@542 -- # cat 00:18:51.579 05:14:53 -- nvmf/common.sh@544 -- # jq . 00:18:51.579 [2024-11-26 05:14:53.172574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.579 [2024-11-26 05:14:53.172623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.579 05:14:53 -- nvmf/common.sh@545 -- # IFS=, 00:18:51.579 05:14:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:51.579 "params": { 00:18:51.579 "name": "Nvme1", 00:18:51.579 "trtype": "tcp", 00:18:51.579 "traddr": "10.0.0.2", 00:18:51.579 "adrfam": "ipv4", 00:18:51.579 "trsvcid": "4420", 00:18:51.579 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:51.579 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:51.579 "hdgst": false, 00:18:51.579 "ddgst": false 00:18:51.579 }, 00:18:51.579 "method": "bdev_nvme_attach_controller" 00:18:51.579 }' 00:18:51.579 [2024-11-26 05:14:53.180528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.579 [2024-11-26 05:14:53.180556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.188544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.188568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.196556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.196575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.204578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.204598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.207109] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:51.580 [2024-11-26 05:14:53.207164] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3306325 ] 00:18:51.580 [2024-11-26 05:14:53.212600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.212621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.220638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.220658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.228643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.228678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 EAL: No free 2048 kB hugepages reported on node 1 00:18:51.580 [2024-11-26 05:14:53.236681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.236717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.244712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.244751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.252747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.252769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.260765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.260787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.268778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.268798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.270298] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:51.580 [2024-11-26 05:14:53.276823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.276852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.284850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.284887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.292839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.292861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.300858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.300880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.308879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.308901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.316902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.316923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.324955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.325010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.332949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.332989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.580 [2024-11-26 05:14:53.340996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.580 [2024-11-26 05:14:53.341035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.840 [2024-11-26 05:14:53.349005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.840 [2024-11-26 05:14:53.349027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.840 [2024-11-26 05:14:53.357035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.840 [2024-11-26 05:14:53.357059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.840 [2024-11-26 05:14:53.360316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:51.840 [2024-11-26 05:14:53.365065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.840 [2024-11-26 05:14:53.365090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.840 [2024-11-26 05:14:53.373088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.840 [2024-11-26 05:14:53.373115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.840 [2024-11-26 05:14:53.381150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.840 [2024-11-26 05:14:53.381202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.389167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.389206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.397194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.397237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.405220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.405264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.413241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.413283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.421256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.421297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.429253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.429279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.437321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.437363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.445341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.445383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.453331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.453355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.461392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.461424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.469400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.469428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.477423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.477450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.485445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.485473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.493469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.493497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.501498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.501527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.509518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.509545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.517543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.517570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.525567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.525597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 Running I/O for 5 seconds... 00:18:51.841 [2024-11-26 05:14:53.533588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.533614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.547846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.547875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.559279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.559311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.570693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.570748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.582234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.582266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:51.841 [2024-11-26 05:14:53.593675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:51.841 [2024-11-26 05:14:53.593716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.606847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.606883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.617507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.617539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.629134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.629166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.640306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.640336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.651643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.651674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.662557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.662588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.675042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.675073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.685192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.685223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.696313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.696344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.709799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.709830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.720441] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.720472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.731442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.731473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.744026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.744058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.753463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.753496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.766871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.766902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.777742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.777774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.788847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.788877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.801617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.801650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.812206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.812237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.823508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.823539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.834008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.834040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.844867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.844899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.100 [2024-11-26 05:14:53.858130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.100 [2024-11-26 05:14:53.858163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.360 [2024-11-26 05:14:53.869063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.360 [2024-11-26 05:14:53.869096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.360 [2024-11-26 05:14:53.880320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.360 [2024-11-26 05:14:53.880354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.360 [2024-11-26 05:14:53.893196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.360 [2024-11-26 05:14:53.893228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.360 [2024-11-26 05:14:53.903678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.360 [2024-11-26 05:14:53.903730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.360 [2024-11-26 05:14:53.915024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.360 [2024-11-26 05:14:53.915055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.360 [2024-11-26 05:14:53.928025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.360 [2024-11-26 05:14:53.928057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.360 [2024-11-26 05:14:53.937889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.360 [2024-11-26 05:14:53.937921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.360 [2024-11-26 05:14:53.949508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.360 [2024-11-26 05:14:53.949540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.360 [2024-11-26 05:14:53.960588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.360 [2024-11-26 05:14:53.960619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.360 [2024-11-26 05:14:53.971897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.360 [2024-11-26 05:14:53.971927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.360 [2024-11-26 05:14:53.984330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.361 [2024-11-26 05:14:53.984361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.361 [2024-11-26 05:14:53.994174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.361 [2024-11-26 05:14:53.994206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.361 [2024-11-26 05:14:54.005875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.361 [2024-11-26 05:14:54.005906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.361 [2024-11-26 05:14:54.017378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.361 [2024-11-26 05:14:54.017409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.361 [2024-11-26 05:14:54.030410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.361 [2024-11-26 05:14:54.030440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.361 [2024-11-26 05:14:54.040914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.361 [2024-11-26 05:14:54.040945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.361 [2024-11-26 05:14:54.052025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.361 [2024-11-26 05:14:54.052056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.361 [2024-11-26 05:14:54.063403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.361 [2024-11-26 05:14:54.063434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.361 [2024-11-26 05:14:54.074597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.361 [2024-11-26 05:14:54.074628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.361 [2024-11-26 05:14:54.087575] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.361 [2024-11-26 05:14:54.087606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.361 [2024-11-26 05:14:54.097305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.361 [2024-11-26 05:14:54.097336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.361 [2024-11-26 05:14:54.107746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.361 [2024-11-26 05:14:54.107776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.361 [2024-11-26 05:14:54.118634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.361 [2024-11-26 05:14:54.118666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.621 [2024-11-26 05:14:54.130172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.621 [2024-11-26 05:14:54.130205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.621 [2024-11-26 05:14:54.141649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.621 [2024-11-26 05:14:54.141679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.621 [2024-11-26 05:14:54.152882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.621 [2024-11-26 05:14:54.152913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.621 [2024-11-26 05:14:54.163926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.621 [2024-11-26 05:14:54.163957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.621 [2024-11-26 05:14:54.175601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.621 [2024-11-26 05:14:54.175631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.621 [2024-11-26 05:14:54.186616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.621 [2024-11-26 05:14:54.186648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.621 [2024-11-26 05:14:54.198243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.621 [2024-11-26 05:14:54.198274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.621 [2024-11-26 05:14:54.209804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.621 [2024-11-26 05:14:54.209834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.621 [2024-11-26 05:14:54.221218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.621 [2024-11-26 05:14:54.221248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.621 [2024-11-26 05:14:54.234310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.621 [2024-11-26 05:14:54.234341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.622 [2024-11-26 05:14:54.244680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.622 [2024-11-26 05:14:54.244723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.622 [2024-11-26 05:14:54.255742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.622 [2024-11-26 05:14:54.255773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.622 [2024-11-26 05:14:54.267161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.622 [2024-11-26 05:14:54.267193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.622 [2024-11-26 05:14:54.278580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.622 [2024-11-26 05:14:54.278611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.622 [2024-11-26 05:14:54.289817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.622 [2024-11-26 05:14:54.289849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.622 [2024-11-26 05:14:54.300850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.622 [2024-11-26 05:14:54.300881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.622 [2024-11-26 05:14:54.312077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.622 [2024-11-26 05:14:54.312109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.622 [2024-11-26 05:14:54.325041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.622 [2024-11-26 05:14:54.325073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.622 [2024-11-26 05:14:54.336114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.622 [2024-11-26 05:14:54.336146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.622 [2024-11-26 05:14:54.347314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.622 [2024-11-26 05:14:54.347345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.622 [2024-11-26 05:14:54.360330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.622 [2024-11-26 05:14:54.360362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.622 [2024-11-26 05:14:54.370802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.622 [2024-11-26 05:14:54.370833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.622 [2024-11-26 05:14:54.382081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.622 [2024-11-26 05:14:54.382112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.880 [2024-11-26 05:14:54.393533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.393574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.406645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.406677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.416369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.416401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.427273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.427303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.439921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.439952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.449929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.449960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.461510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.461542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.472554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.472585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.483444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.483475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.494125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.494155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.505021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.505052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.516443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.516475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.529563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.529594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.540211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.540242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.551048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.551080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.561938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.561970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.572494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.572525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.583601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.583634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.596729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.596760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.607265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.607304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.618006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.618037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.629331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.629362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:52.881 [2024-11-26 05:14:54.640623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:52.881 [2024-11-26 05:14:54.640653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.139 [2024-11-26 05:14:54.651839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.139 [2024-11-26 05:14:54.651871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.139 [2024-11-26 05:14:54.664655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.139 [2024-11-26 05:14:54.664694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.139 [2024-11-26 05:14:54.674963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.139 [2024-11-26 05:14:54.674993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.685801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.685831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.696944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.696975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.707900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.707931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.720819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.720849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.731066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.731096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.742234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.742264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.755255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.755286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.765605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.765635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.776812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.776842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.789597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.789627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.799296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.799326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.809833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.809864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.820477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.820515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.831213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.831244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.842321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.842352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.855895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.855927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.866451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.866481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.877110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.877140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.888292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.888323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.140 [2024-11-26 05:14:54.898973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.140 [2024-11-26 05:14:54.899004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.399 [2024-11-26 05:14:54.910053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.399 [2024-11-26 05:14:54.910085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.399 [2024-11-26 05:14:54.921144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.399 [2024-11-26 05:14:54.921174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.399 [2024-11-26 05:14:54.932135] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.399 [2024-11-26 05:14:54.932166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.399 [2024-11-26 05:14:54.943075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.399 [2024-11-26 05:14:54.943105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.399 [2024-11-26 05:14:54.954244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.399 [2024-11-26 05:14:54.954274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.399 [2024-11-26 05:14:54.965291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.399 [2024-11-26 05:14:54.965322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.399 [2024-11-26 05:14:54.977989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.399 [2024-11-26 05:14:54.978020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.399 [2024-11-26 05:14:54.988463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.399 [2024-11-26 05:14:54.988494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.399 [2024-11-26 05:14:54.999767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.399 [2024-11-26 05:14:54.999797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.399 [2024-11-26 05:14:55.011155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.399 [2024-11-26 05:14:55.011186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.399 [2024-11-26 05:14:55.022947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.399 [2024-11-26 05:14:55.022977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.400 [2024-11-26 05:14:55.033893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.400 [2024-11-26 05:14:55.033932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.400 [2024-11-26 05:14:55.045224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.400 [2024-11-26 05:14:55.045255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.400 [2024-11-26 05:14:55.056852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.400 [2024-11-26 05:14:55.056883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.400 [2024-11-26 05:14:55.068311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.400 [2024-11-26 05:14:55.068342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.400 [2024-11-26 05:14:55.081487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.400 [2024-11-26 05:14:55.081518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.400 [2024-11-26 05:14:55.091800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.400 [2024-11-26 05:14:55.091831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.400 [2024-11-26 05:14:55.103016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.400 [2024-11-26 05:14:55.103046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.400 [2024-11-26 05:14:55.115746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.400 [2024-11-26 05:14:55.115776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.400 [2024-11-26 05:14:55.126472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.400 [2024-11-26 05:14:55.126502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.400 [2024-11-26 05:14:55.137712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.400 [2024-11-26 05:14:55.137743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.400 [2024-11-26 05:14:55.150226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.400 [2024-11-26 05:14:55.150258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.400 [2024-11-26 05:14:55.160230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.400 [2024-11-26 05:14:55.160261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.171896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.171928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.182782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.182813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.193496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.193527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.204534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.204564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.215280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.215310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.226224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.226255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.237153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.237184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.248196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.248227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.259014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.259045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.269748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.269779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.283117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.283148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.293508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.293539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.305106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.305137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.315951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.315982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.327103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.327134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.337899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.337931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.348876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.348907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.360098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.360130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.373060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.373091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.383318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.383350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.394527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.394558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.407268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.407298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.660 [2024-11-26 05:14:55.417658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.660 [2024-11-26 05:14:55.417701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.920 [2024-11-26 05:14:55.428966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.920 [2024-11-26 05:14:55.428999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.920 [2024-11-26 05:14:55.442026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.920 [2024-11-26 05:14:55.442057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.920 [2024-11-26 05:14:55.452844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.920 [2024-11-26 05:14:55.452875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.920 [2024-11-26 05:14:55.464068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.920 [2024-11-26 05:14:55.464098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.920 [2024-11-26 05:14:55.475361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.920 [2024-11-26 05:14:55.475392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.920 [2024-11-26 05:14:55.486512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.920 [2024-11-26 05:14:55.486544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.920 [2024-11-26 05:14:55.499482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.920 [2024-11-26 05:14:55.499513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.920 [2024-11-26 05:14:55.509965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.920 [2024-11-26 05:14:55.509996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.920 [2024-11-26 05:14:55.521171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.521202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.533266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.533297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.543015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.543046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.555268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.555298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.566362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.566393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.579472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.579504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.589570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.589600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.600783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.600814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.613359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.613390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.623891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.623921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.634924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.634955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.645806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.645836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.657027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.657058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.668337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.668367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:53.921 [2024-11-26 05:14:55.681214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:53.921 [2024-11-26 05:14:55.681246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.691708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.691741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.702362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.702392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.713059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.713089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.724190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.724221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.735469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.735500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.746815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.746846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.757113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.757144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.768010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.768041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.778845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.778875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.790016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.790048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.802832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.802863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.813443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.813475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.824288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.824320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.835044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.835076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.845962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.845993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.856830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.856861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.867858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.867888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.878629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.878661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.889387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.889418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.901535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.901566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.911755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.911786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.923080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.923111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.182 [2024-11-26 05:14:55.934068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.182 [2024-11-26 05:14:55.934098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:55.946950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:55.946982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:55.956846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:55.956877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:55.967981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:55.968012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:55.979164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:55.979196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:55.990429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:55.990461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.003157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.003188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.013647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.013679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.024921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.024951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.035721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.035752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.047161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.047192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.058358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.058390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.069387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.069419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.080195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.080227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.091038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.091079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.103932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.103963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.113978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.114010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.124862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.124893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.137248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.137278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.146871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.146902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.158786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.158819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.170173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.170204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.180953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.180984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.193605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.193647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.442 [2024-11-26 05:14:56.204127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.442 [2024-11-26 05:14:56.204158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.215542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.215574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.226922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.226953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.238459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.238490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.249557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.249588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.260619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.260650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.271955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.271986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.284905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.284937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.295874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.295905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.307209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.307247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.320267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.320306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.330981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.331011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.342366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.342397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.353614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.353644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.364920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.364951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.376136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.376167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.702 [2024-11-26 05:14:56.387495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.702 [2024-11-26 05:14:56.387526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.703 [2024-11-26 05:14:56.398440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.703 [2024-11-26 05:14:56.398471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.703 [2024-11-26 05:14:56.409471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.703 [2024-11-26 05:14:56.409503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.703 [2024-11-26 05:14:56.422403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.703 [2024-11-26 05:14:56.422435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.703 [2024-11-26 05:14:56.433253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.703 [2024-11-26 05:14:56.433283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.703 [2024-11-26 05:14:56.444408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.703 [2024-11-26 05:14:56.444438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.703 [2024-11-26 05:14:56.455528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.703 [2024-11-26 05:14:56.455558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.703 [2024-11-26 05:14:56.466481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.703 [2024-11-26 05:14:56.466511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.477976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.478008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.488945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.488975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.501584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.501616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.511560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.511591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.523451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.523495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.536579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.536610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.546928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.546959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.558204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.558234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.571149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.571180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.581612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.581642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.592494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.592525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.605394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.605425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.616121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.616152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.627369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.627400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.640504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.640536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.651140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.651171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.662238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.662268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.672870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.672901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.684066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.684098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.695124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.695154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.706454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.706484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.963 [2024-11-26 05:14:56.717438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:54.963 [2024-11-26 05:14:56.717468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.728640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.728672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.739710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.739747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.750848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.750879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.761967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.761998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.774658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.774699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.785423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.785454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.796508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.796540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.809493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.809524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.819766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.819797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.830817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.830849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.843291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.843333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.853066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.853098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.863758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.863788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.875181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.875212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.886208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.886239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.896978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.897009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.909788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.909819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.919966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.919996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.931223] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.931255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.944122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.944153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.954608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.954639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.965309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.965340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.224 [2024-11-26 05:14:56.976144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.224 [2024-11-26 05:14:56.976176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.225 [2024-11-26 05:14:56.987179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.225 [2024-11-26 05:14:56.987211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:56.998254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:56.998285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.009350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.009381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.020648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.020679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.032003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.032034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.043006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.043037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.054095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.054126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.064639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.064670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.075789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.075820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.086981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.087011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.097751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.097782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.109172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.109204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.120127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.120158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.131217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.131249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.142280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.142311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.155361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.155392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.165906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.165937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.176983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.177014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.188140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.188171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.199132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.199163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.210320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.210351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.221400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.221432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.234330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.234363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.484 [2024-11-26 05:14:57.244634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.484 [2024-11-26 05:14:57.244666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.744 [2024-11-26 05:14:57.255598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.744 [2024-11-26 05:14:57.255629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.744 [2024-11-26 05:14:57.267358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.744 [2024-11-26 05:14:57.267389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.744 [2024-11-26 05:14:57.278982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.744 [2024-11-26 05:14:57.279015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.744 [2024-11-26 05:14:57.290219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.744 [2024-11-26 05:14:57.290250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.303146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.303179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.313119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.313150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.323470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.323499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.334206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.334237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.345400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.345432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.358605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.358637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.368819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.368848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.380216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.380247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.390984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.391027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.402147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.402178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.413654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.413694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.425349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.425380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.436774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.436802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.450049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.450081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.460244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.460276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.471165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.471196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.483629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.483661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.493846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.493874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.745 [2024-11-26 05:14:57.504667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.745 [2024-11-26 05:14:57.504707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.005 [2024-11-26 05:14:57.517985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.005 [2024-11-26 05:14:57.518030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.005 [2024-11-26 05:14:57.528571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.528603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.540055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.540086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.553426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.553457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.564004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.564036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.574912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.574941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.586294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.586326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.597671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.597713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.608947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.608975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.620027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.620058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.631577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.631608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.644774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.644804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.655079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.655110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.665920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.665949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.676857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.676886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.688305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.688336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.699369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.699399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.710392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.710425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.721762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.721792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.732910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.732939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.744623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.744654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.755740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.755768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.006 [2024-11-26 05:14:57.767156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.006 [2024-11-26 05:14:57.767187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.778995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.779041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.789889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.789917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.801351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.801391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.812491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.812521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.826035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.826067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.836723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.836754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.847511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.847541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.859716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.859748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.869664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.869705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.880991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.881021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.891914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.891945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.903603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.903634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.914382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.914412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.925357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.925388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.936247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.936278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.949530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.949560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.960301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.960332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.971238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.971270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.984003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.984034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:57.994279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:57.994309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:58.005137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:58.005167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:58.015821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:58.015861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.265 [2024-11-26 05:14:58.026553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.265 [2024-11-26 05:14:58.026584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.039299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.039331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.049605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.049636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.060260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.060291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.071211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.071242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.084145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.084175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.095705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.095737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.105114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.105144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.117188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.117219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.128187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.128217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.138910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.138941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.149882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.149912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.160886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.160916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.172005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.172036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.183523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.183553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.196760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.196790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.207512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.207543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.218508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.218540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.231676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.231724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.242653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.242695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.253854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.253885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.266706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.266736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.276962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.276993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.524 [2024-11-26 05:14:58.288162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.524 [2024-11-26 05:14:58.288192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.301148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.301180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.311225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.311256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.322206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.322236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.335077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.335108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.345543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.345575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.356610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.356641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.369337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.369369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.379638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.379670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.390634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.390666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.401771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.401803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.412924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.412955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.424088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.424122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.435359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.435390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.447034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.447076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.458332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.458363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.471528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.471559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.482181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.482212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.493115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.493145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.504743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.504774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.515916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.515947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.529047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.529078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.783 [2024-11-26 05:14:58.539351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.783 [2024-11-26 05:14:58.539381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.550188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.550219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 00:18:57.043 Latency(us) 00:18:57.043 [2024-11-26T04:14:58.811Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:57.043 [2024-11-26T04:14:58.811Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:18:57.043 Nvme1n1 : 5.01 11474.36 89.64 0.00 0.00 11139.45 4781.70 22136.60 00:18:57.043 [2024-11-26T04:14:58.811Z] =================================================================================================================== 00:18:57.043 [2024-11-26T04:14:58.811Z] Total : 11474.36 89.64 0.00 0.00 11139.45 4781.70 22136.60 00:18:57.043 [2024-11-26 05:14:58.557783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.557813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.565810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.565838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.573845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.573885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.581907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.581966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.589938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.589996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.597949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.598004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.605958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.606012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.613977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.614030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.622009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.622066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.630031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.630084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.642098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.642169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.650097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.650153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.658112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.658169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.666126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.666181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.674143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.674197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.682175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.682230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.690197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.690248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.698210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.698262] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.706199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.706229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.714221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.714252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.722286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.722339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.730312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.730366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.738323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.738372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.746315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.746346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.754363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.754406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.043 [2024-11-26 05:14:58.762396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.043 [2024-11-26 05:14:58.762451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.044 [2024-11-26 05:14:58.770420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.044 [2024-11-26 05:14:58.770474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.044 [2024-11-26 05:14:58.778396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.044 [2024-11-26 05:14:58.778423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.044 [2024-11-26 05:14:58.786410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.044 [2024-11-26 05:14:58.786435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.044 [2024-11-26 05:14:58.794432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.044 [2024-11-26 05:14:58.794457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.044 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (3306325) - No such process 00:18:57.044 05:14:58 -- target/zcopy.sh@49 -- # wait 3306325 00:18:57.044 05:14:58 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:18:57.044 05:14:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.044 05:14:58 -- common/autotest_common.sh@10 -- # set +x 00:18:57.044 05:14:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.304 05:14:58 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:18:57.304 05:14:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.304 05:14:58 -- common/autotest_common.sh@10 -- # set +x 00:18:57.304 delay0 00:18:57.304 05:14:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.304 05:14:58 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:18:57.304 05:14:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.304 05:14:58 -- common/autotest_common.sh@10 -- # set +x 00:18:57.304 05:14:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.304 05:14:58 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:18:57.304 EAL: No free 2048 kB hugepages reported on node 1 00:18:57.304 [2024-11-26 05:14:58.877026] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:19:03.868 Initializing NVMe Controllers 00:19:03.868 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:03.868 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:03.868 Initialization complete. Launching workers. 00:19:03.868 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 849 00:19:03.868 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 1133, failed to submit 36 00:19:03.868 success 925, unsuccess 208, failed 0 00:19:03.868 05:15:05 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:19:03.868 05:15:05 -- target/zcopy.sh@60 -- # nvmftestfini 00:19:03.868 05:15:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:03.868 05:15:05 -- nvmf/common.sh@116 -- # sync 00:19:03.868 05:15:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:03.868 05:15:05 -- nvmf/common.sh@119 -- # set +e 00:19:03.868 05:15:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:03.868 05:15:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:03.868 rmmod nvme_tcp 00:19:03.868 rmmod nvme_fabrics 00:19:03.868 rmmod nvme_keyring 00:19:03.868 05:15:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:03.868 05:15:05 -- nvmf/common.sh@123 -- # set -e 00:19:03.868 05:15:05 -- nvmf/common.sh@124 -- # return 0 00:19:03.868 05:15:05 -- nvmf/common.sh@477 -- # '[' -n 3304813 ']' 00:19:03.868 05:15:05 -- nvmf/common.sh@478 -- # killprocess 3304813 00:19:03.868 05:15:05 -- common/autotest_common.sh@936 -- # '[' -z 3304813 ']' 00:19:03.868 05:15:05 -- common/autotest_common.sh@940 -- # kill -0 3304813 00:19:03.868 05:15:05 -- common/autotest_common.sh@941 -- # uname 00:19:03.868 05:15:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:03.868 05:15:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3304813 00:19:03.868 05:15:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:03.868 05:15:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:03.868 05:15:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3304813' 00:19:03.868 killing process with pid 3304813 00:19:03.868 05:15:05 -- common/autotest_common.sh@955 -- # kill 3304813 00:19:03.868 05:15:05 -- common/autotest_common.sh@960 -- # wait 3304813 00:19:03.868 05:15:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:03.868 05:15:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:03.868 05:15:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:03.868 05:15:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:03.868 05:15:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:03.868 05:15:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:03.869 05:15:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:03.869 05:15:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:06.401 05:15:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:06.401 00:19:06.401 real 0m28.684s 00:19:06.401 user 0m42.128s 00:19:06.401 sys 0m8.113s 00:19:06.401 05:15:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:06.401 05:15:07 -- common/autotest_common.sh@10 -- # set +x 00:19:06.401 ************************************ 00:19:06.401 END TEST nvmf_zcopy 00:19:06.401 ************************************ 00:19:06.401 05:15:07 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:06.401 05:15:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:06.401 05:15:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:06.401 05:15:07 -- common/autotest_common.sh@10 -- # set +x 00:19:06.401 ************************************ 00:19:06.401 START TEST nvmf_nmic 00:19:06.401 ************************************ 00:19:06.401 05:15:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:06.401 * Looking for test storage... 00:19:06.401 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:06.401 05:15:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:06.401 05:15:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:06.401 05:15:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:06.401 05:15:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:06.401 05:15:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:06.401 05:15:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:06.401 05:15:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:06.401 05:15:07 -- scripts/common.sh@335 -- # IFS=.-: 00:19:06.401 05:15:07 -- scripts/common.sh@335 -- # read -ra ver1 00:19:06.401 05:15:07 -- scripts/common.sh@336 -- # IFS=.-: 00:19:06.401 05:15:07 -- scripts/common.sh@336 -- # read -ra ver2 00:19:06.401 05:15:07 -- scripts/common.sh@337 -- # local 'op=<' 00:19:06.401 05:15:07 -- scripts/common.sh@339 -- # ver1_l=2 00:19:06.401 05:15:07 -- scripts/common.sh@340 -- # ver2_l=1 00:19:06.401 05:15:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:06.401 05:15:07 -- scripts/common.sh@343 -- # case "$op" in 00:19:06.401 05:15:07 -- scripts/common.sh@344 -- # : 1 00:19:06.401 05:15:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:06.401 05:15:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:06.401 05:15:07 -- scripts/common.sh@364 -- # decimal 1 00:19:06.401 05:15:07 -- scripts/common.sh@352 -- # local d=1 00:19:06.401 05:15:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:06.401 05:15:07 -- scripts/common.sh@354 -- # echo 1 00:19:06.401 05:15:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:06.401 05:15:07 -- scripts/common.sh@365 -- # decimal 2 00:19:06.401 05:15:07 -- scripts/common.sh@352 -- # local d=2 00:19:06.401 05:15:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:06.401 05:15:07 -- scripts/common.sh@354 -- # echo 2 00:19:06.401 05:15:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:06.401 05:15:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:06.401 05:15:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:06.401 05:15:07 -- scripts/common.sh@367 -- # return 0 00:19:06.401 05:15:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:06.401 05:15:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:06.401 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:06.401 --rc genhtml_branch_coverage=1 00:19:06.401 --rc genhtml_function_coverage=1 00:19:06.401 --rc genhtml_legend=1 00:19:06.401 --rc geninfo_all_blocks=1 00:19:06.401 --rc geninfo_unexecuted_blocks=1 00:19:06.401 00:19:06.401 ' 00:19:06.401 05:15:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:06.401 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:06.401 --rc genhtml_branch_coverage=1 00:19:06.401 --rc genhtml_function_coverage=1 00:19:06.401 --rc genhtml_legend=1 00:19:06.401 --rc geninfo_all_blocks=1 00:19:06.401 --rc geninfo_unexecuted_blocks=1 00:19:06.401 00:19:06.401 ' 00:19:06.401 05:15:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:06.401 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:06.401 --rc genhtml_branch_coverage=1 00:19:06.401 --rc genhtml_function_coverage=1 00:19:06.401 --rc genhtml_legend=1 00:19:06.401 --rc geninfo_all_blocks=1 00:19:06.401 --rc geninfo_unexecuted_blocks=1 00:19:06.401 00:19:06.401 ' 00:19:06.401 05:15:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:06.401 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:06.401 --rc genhtml_branch_coverage=1 00:19:06.401 --rc genhtml_function_coverage=1 00:19:06.401 --rc genhtml_legend=1 00:19:06.401 --rc geninfo_all_blocks=1 00:19:06.401 --rc geninfo_unexecuted_blocks=1 00:19:06.401 00:19:06.401 ' 00:19:06.401 05:15:07 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:06.401 05:15:07 -- nvmf/common.sh@7 -- # uname -s 00:19:06.401 05:15:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:06.401 05:15:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:06.401 05:15:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:06.401 05:15:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:06.401 05:15:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:06.401 05:15:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:06.401 05:15:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:06.401 05:15:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:06.401 05:15:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:06.401 05:15:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:06.401 05:15:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:06.401 05:15:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:06.401 05:15:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:06.401 05:15:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:06.401 05:15:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:06.401 05:15:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:06.401 05:15:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:06.401 05:15:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:06.401 05:15:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:06.401 05:15:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:06.401 05:15:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:06.401 05:15:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:06.401 05:15:07 -- paths/export.sh@5 -- # export PATH 00:19:06.402 05:15:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:06.402 05:15:07 -- nvmf/common.sh@46 -- # : 0 00:19:06.402 05:15:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:06.402 05:15:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:06.402 05:15:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:06.402 05:15:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:06.402 05:15:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:06.402 05:15:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:06.402 05:15:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:06.402 05:15:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:06.402 05:15:07 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:06.402 05:15:07 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:06.402 05:15:07 -- target/nmic.sh@14 -- # nvmftestinit 00:19:06.402 05:15:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:06.402 05:15:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:06.402 05:15:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:06.402 05:15:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:06.402 05:15:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:06.402 05:15:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:06.402 05:15:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:06.402 05:15:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:06.402 05:15:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:06.402 05:15:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:06.402 05:15:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:06.402 05:15:07 -- common/autotest_common.sh@10 -- # set +x 00:19:08.310 05:15:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:08.310 05:15:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:08.310 05:15:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:08.310 05:15:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:08.310 05:15:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:08.310 05:15:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:08.310 05:15:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:08.310 05:15:09 -- nvmf/common.sh@294 -- # net_devs=() 00:19:08.310 05:15:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:08.310 05:15:09 -- nvmf/common.sh@295 -- # e810=() 00:19:08.310 05:15:09 -- nvmf/common.sh@295 -- # local -ga e810 00:19:08.310 05:15:09 -- nvmf/common.sh@296 -- # x722=() 00:19:08.310 05:15:09 -- nvmf/common.sh@296 -- # local -ga x722 00:19:08.310 05:15:09 -- nvmf/common.sh@297 -- # mlx=() 00:19:08.310 05:15:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:08.310 05:15:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:08.310 05:15:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:08.310 05:15:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:08.310 05:15:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:08.310 05:15:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:08.310 05:15:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:08.310 05:15:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:08.310 05:15:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:08.310 05:15:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:08.310 05:15:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:08.310 05:15:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:08.310 05:15:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:08.310 05:15:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:08.310 05:15:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:08.310 05:15:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:08.310 05:15:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:08.310 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:08.310 05:15:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:08.310 05:15:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:08.310 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:08.310 05:15:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:08.310 05:15:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:08.310 05:15:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:08.310 05:15:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:08.310 05:15:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:08.310 05:15:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:08.311 05:15:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:08.311 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:08.311 05:15:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:08.311 05:15:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:08.311 05:15:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:08.311 05:15:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:08.311 05:15:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:08.311 05:15:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:08.311 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:08.311 05:15:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:08.311 05:15:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:08.311 05:15:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:08.311 05:15:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:08.311 05:15:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:08.311 05:15:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:08.311 05:15:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:08.311 05:15:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:08.311 05:15:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:08.311 05:15:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:08.311 05:15:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:08.311 05:15:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:08.311 05:15:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:08.311 05:15:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:08.311 05:15:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:08.311 05:15:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:08.311 05:15:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:08.311 05:15:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:08.311 05:15:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:08.311 05:15:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:08.311 05:15:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:08.311 05:15:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:08.311 05:15:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:08.311 05:15:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:08.311 05:15:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:08.311 05:15:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:08.311 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:08.311 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:19:08.311 00:19:08.311 --- 10.0.0.2 ping statistics --- 00:19:08.311 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:08.311 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:19:08.311 05:15:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:08.311 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:08.311 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.175 ms 00:19:08.311 00:19:08.311 --- 10.0.0.1 ping statistics --- 00:19:08.311 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:08.311 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:19:08.311 05:15:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:08.311 05:15:09 -- nvmf/common.sh@410 -- # return 0 00:19:08.311 05:15:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:08.311 05:15:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:08.311 05:15:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:08.311 05:15:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:08.311 05:15:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:08.311 05:15:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:08.311 05:15:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:08.311 05:15:09 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:08.311 05:15:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:08.311 05:15:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:08.311 05:15:09 -- common/autotest_common.sh@10 -- # set +x 00:19:08.311 05:15:09 -- nvmf/common.sh@469 -- # nvmfpid=3310376 00:19:08.311 05:15:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:08.311 05:15:09 -- nvmf/common.sh@470 -- # waitforlisten 3310376 00:19:08.311 05:15:09 -- common/autotest_common.sh@829 -- # '[' -z 3310376 ']' 00:19:08.311 05:15:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:08.311 05:15:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:08.311 05:15:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:08.311 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:08.311 05:15:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:08.311 05:15:09 -- common/autotest_common.sh@10 -- # set +x 00:19:08.311 [2024-11-26 05:15:09.926147] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:08.311 [2024-11-26 05:15:09.926234] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:08.311 EAL: No free 2048 kB hugepages reported on node 1 00:19:08.311 [2024-11-26 05:15:09.992344] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:08.570 [2024-11-26 05:15:10.093866] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:08.570 [2024-11-26 05:15:10.094032] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:08.570 [2024-11-26 05:15:10.094050] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:08.570 [2024-11-26 05:15:10.094071] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:08.570 [2024-11-26 05:15:10.094134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:08.570 [2024-11-26 05:15:10.094197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:08.570 [2024-11-26 05:15:10.094235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:08.570 [2024-11-26 05:15:10.094237] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:09.136 05:15:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:09.136 05:15:10 -- common/autotest_common.sh@862 -- # return 0 00:19:09.396 05:15:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:09.396 05:15:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:09.396 05:15:10 -- common/autotest_common.sh@10 -- # set +x 00:19:09.396 05:15:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:09.396 05:15:10 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:09.396 05:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:09.396 05:15:10 -- common/autotest_common.sh@10 -- # set +x 00:19:09.396 [2024-11-26 05:15:10.927337] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:09.396 05:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:09.396 05:15:10 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:09.396 05:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:09.396 05:15:10 -- common/autotest_common.sh@10 -- # set +x 00:19:09.396 Malloc0 00:19:09.396 05:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:09.396 05:15:10 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:09.396 05:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:09.396 05:15:10 -- common/autotest_common.sh@10 -- # set +x 00:19:09.396 05:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:09.396 05:15:10 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:09.396 05:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:09.396 05:15:10 -- common/autotest_common.sh@10 -- # set +x 00:19:09.396 05:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:09.396 05:15:10 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:09.396 05:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:09.396 05:15:10 -- common/autotest_common.sh@10 -- # set +x 00:19:09.396 [2024-11-26 05:15:10.979579] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:09.396 05:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:09.396 05:15:10 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:09.396 test case1: single bdev can't be used in multiple subsystems 00:19:09.396 05:15:10 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:09.396 05:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:09.396 05:15:10 -- common/autotest_common.sh@10 -- # set +x 00:19:09.396 05:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:09.396 05:15:10 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:09.396 05:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:09.396 05:15:10 -- common/autotest_common.sh@10 -- # set +x 00:19:09.396 05:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:09.396 05:15:10 -- target/nmic.sh@28 -- # nmic_status=0 00:19:09.396 05:15:10 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:09.396 05:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:09.396 05:15:10 -- common/autotest_common.sh@10 -- # set +x 00:19:09.396 [2024-11-26 05:15:11.003397] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:09.396 [2024-11-26 05:15:11.003427] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:09.396 [2024-11-26 05:15:11.003441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.396 request: 00:19:09.396 { 00:19:09.396 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:09.396 "namespace": { 00:19:09.396 "bdev_name": "Malloc0" 00:19:09.396 }, 00:19:09.396 "method": "nvmf_subsystem_add_ns", 00:19:09.396 "req_id": 1 00:19:09.396 } 00:19:09.396 Got JSON-RPC error response 00:19:09.396 response: 00:19:09.396 { 00:19:09.396 "code": -32602, 00:19:09.396 "message": "Invalid parameters" 00:19:09.396 } 00:19:09.396 05:15:11 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:19:09.396 05:15:11 -- target/nmic.sh@29 -- # nmic_status=1 00:19:09.396 05:15:11 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:09.396 05:15:11 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:09.396 Adding namespace failed - expected result. 00:19:09.396 05:15:11 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:09.396 test case2: host connect to nvmf target in multiple paths 00:19:09.396 05:15:11 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:19:09.396 05:15:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:09.396 05:15:11 -- common/autotest_common.sh@10 -- # set +x 00:19:09.396 [2024-11-26 05:15:11.011510] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:09.396 05:15:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:09.396 05:15:11 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:09.964 05:15:11 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:19:10.898 05:15:12 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:10.898 05:15:12 -- common/autotest_common.sh@1187 -- # local i=0 00:19:10.898 05:15:12 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:10.898 05:15:12 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:10.898 05:15:12 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:12.803 05:15:14 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:12.803 05:15:14 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:12.803 05:15:14 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:12.803 05:15:14 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:12.803 05:15:14 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:12.803 05:15:14 -- common/autotest_common.sh@1197 -- # return 0 00:19:12.803 05:15:14 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:12.803 [global] 00:19:12.803 thread=1 00:19:12.803 invalidate=1 00:19:12.803 rw=write 00:19:12.803 time_based=1 00:19:12.803 runtime=1 00:19:12.803 ioengine=libaio 00:19:12.803 direct=1 00:19:12.803 bs=4096 00:19:12.803 iodepth=1 00:19:12.803 norandommap=0 00:19:12.803 numjobs=1 00:19:12.803 00:19:12.803 verify_dump=1 00:19:12.803 verify_backlog=512 00:19:12.803 verify_state_save=0 00:19:12.803 do_verify=1 00:19:12.803 verify=crc32c-intel 00:19:12.803 [job0] 00:19:12.803 filename=/dev/nvme0n1 00:19:12.803 Could not set queue depth (nvme0n1) 00:19:12.803 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:12.803 fio-3.35 00:19:12.803 Starting 1 thread 00:19:14.176 00:19:14.176 job0: (groupid=0, jobs=1): err= 0: pid=3311041: Tue Nov 26 05:15:15 2024 00:19:14.176 read: IOPS=20, BW=81.7KiB/s (83.7kB/s)(84.0KiB/1028msec) 00:19:14.177 slat (nsec): min=7439, max=35460, avg=17788.95, stdev=7503.21 00:19:14.177 clat (usec): min=40896, max=42056, avg=41279.39, stdev=476.37 00:19:14.177 lat (usec): min=40909, max=42070, avg=41297.18, stdev=478.88 00:19:14.177 clat percentiles (usec): 00:19:14.177 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:14.177 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:14.177 | 70.00th=[41157], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:14.177 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:14.177 | 99.99th=[42206] 00:19:14.177 write: IOPS=498, BW=1992KiB/s (2040kB/s)(2048KiB/1028msec); 0 zone resets 00:19:14.177 slat (usec): min=7, max=40663, avg=152.24, stdev=2219.63 00:19:14.177 clat (usec): min=133, max=311, avg=157.94, stdev=16.50 00:19:14.177 lat (usec): min=141, max=40974, avg=310.18, stdev=2229.00 00:19:14.177 clat percentiles (usec): 00:19:14.177 | 1.00th=[ 137], 5.00th=[ 141], 10.00th=[ 145], 20.00th=[ 149], 00:19:14.177 | 30.00th=[ 151], 40.00th=[ 153], 50.00th=[ 157], 60.00th=[ 159], 00:19:14.177 | 70.00th=[ 161], 80.00th=[ 165], 90.00th=[ 172], 95.00th=[ 182], 00:19:14.177 | 99.00th=[ 225], 99.50th=[ 251], 99.90th=[ 310], 99.95th=[ 310], 00:19:14.177 | 99.99th=[ 310] 00:19:14.177 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:14.177 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:14.177 lat (usec) : 250=95.50%, 500=0.56% 00:19:14.177 lat (msec) : 50=3.94% 00:19:14.177 cpu : usr=0.49%, sys=0.58%, ctx=538, majf=0, minf=1 00:19:14.177 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:14.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.177 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.177 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:14.177 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:14.177 00:19:14.177 Run status group 0 (all jobs): 00:19:14.177 READ: bw=81.7KiB/s (83.7kB/s), 81.7KiB/s-81.7KiB/s (83.7kB/s-83.7kB/s), io=84.0KiB (86.0kB), run=1028-1028msec 00:19:14.177 WRITE: bw=1992KiB/s (2040kB/s), 1992KiB/s-1992KiB/s (2040kB/s-2040kB/s), io=2048KiB (2097kB), run=1028-1028msec 00:19:14.177 00:19:14.177 Disk stats (read/write): 00:19:14.177 nvme0n1: ios=52/512, merge=0/0, ticks=1692/78, in_queue=1770, util=99.70% 00:19:14.177 05:15:15 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:14.177 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:14.177 05:15:15 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:14.177 05:15:15 -- common/autotest_common.sh@1208 -- # local i=0 00:19:14.177 05:15:15 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:14.177 05:15:15 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:14.177 05:15:15 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:14.177 05:15:15 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:14.177 05:15:15 -- common/autotest_common.sh@1220 -- # return 0 00:19:14.177 05:15:15 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:14.177 05:15:15 -- target/nmic.sh@53 -- # nvmftestfini 00:19:14.177 05:15:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:14.177 05:15:15 -- nvmf/common.sh@116 -- # sync 00:19:14.177 05:15:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:14.177 05:15:15 -- nvmf/common.sh@119 -- # set +e 00:19:14.177 05:15:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:14.177 05:15:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:14.177 rmmod nvme_tcp 00:19:14.177 rmmod nvme_fabrics 00:19:14.177 rmmod nvme_keyring 00:19:14.177 05:15:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:14.177 05:15:15 -- nvmf/common.sh@123 -- # set -e 00:19:14.177 05:15:15 -- nvmf/common.sh@124 -- # return 0 00:19:14.177 05:15:15 -- nvmf/common.sh@477 -- # '[' -n 3310376 ']' 00:19:14.177 05:15:15 -- nvmf/common.sh@478 -- # killprocess 3310376 00:19:14.177 05:15:15 -- common/autotest_common.sh@936 -- # '[' -z 3310376 ']' 00:19:14.177 05:15:15 -- common/autotest_common.sh@940 -- # kill -0 3310376 00:19:14.177 05:15:15 -- common/autotest_common.sh@941 -- # uname 00:19:14.177 05:15:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:14.177 05:15:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3310376 00:19:14.437 05:15:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:14.437 05:15:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:14.437 05:15:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3310376' 00:19:14.437 killing process with pid 3310376 00:19:14.437 05:15:15 -- common/autotest_common.sh@955 -- # kill 3310376 00:19:14.437 05:15:15 -- common/autotest_common.sh@960 -- # wait 3310376 00:19:14.695 05:15:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:14.696 05:15:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:14.696 05:15:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:14.696 05:15:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:14.696 05:15:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:14.696 05:15:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:14.696 05:15:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:14.696 05:15:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:16.601 05:15:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:16.601 00:19:16.601 real 0m10.641s 00:19:16.601 user 0m25.567s 00:19:16.601 sys 0m2.361s 00:19:16.601 05:15:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:16.601 05:15:18 -- common/autotest_common.sh@10 -- # set +x 00:19:16.601 ************************************ 00:19:16.601 END TEST nvmf_nmic 00:19:16.601 ************************************ 00:19:16.601 05:15:18 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:16.601 05:15:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:16.601 05:15:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:16.601 05:15:18 -- common/autotest_common.sh@10 -- # set +x 00:19:16.601 ************************************ 00:19:16.601 START TEST nvmf_fio_target 00:19:16.601 ************************************ 00:19:16.601 05:15:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:16.601 * Looking for test storage... 00:19:16.601 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:16.601 05:15:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:16.601 05:15:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:16.601 05:15:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:16.860 05:15:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:16.860 05:15:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:16.860 05:15:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:16.860 05:15:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:16.860 05:15:18 -- scripts/common.sh@335 -- # IFS=.-: 00:19:16.860 05:15:18 -- scripts/common.sh@335 -- # read -ra ver1 00:19:16.860 05:15:18 -- scripts/common.sh@336 -- # IFS=.-: 00:19:16.860 05:15:18 -- scripts/common.sh@336 -- # read -ra ver2 00:19:16.860 05:15:18 -- scripts/common.sh@337 -- # local 'op=<' 00:19:16.860 05:15:18 -- scripts/common.sh@339 -- # ver1_l=2 00:19:16.860 05:15:18 -- scripts/common.sh@340 -- # ver2_l=1 00:19:16.860 05:15:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:16.860 05:15:18 -- scripts/common.sh@343 -- # case "$op" in 00:19:16.860 05:15:18 -- scripts/common.sh@344 -- # : 1 00:19:16.860 05:15:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:16.860 05:15:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:16.860 05:15:18 -- scripts/common.sh@364 -- # decimal 1 00:19:16.860 05:15:18 -- scripts/common.sh@352 -- # local d=1 00:19:16.860 05:15:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:16.860 05:15:18 -- scripts/common.sh@354 -- # echo 1 00:19:16.860 05:15:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:16.860 05:15:18 -- scripts/common.sh@365 -- # decimal 2 00:19:16.860 05:15:18 -- scripts/common.sh@352 -- # local d=2 00:19:16.860 05:15:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:16.860 05:15:18 -- scripts/common.sh@354 -- # echo 2 00:19:16.860 05:15:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:16.860 05:15:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:16.860 05:15:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:16.861 05:15:18 -- scripts/common.sh@367 -- # return 0 00:19:16.861 05:15:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:16.861 05:15:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:16.861 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:16.861 --rc genhtml_branch_coverage=1 00:19:16.861 --rc genhtml_function_coverage=1 00:19:16.861 --rc genhtml_legend=1 00:19:16.861 --rc geninfo_all_blocks=1 00:19:16.861 --rc geninfo_unexecuted_blocks=1 00:19:16.861 00:19:16.861 ' 00:19:16.861 05:15:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:16.861 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:16.861 --rc genhtml_branch_coverage=1 00:19:16.861 --rc genhtml_function_coverage=1 00:19:16.861 --rc genhtml_legend=1 00:19:16.861 --rc geninfo_all_blocks=1 00:19:16.861 --rc geninfo_unexecuted_blocks=1 00:19:16.861 00:19:16.861 ' 00:19:16.861 05:15:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:16.861 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:16.861 --rc genhtml_branch_coverage=1 00:19:16.861 --rc genhtml_function_coverage=1 00:19:16.861 --rc genhtml_legend=1 00:19:16.861 --rc geninfo_all_blocks=1 00:19:16.861 --rc geninfo_unexecuted_blocks=1 00:19:16.861 00:19:16.861 ' 00:19:16.861 05:15:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:16.861 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:16.861 --rc genhtml_branch_coverage=1 00:19:16.861 --rc genhtml_function_coverage=1 00:19:16.861 --rc genhtml_legend=1 00:19:16.861 --rc geninfo_all_blocks=1 00:19:16.861 --rc geninfo_unexecuted_blocks=1 00:19:16.861 00:19:16.861 ' 00:19:16.861 05:15:18 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:16.861 05:15:18 -- nvmf/common.sh@7 -- # uname -s 00:19:16.861 05:15:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:16.861 05:15:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:16.861 05:15:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:16.861 05:15:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:16.861 05:15:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:16.861 05:15:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:16.861 05:15:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:16.861 05:15:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:16.861 05:15:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:16.861 05:15:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:16.861 05:15:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:16.861 05:15:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:16.861 05:15:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:16.861 05:15:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:16.861 05:15:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:16.861 05:15:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:16.861 05:15:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:16.861 05:15:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:16.861 05:15:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:16.861 05:15:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:16.861 05:15:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:16.861 05:15:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:16.861 05:15:18 -- paths/export.sh@5 -- # export PATH 00:19:16.861 05:15:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:16.861 05:15:18 -- nvmf/common.sh@46 -- # : 0 00:19:16.861 05:15:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:16.861 05:15:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:16.861 05:15:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:16.861 05:15:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:16.861 05:15:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:16.861 05:15:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:16.861 05:15:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:16.861 05:15:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:16.861 05:15:18 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:16.861 05:15:18 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:16.861 05:15:18 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:16.861 05:15:18 -- target/fio.sh@16 -- # nvmftestinit 00:19:16.861 05:15:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:16.861 05:15:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:16.861 05:15:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:16.861 05:15:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:16.861 05:15:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:16.861 05:15:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:16.861 05:15:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:16.861 05:15:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:16.861 05:15:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:16.861 05:15:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:16.861 05:15:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:16.861 05:15:18 -- common/autotest_common.sh@10 -- # set +x 00:19:18.766 05:15:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:18.766 05:15:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:18.766 05:15:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:18.766 05:15:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:18.766 05:15:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:18.766 05:15:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:18.766 05:15:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:18.766 05:15:20 -- nvmf/common.sh@294 -- # net_devs=() 00:19:18.766 05:15:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:18.766 05:15:20 -- nvmf/common.sh@295 -- # e810=() 00:19:18.766 05:15:20 -- nvmf/common.sh@295 -- # local -ga e810 00:19:18.766 05:15:20 -- nvmf/common.sh@296 -- # x722=() 00:19:18.766 05:15:20 -- nvmf/common.sh@296 -- # local -ga x722 00:19:18.766 05:15:20 -- nvmf/common.sh@297 -- # mlx=() 00:19:18.766 05:15:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:18.766 05:15:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:18.766 05:15:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:18.766 05:15:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:18.766 05:15:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:18.766 05:15:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:18.766 05:15:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:18.766 05:15:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:18.766 05:15:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:18.766 05:15:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:18.766 05:15:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:18.766 05:15:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:18.766 05:15:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:18.766 05:15:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:18.766 05:15:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:18.766 05:15:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:18.766 05:15:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:18.766 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:18.766 05:15:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:18.766 05:15:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:18.766 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:18.766 05:15:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:18.766 05:15:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:18.766 05:15:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:18.766 05:15:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:18.766 05:15:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:18.766 05:15:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:18.766 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:18.766 05:15:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:18.766 05:15:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:18.766 05:15:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:18.766 05:15:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:18.766 05:15:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:18.766 05:15:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:18.766 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:18.766 05:15:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:18.766 05:15:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:18.766 05:15:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:18.766 05:15:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:18.766 05:15:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:18.766 05:15:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:18.766 05:15:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:18.766 05:15:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:18.766 05:15:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:18.766 05:15:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:18.766 05:15:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:18.766 05:15:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:18.766 05:15:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:18.766 05:15:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:18.766 05:15:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:18.766 05:15:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:18.766 05:15:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:18.766 05:15:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:18.766 05:15:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:18.766 05:15:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:18.766 05:15:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:19.025 05:15:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:19.025 05:15:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:19.025 05:15:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:19.025 05:15:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:19.025 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:19.025 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.277 ms 00:19:19.025 00:19:19.025 --- 10.0.0.2 ping statistics --- 00:19:19.025 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:19.025 rtt min/avg/max/mdev = 0.277/0.277/0.277/0.000 ms 00:19:19.025 05:15:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:19.025 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:19.025 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:19:19.025 00:19:19.025 --- 10.0.0.1 ping statistics --- 00:19:19.025 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:19.025 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:19:19.025 05:15:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:19.025 05:15:20 -- nvmf/common.sh@410 -- # return 0 00:19:19.025 05:15:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:19.025 05:15:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:19.025 05:15:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:19.025 05:15:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:19.025 05:15:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:19.025 05:15:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:19.025 05:15:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:19.025 05:15:20 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:19.025 05:15:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:19.025 05:15:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:19.025 05:15:20 -- common/autotest_common.sh@10 -- # set +x 00:19:19.025 05:15:20 -- nvmf/common.sh@469 -- # nvmfpid=3313141 00:19:19.025 05:15:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:19.025 05:15:20 -- nvmf/common.sh@470 -- # waitforlisten 3313141 00:19:19.025 05:15:20 -- common/autotest_common.sh@829 -- # '[' -z 3313141 ']' 00:19:19.025 05:15:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:19.025 05:15:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:19.025 05:15:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:19.025 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:19.025 05:15:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:19.025 05:15:20 -- common/autotest_common.sh@10 -- # set +x 00:19:19.025 [2024-11-26 05:15:20.654566] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:19.025 [2024-11-26 05:15:20.654658] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:19.025 EAL: No free 2048 kB hugepages reported on node 1 00:19:19.025 [2024-11-26 05:15:20.728108] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:19.285 [2024-11-26 05:15:20.820931] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:19.285 [2024-11-26 05:15:20.821126] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:19.285 [2024-11-26 05:15:20.821147] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:19.285 [2024-11-26 05:15:20.821161] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:19.285 [2024-11-26 05:15:20.821248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:19.285 [2024-11-26 05:15:20.821304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:19.285 [2024-11-26 05:15:20.821357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:19.285 [2024-11-26 05:15:20.821360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:19.852 05:15:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:19.852 05:15:21 -- common/autotest_common.sh@862 -- # return 0 00:19:19.852 05:15:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:19.852 05:15:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:19.852 05:15:21 -- common/autotest_common.sh@10 -- # set +x 00:19:20.112 05:15:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:20.112 05:15:21 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:20.112 [2024-11-26 05:15:21.867127] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:20.373 05:15:21 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:20.632 05:15:22 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:20.632 05:15:22 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:20.890 05:15:22 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:20.890 05:15:22 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:21.149 05:15:22 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:21.149 05:15:22 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:21.407 05:15:22 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:21.407 05:15:22 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:21.665 05:15:23 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:21.924 05:15:23 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:21.924 05:15:23 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:22.182 05:15:23 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:22.182 05:15:23 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:22.440 05:15:24 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:22.440 05:15:24 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:22.698 05:15:24 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:22.957 05:15:24 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:22.957 05:15:24 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:23.215 05:15:24 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:23.215 05:15:24 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:23.474 05:15:25 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:23.731 [2024-11-26 05:15:25.285075] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:23.731 05:15:25 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:23.990 05:15:25 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:24.248 05:15:25 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:24.818 05:15:26 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:24.818 05:15:26 -- common/autotest_common.sh@1187 -- # local i=0 00:19:24.818 05:15:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:24.818 05:15:26 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:24.818 05:15:26 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:24.818 05:15:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:26.799 05:15:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:26.799 05:15:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:26.799 05:15:28 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:26.799 05:15:28 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:26.799 05:15:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:26.799 05:15:28 -- common/autotest_common.sh@1197 -- # return 0 00:19:26.799 05:15:28 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:26.799 [global] 00:19:26.799 thread=1 00:19:26.799 invalidate=1 00:19:26.799 rw=write 00:19:26.799 time_based=1 00:19:26.799 runtime=1 00:19:26.799 ioengine=libaio 00:19:26.799 direct=1 00:19:26.799 bs=4096 00:19:26.799 iodepth=1 00:19:26.799 norandommap=0 00:19:26.799 numjobs=1 00:19:26.799 00:19:26.799 verify_dump=1 00:19:26.799 verify_backlog=512 00:19:26.799 verify_state_save=0 00:19:26.799 do_verify=1 00:19:26.799 verify=crc32c-intel 00:19:26.799 [job0] 00:19:26.799 filename=/dev/nvme0n1 00:19:26.799 [job1] 00:19:26.799 filename=/dev/nvme0n2 00:19:26.799 [job2] 00:19:26.799 filename=/dev/nvme0n3 00:19:26.799 [job3] 00:19:26.799 filename=/dev/nvme0n4 00:19:26.799 Could not set queue depth (nvme0n1) 00:19:26.799 Could not set queue depth (nvme0n2) 00:19:26.799 Could not set queue depth (nvme0n3) 00:19:26.799 Could not set queue depth (nvme0n4) 00:19:27.058 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:27.058 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:27.058 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:27.058 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:27.058 fio-3.35 00:19:27.058 Starting 4 threads 00:19:28.433 00:19:28.433 job0: (groupid=0, jobs=1): err= 0: pid=3314255: Tue Nov 26 05:15:29 2024 00:19:28.433 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:19:28.433 slat (nsec): min=6141, max=54109, avg=13252.66, stdev=6184.37 00:19:28.433 clat (usec): min=202, max=41502, avg=368.03, stdev=1054.29 00:19:28.433 lat (usec): min=209, max=41516, avg=381.28, stdev=1054.43 00:19:28.433 clat percentiles (usec): 00:19:28.433 | 1.00th=[ 223], 5.00th=[ 237], 10.00th=[ 249], 20.00th=[ 277], 00:19:28.433 | 30.00th=[ 297], 40.00th=[ 318], 50.00th=[ 330], 60.00th=[ 343], 00:19:28.433 | 70.00th=[ 363], 80.00th=[ 400], 90.00th=[ 433], 95.00th=[ 478], 00:19:28.433 | 99.00th=[ 627], 99.50th=[ 652], 99.90th=[ 2311], 99.95th=[41681], 00:19:28.433 | 99.99th=[41681] 00:19:28.433 write: IOPS=1775, BW=7101KiB/s (7271kB/s)(7108KiB/1001msec); 0 zone resets 00:19:28.433 slat (nsec): min=7882, max=58807, avg=15478.96, stdev=7439.83 00:19:28.433 clat (usec): min=137, max=1044, avg=209.70, stdev=58.08 00:19:28.433 lat (usec): min=146, max=1053, avg=225.18, stdev=58.89 00:19:28.433 clat percentiles (usec): 00:19:28.433 | 1.00th=[ 149], 5.00th=[ 157], 10.00th=[ 163], 20.00th=[ 176], 00:19:28.433 | 30.00th=[ 186], 40.00th=[ 192], 50.00th=[ 196], 60.00th=[ 202], 00:19:28.433 | 70.00th=[ 210], 80.00th=[ 223], 90.00th=[ 265], 95.00th=[ 334], 00:19:28.433 | 99.00th=[ 433], 99.50th=[ 457], 99.90th=[ 562], 99.95th=[ 1045], 00:19:28.433 | 99.99th=[ 1045] 00:19:28.433 bw ( KiB/s): min= 8192, max= 8192, per=30.47%, avg=8192.00, stdev= 0.00, samples=1 00:19:28.433 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:28.433 lat (usec) : 250=52.40%, 500=45.85%, 750=1.63%, 1000=0.03% 00:19:28.433 lat (msec) : 2=0.03%, 4=0.03%, 50=0.03% 00:19:28.433 cpu : usr=3.00%, sys=7.10%, ctx=3316, majf=0, minf=1 00:19:28.433 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:28.433 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.433 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.433 issued rwts: total=1536,1777,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:28.433 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:28.433 job1: (groupid=0, jobs=1): err= 0: pid=3314256: Tue Nov 26 05:15:29 2024 00:19:28.433 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:19:28.433 slat (nsec): min=4463, max=50689, avg=9601.84, stdev=5440.85 00:19:28.433 clat (usec): min=187, max=15501, avg=246.51, stdev=341.36 00:19:28.433 lat (usec): min=192, max=15506, avg=256.12, stdev=341.57 00:19:28.433 clat percentiles (usec): 00:19:28.433 | 1.00th=[ 196], 5.00th=[ 204], 10.00th=[ 208], 20.00th=[ 215], 00:19:28.433 | 30.00th=[ 219], 40.00th=[ 225], 50.00th=[ 229], 60.00th=[ 235], 00:19:28.433 | 70.00th=[ 241], 80.00th=[ 247], 90.00th=[ 269], 95.00th=[ 310], 00:19:28.433 | 99.00th=[ 465], 99.50th=[ 506], 99.90th=[ 971], 99.95th=[ 1139], 00:19:28.433 | 99.99th=[15533] 00:19:28.433 write: IOPS=2447, BW=9790KiB/s (10.0MB/s)(9800KiB/1001msec); 0 zone resets 00:19:28.433 slat (nsec): min=6193, max=46903, avg=12075.69, stdev=5243.01 00:19:28.433 clat (usec): min=132, max=328, avg=176.51, stdev=24.62 00:19:28.433 lat (usec): min=139, max=337, avg=188.59, stdev=24.66 00:19:28.433 clat percentiles (usec): 00:19:28.433 | 1.00th=[ 141], 5.00th=[ 149], 10.00th=[ 153], 20.00th=[ 157], 00:19:28.433 | 30.00th=[ 161], 40.00th=[ 165], 50.00th=[ 169], 60.00th=[ 178], 00:19:28.433 | 70.00th=[ 184], 80.00th=[ 194], 90.00th=[ 210], 95.00th=[ 225], 00:19:28.433 | 99.00th=[ 260], 99.50th=[ 269], 99.90th=[ 314], 99.95th=[ 326], 00:19:28.433 | 99.99th=[ 330] 00:19:28.433 bw ( KiB/s): min= 9864, max= 9864, per=36.69%, avg=9864.00, stdev= 0.00, samples=1 00:19:28.433 iops : min= 2466, max= 2466, avg=2466.00, stdev= 0.00, samples=1 00:19:28.433 lat (usec) : 250=91.31%, 500=8.43%, 750=0.18%, 1000=0.04% 00:19:28.433 lat (msec) : 2=0.02%, 20=0.02% 00:19:28.433 cpu : usr=2.40%, sys=5.30%, ctx=4499, majf=0, minf=1 00:19:28.433 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:28.433 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.433 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.433 issued rwts: total=2048,2450,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:28.433 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:28.433 job2: (groupid=0, jobs=1): err= 0: pid=3314261: Tue Nov 26 05:15:29 2024 00:19:28.433 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:19:28.433 slat (nsec): min=5938, max=48806, avg=13494.82, stdev=6955.07 00:19:28.433 clat (usec): min=210, max=1219, avg=338.57, stdev=79.06 00:19:28.433 lat (usec): min=217, max=1228, avg=352.07, stdev=81.61 00:19:28.433 clat percentiles (usec): 00:19:28.433 | 1.00th=[ 227], 5.00th=[ 237], 10.00th=[ 247], 20.00th=[ 277], 00:19:28.433 | 30.00th=[ 297], 40.00th=[ 314], 50.00th=[ 326], 60.00th=[ 334], 00:19:28.433 | 70.00th=[ 363], 80.00th=[ 404], 90.00th=[ 441], 95.00th=[ 482], 00:19:28.433 | 99.00th=[ 586], 99.50th=[ 611], 99.90th=[ 652], 99.95th=[ 1221], 00:19:28.433 | 99.99th=[ 1221] 00:19:28.433 write: IOPS=2019, BW=8080KiB/s (8274kB/s)(8088KiB/1001msec); 0 zone resets 00:19:28.433 slat (usec): min=7, max=1061, avg=15.22, stdev=24.41 00:19:28.433 clat (usec): min=146, max=459, avg=205.03, stdev=32.30 00:19:28.433 lat (usec): min=155, max=1254, avg=220.25, stdev=40.91 00:19:28.433 clat percentiles (usec): 00:19:28.433 | 1.00th=[ 159], 5.00th=[ 169], 10.00th=[ 176], 20.00th=[ 186], 00:19:28.433 | 30.00th=[ 190], 40.00th=[ 196], 50.00th=[ 198], 60.00th=[ 204], 00:19:28.433 | 70.00th=[ 210], 80.00th=[ 219], 90.00th=[ 239], 95.00th=[ 262], 00:19:28.433 | 99.00th=[ 351], 99.50th=[ 392], 99.90th=[ 412], 99.95th=[ 441], 00:19:28.433 | 99.99th=[ 461] 00:19:28.433 bw ( KiB/s): min= 8192, max= 8192, per=30.47%, avg=8192.00, stdev= 0.00, samples=1 00:19:28.433 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:28.433 lat (usec) : 250=58.09%, 500=40.44%, 750=1.43% 00:19:28.433 lat (msec) : 2=0.03% 00:19:28.433 cpu : usr=4.00%, sys=6.40%, ctx=3560, majf=0, minf=1 00:19:28.433 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:28.433 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.433 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.433 issued rwts: total=1536,2022,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:28.434 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:28.434 job3: (groupid=0, jobs=1): err= 0: pid=3314262: Tue Nov 26 05:15:29 2024 00:19:28.434 read: IOPS=68, BW=274KiB/s (281kB/s)(276KiB/1006msec) 00:19:28.434 slat (nsec): min=5577, max=37562, avg=16864.01, stdev=8448.97 00:19:28.434 clat (usec): min=232, max=41987, avg=12455.81, stdev=18588.21 00:19:28.434 lat (usec): min=246, max=42003, avg=12472.67, stdev=18593.57 00:19:28.434 clat percentiles (usec): 00:19:28.434 | 1.00th=[ 233], 5.00th=[ 330], 10.00th=[ 334], 20.00th=[ 416], 00:19:28.434 | 30.00th=[ 474], 40.00th=[ 486], 50.00th=[ 510], 60.00th=[ 519], 00:19:28.434 | 70.00th=[13173], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:19:28.434 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:28.434 | 99.99th=[42206] 00:19:28.434 write: IOPS=508, BW=2036KiB/s (2085kB/s)(2048KiB/1006msec); 0 zone resets 00:19:28.434 slat (nsec): min=6794, max=39437, avg=11156.67, stdev=4814.10 00:19:28.434 clat (usec): min=159, max=1183, avg=269.70, stdev=81.47 00:19:28.434 lat (usec): min=168, max=1200, avg=280.86, stdev=82.63 00:19:28.434 clat percentiles (usec): 00:19:28.434 | 1.00th=[ 176], 5.00th=[ 190], 10.00th=[ 194], 20.00th=[ 206], 00:19:28.434 | 30.00th=[ 219], 40.00th=[ 233], 50.00th=[ 243], 60.00th=[ 260], 00:19:28.434 | 70.00th=[ 297], 80.00th=[ 359], 90.00th=[ 379], 95.00th=[ 388], 00:19:28.434 | 99.00th=[ 429], 99.50th=[ 449], 99.90th=[ 1188], 99.95th=[ 1188], 00:19:28.434 | 99.99th=[ 1188] 00:19:28.434 bw ( KiB/s): min= 4096, max= 4096, per=15.24%, avg=4096.00, stdev= 0.00, samples=1 00:19:28.434 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:28.434 lat (usec) : 250=47.85%, 500=45.27%, 750=3.10% 00:19:28.434 lat (msec) : 2=0.17%, 20=0.17%, 50=3.44% 00:19:28.434 cpu : usr=0.10%, sys=0.90%, ctx=582, majf=0, minf=1 00:19:28.434 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:28.434 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.434 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.434 issued rwts: total=69,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:28.434 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:28.434 00:19:28.434 Run status group 0 (all jobs): 00:19:28.434 READ: bw=20.1MiB/s (21.1MB/s), 274KiB/s-8184KiB/s (281kB/s-8380kB/s), io=20.3MiB (21.3MB), run=1001-1006msec 00:19:28.434 WRITE: bw=26.3MiB/s (27.5MB/s), 2036KiB/s-9790KiB/s (2085kB/s-10.0MB/s), io=26.4MiB (27.7MB), run=1001-1006msec 00:19:28.434 00:19:28.434 Disk stats (read/write): 00:19:28.434 nvme0n1: ios=1344/1536, merge=0/0, ticks=679/298, in_queue=977, util=85.57% 00:19:28.434 nvme0n2: ios=1772/2048, merge=0/0, ticks=1307/349, in_queue=1656, util=89.63% 00:19:28.434 nvme0n3: ios=1473/1536, merge=0/0, ticks=624/295, in_queue=919, util=93.63% 00:19:28.434 nvme0n4: ios=121/512, merge=0/0, ticks=949/129, in_queue=1078, util=94.42% 00:19:28.434 05:15:29 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:28.434 [global] 00:19:28.434 thread=1 00:19:28.434 invalidate=1 00:19:28.434 rw=randwrite 00:19:28.434 time_based=1 00:19:28.434 runtime=1 00:19:28.434 ioengine=libaio 00:19:28.434 direct=1 00:19:28.434 bs=4096 00:19:28.434 iodepth=1 00:19:28.434 norandommap=0 00:19:28.434 numjobs=1 00:19:28.434 00:19:28.434 verify_dump=1 00:19:28.434 verify_backlog=512 00:19:28.434 verify_state_save=0 00:19:28.434 do_verify=1 00:19:28.434 verify=crc32c-intel 00:19:28.434 [job0] 00:19:28.434 filename=/dev/nvme0n1 00:19:28.434 [job1] 00:19:28.434 filename=/dev/nvme0n2 00:19:28.434 [job2] 00:19:28.434 filename=/dev/nvme0n3 00:19:28.434 [job3] 00:19:28.434 filename=/dev/nvme0n4 00:19:28.434 Could not set queue depth (nvme0n1) 00:19:28.434 Could not set queue depth (nvme0n2) 00:19:28.434 Could not set queue depth (nvme0n3) 00:19:28.434 Could not set queue depth (nvme0n4) 00:19:28.434 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:28.434 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:28.434 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:28.434 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:28.434 fio-3.35 00:19:28.434 Starting 4 threads 00:19:29.810 00:19:29.810 job0: (groupid=0, jobs=1): err= 0: pid=3314553: Tue Nov 26 05:15:31 2024 00:19:29.810 read: IOPS=31, BW=128KiB/s (131kB/s)(128KiB/1002msec) 00:19:29.810 slat (nsec): min=6391, max=33599, avg=16075.38, stdev=8359.32 00:19:29.810 clat (usec): min=224, max=42011, avg=28081.42, stdev=19162.61 00:19:29.810 lat (usec): min=233, max=42042, avg=28097.50, stdev=19165.83 00:19:29.810 clat percentiles (usec): 00:19:29.810 | 1.00th=[ 225], 5.00th=[ 253], 10.00th=[ 314], 20.00th=[ 371], 00:19:29.810 | 30.00th=[ 519], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:29.810 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:19:29.810 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:29.810 | 99.99th=[42206] 00:19:29.810 write: IOPS=510, BW=2044KiB/s (2093kB/s)(2048KiB/1002msec); 0 zone resets 00:19:29.810 slat (nsec): min=6023, max=27607, avg=7620.50, stdev=2799.10 00:19:29.810 clat (usec): min=139, max=3477, avg=190.14, stdev=147.96 00:19:29.810 lat (usec): min=146, max=3484, avg=197.76, stdev=147.99 00:19:29.810 clat percentiles (usec): 00:19:29.810 | 1.00th=[ 145], 5.00th=[ 151], 10.00th=[ 157], 20.00th=[ 161], 00:19:29.810 | 30.00th=[ 167], 40.00th=[ 172], 50.00th=[ 182], 60.00th=[ 192], 00:19:29.810 | 70.00th=[ 198], 80.00th=[ 202], 90.00th=[ 212], 95.00th=[ 225], 00:19:29.810 | 99.00th=[ 262], 99.50th=[ 383], 99.90th=[ 3490], 99.95th=[ 3490], 00:19:29.810 | 99.99th=[ 3490] 00:19:29.810 bw ( KiB/s): min= 4096, max= 4096, per=23.11%, avg=4096.00, stdev= 0.00, samples=1 00:19:29.810 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:29.810 lat (usec) : 250=93.01%, 500=2.57%, 750=0.18% 00:19:29.810 lat (msec) : 4=0.18%, 50=4.04% 00:19:29.810 cpu : usr=0.20%, sys=0.40%, ctx=544, majf=0, minf=2 00:19:29.810 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:29.810 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:29.810 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:29.810 issued rwts: total=32,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:29.810 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:29.810 job1: (groupid=0, jobs=1): err= 0: pid=3314567: Tue Nov 26 05:15:31 2024 00:19:29.810 read: IOPS=280, BW=1123KiB/s (1150kB/s)(1124KiB/1001msec) 00:19:29.810 slat (nsec): min=5031, max=73076, avg=15087.58, stdev=7673.76 00:19:29.810 clat (usec): min=222, max=41986, avg=3065.72, stdev=10287.35 00:19:29.810 lat (usec): min=233, max=42000, avg=3080.81, stdev=10288.66 00:19:29.810 clat percentiles (usec): 00:19:29.810 | 1.00th=[ 231], 5.00th=[ 235], 10.00th=[ 243], 20.00th=[ 249], 00:19:29.810 | 30.00th=[ 265], 40.00th=[ 281], 50.00th=[ 285], 60.00th=[ 293], 00:19:29.810 | 70.00th=[ 306], 80.00th=[ 343], 90.00th=[ 510], 95.00th=[41157], 00:19:29.810 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:29.810 | 99.99th=[42206] 00:19:29.810 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:19:29.810 slat (nsec): min=6099, max=39586, avg=10183.52, stdev=4699.50 00:19:29.810 clat (usec): min=133, max=461, avg=240.81, stdev=73.61 00:19:29.810 lat (usec): min=140, max=470, avg=251.00, stdev=74.35 00:19:29.810 clat percentiles (usec): 00:19:29.810 | 1.00th=[ 143], 5.00th=[ 153], 10.00th=[ 163], 20.00th=[ 172], 00:19:29.810 | 30.00th=[ 186], 40.00th=[ 198], 50.00th=[ 229], 60.00th=[ 253], 00:19:29.810 | 70.00th=[ 269], 80.00th=[ 306], 90.00th=[ 375], 95.00th=[ 379], 00:19:29.810 | 99.00th=[ 404], 99.50th=[ 429], 99.90th=[ 461], 99.95th=[ 461], 00:19:29.810 | 99.99th=[ 461] 00:19:29.810 bw ( KiB/s): min= 4096, max= 4096, per=23.11%, avg=4096.00, stdev= 0.00, samples=1 00:19:29.810 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:29.810 lat (usec) : 250=45.27%, 500=50.95%, 750=1.39% 00:19:29.810 lat (msec) : 50=2.40% 00:19:29.811 cpu : usr=0.60%, sys=0.80%, ctx=796, majf=0, minf=1 00:19:29.811 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:29.811 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:29.811 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:29.811 issued rwts: total=281,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:29.811 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:29.811 job2: (groupid=0, jobs=1): err= 0: pid=3314603: Tue Nov 26 05:15:31 2024 00:19:29.811 read: IOPS=995, BW=3981KiB/s (4076kB/s)(4140KiB/1040msec) 00:19:29.811 slat (nsec): min=4543, max=52775, avg=11771.29, stdev=4901.11 00:19:29.811 clat (usec): min=214, max=41021, avg=690.65, stdev=3765.24 00:19:29.811 lat (usec): min=228, max=41040, avg=702.43, stdev=3766.58 00:19:29.811 clat percentiles (usec): 00:19:29.811 | 1.00th=[ 223], 5.00th=[ 231], 10.00th=[ 241], 20.00th=[ 269], 00:19:29.811 | 30.00th=[ 289], 40.00th=[ 310], 50.00th=[ 343], 60.00th=[ 375], 00:19:29.811 | 70.00th=[ 379], 80.00th=[ 388], 90.00th=[ 441], 95.00th=[ 474], 00:19:29.811 | 99.00th=[ 562], 99.50th=[40633], 99.90th=[41157], 99.95th=[41157], 00:19:29.811 | 99.99th=[41157] 00:19:29.811 write: IOPS=1476, BW=5908KiB/s (6049kB/s)(6144KiB/1040msec); 0 zone resets 00:19:29.811 slat (nsec): min=6112, max=52384, avg=9211.71, stdev=4721.45 00:19:29.811 clat (usec): min=139, max=651, avg=187.58, stdev=27.98 00:19:29.811 lat (usec): min=146, max=669, avg=196.79, stdev=28.40 00:19:29.811 clat percentiles (usec): 00:19:29.811 | 1.00th=[ 145], 5.00th=[ 155], 10.00th=[ 161], 20.00th=[ 165], 00:19:29.811 | 30.00th=[ 172], 40.00th=[ 178], 50.00th=[ 188], 60.00th=[ 196], 00:19:29.811 | 70.00th=[ 198], 80.00th=[ 204], 90.00th=[ 215], 95.00th=[ 229], 00:19:29.811 | 99.00th=[ 251], 99.50th=[ 260], 99.90th=[ 586], 99.95th=[ 652], 00:19:29.811 | 99.99th=[ 652] 00:19:29.811 bw ( KiB/s): min= 4096, max= 8192, per=34.67%, avg=6144.00, stdev=2896.31, samples=2 00:19:29.811 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:19:29.811 lat (usec) : 250=65.23%, 500=33.61%, 750=0.82% 00:19:29.811 lat (msec) : 50=0.35% 00:19:29.811 cpu : usr=1.54%, sys=2.31%, ctx=2572, majf=0, minf=1 00:19:29.811 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:29.811 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:29.811 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:29.811 issued rwts: total=1035,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:29.811 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:29.811 job3: (groupid=0, jobs=1): err= 0: pid=3314613: Tue Nov 26 05:15:31 2024 00:19:29.811 read: IOPS=1574, BW=6298KiB/s (6449kB/s)(6304KiB/1001msec) 00:19:29.811 slat (nsec): min=5736, max=54126, avg=11245.92, stdev=5986.42 00:19:29.811 clat (usec): min=211, max=533, avg=300.69, stdev=29.25 00:19:29.811 lat (usec): min=217, max=568, avg=311.94, stdev=31.70 00:19:29.811 clat percentiles (usec): 00:19:29.811 | 1.00th=[ 223], 5.00th=[ 241], 10.00th=[ 262], 20.00th=[ 285], 00:19:29.811 | 30.00th=[ 293], 40.00th=[ 302], 50.00th=[ 306], 60.00th=[ 310], 00:19:29.811 | 70.00th=[ 314], 80.00th=[ 318], 90.00th=[ 326], 95.00th=[ 338], 00:19:29.811 | 99.00th=[ 371], 99.50th=[ 400], 99.90th=[ 515], 99.95th=[ 537], 00:19:29.811 | 99.99th=[ 537] 00:19:29.811 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:29.811 slat (nsec): min=6011, max=71034, avg=13310.22, stdev=8139.88 00:19:29.811 clat (usec): min=150, max=473, avg=227.14, stdev=59.63 00:19:29.811 lat (usec): min=162, max=505, avg=240.45, stdev=61.90 00:19:29.811 clat percentiles (usec): 00:19:29.811 | 1.00th=[ 159], 5.00th=[ 165], 10.00th=[ 172], 20.00th=[ 184], 00:19:29.811 | 30.00th=[ 192], 40.00th=[ 198], 50.00th=[ 204], 60.00th=[ 217], 00:19:29.811 | 70.00th=[ 241], 80.00th=[ 273], 90.00th=[ 322], 95.00th=[ 355], 00:19:29.811 | 99.00th=[ 416], 99.50th=[ 433], 99.90th=[ 461], 99.95th=[ 465], 00:19:29.811 | 99.99th=[ 474] 00:19:29.811 bw ( KiB/s): min= 8192, max= 8192, per=46.22%, avg=8192.00, stdev= 0.00, samples=1 00:19:29.811 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:29.811 lat (usec) : 250=44.78%, 500=55.16%, 750=0.06% 00:19:29.811 cpu : usr=2.20%, sys=6.90%, ctx=3625, majf=0, minf=1 00:19:29.811 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:29.811 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:29.811 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:29.811 issued rwts: total=1576,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:29.811 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:29.811 00:19:29.811 Run status group 0 (all jobs): 00:19:29.811 READ: bw=11.0MiB/s (11.5MB/s), 128KiB/s-6298KiB/s (131kB/s-6449kB/s), io=11.4MiB (12.0MB), run=1001-1040msec 00:19:29.811 WRITE: bw=17.3MiB/s (18.1MB/s), 2044KiB/s-8184KiB/s (2093kB/s-8380kB/s), io=18.0MiB (18.9MB), run=1001-1040msec 00:19:29.811 00:19:29.811 Disk stats (read/write): 00:19:29.811 nvme0n1: ios=69/512, merge=0/0, ticks=772/94, in_queue=866, util=86.77% 00:19:29.811 nvme0n2: ios=67/512, merge=0/0, ticks=1468/117, in_queue=1585, util=89.13% 00:19:29.811 nvme0n3: ios=1081/1536, merge=0/0, ticks=1309/268, in_queue=1577, util=93.62% 00:19:29.811 nvme0n4: ios=1500/1536, merge=0/0, ticks=695/346, in_queue=1041, util=95.57% 00:19:29.811 05:15:31 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:29.811 [global] 00:19:29.811 thread=1 00:19:29.811 invalidate=1 00:19:29.811 rw=write 00:19:29.811 time_based=1 00:19:29.811 runtime=1 00:19:29.811 ioengine=libaio 00:19:29.811 direct=1 00:19:29.811 bs=4096 00:19:29.811 iodepth=128 00:19:29.811 norandommap=0 00:19:29.811 numjobs=1 00:19:29.811 00:19:29.811 verify_dump=1 00:19:29.811 verify_backlog=512 00:19:29.811 verify_state_save=0 00:19:29.811 do_verify=1 00:19:29.811 verify=crc32c-intel 00:19:29.811 [job0] 00:19:29.811 filename=/dev/nvme0n1 00:19:29.811 [job1] 00:19:29.811 filename=/dev/nvme0n2 00:19:29.811 [job2] 00:19:29.811 filename=/dev/nvme0n3 00:19:29.811 [job3] 00:19:29.811 filename=/dev/nvme0n4 00:19:29.811 Could not set queue depth (nvme0n1) 00:19:29.811 Could not set queue depth (nvme0n2) 00:19:29.811 Could not set queue depth (nvme0n3) 00:19:29.811 Could not set queue depth (nvme0n4) 00:19:30.069 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:30.069 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:30.069 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:30.069 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:30.069 fio-3.35 00:19:30.069 Starting 4 threads 00:19:31.447 00:19:31.447 job0: (groupid=0, jobs=1): err= 0: pid=3314847: Tue Nov 26 05:15:32 2024 00:19:31.447 read: IOPS=2547, BW=9.95MiB/s (10.4MB/s)(10.0MiB/1005msec) 00:19:31.447 slat (usec): min=3, max=23500, avg=187.15, stdev=974.13 00:19:31.447 clat (usec): min=12146, max=66503, avg=23225.62, stdev=8692.43 00:19:31.447 lat (usec): min=13183, max=66519, avg=23412.77, stdev=8747.03 00:19:31.447 clat percentiles (usec): 00:19:31.447 | 1.00th=[13435], 5.00th=[15008], 10.00th=[16450], 20.00th=[16712], 00:19:31.447 | 30.00th=[16909], 40.00th=[17433], 50.00th=[21365], 60.00th=[25297], 00:19:31.447 | 70.00th=[26084], 80.00th=[26870], 90.00th=[29230], 95.00th=[42730], 00:19:31.447 | 99.00th=[54789], 99.50th=[60031], 99.90th=[60031], 99.95th=[63177], 00:19:31.447 | 99.99th=[66323] 00:19:31.447 write: IOPS=2859, BW=11.2MiB/s (11.7MB/s)(11.2MiB/1005msec); 0 zone resets 00:19:31.447 slat (usec): min=3, max=15530, avg=171.58, stdev=983.23 00:19:31.447 clat (usec): min=4021, max=54096, avg=23622.39, stdev=10118.64 00:19:31.447 lat (usec): min=4298, max=54164, avg=23793.97, stdev=10154.39 00:19:31.447 clat percentiles (usec): 00:19:31.447 | 1.00th=[ 8717], 5.00th=[12256], 10.00th=[12649], 20.00th=[16188], 00:19:31.447 | 30.00th=[16450], 40.00th=[19530], 50.00th=[21103], 60.00th=[25297], 00:19:31.447 | 70.00th=[26608], 80.00th=[30016], 90.00th=[37487], 95.00th=[44827], 00:19:31.447 | 99.00th=[53740], 99.50th=[54264], 99.90th=[54264], 99.95th=[54264], 00:19:31.447 | 99.99th=[54264] 00:19:31.447 bw ( KiB/s): min= 9688, max=12288, per=17.65%, avg=10988.00, stdev=1838.48, samples=2 00:19:31.447 iops : min= 2422, max= 3072, avg=2747.00, stdev=459.62, samples=2 00:19:31.447 lat (msec) : 10=1.18%, 20=46.32%, 50=49.48%, 100=3.02% 00:19:31.447 cpu : usr=3.49%, sys=5.18%, ctx=313, majf=0, minf=1 00:19:31.447 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:31.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:31.447 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:31.447 issued rwts: total=2560,2874,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:31.447 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:31.447 job1: (groupid=0, jobs=1): err= 0: pid=3314848: Tue Nov 26 05:15:32 2024 00:19:31.447 read: IOPS=3739, BW=14.6MiB/s (15.3MB/s)(14.7MiB/1003msec) 00:19:31.447 slat (usec): min=2, max=47075, avg=151.39, stdev=1187.04 00:19:31.447 clat (usec): min=2636, max=75777, avg=17443.71, stdev=12509.57 00:19:31.447 lat (usec): min=2649, max=75785, avg=17595.10, stdev=12607.48 00:19:31.447 clat percentiles (usec): 00:19:31.447 | 1.00th=[ 3490], 5.00th=[ 8586], 10.00th=[ 9634], 20.00th=[ 9765], 00:19:31.447 | 30.00th=[ 9896], 40.00th=[10028], 50.00th=[10290], 60.00th=[13435], 00:19:31.447 | 70.00th=[19268], 80.00th=[25297], 90.00th=[35390], 95.00th=[41681], 00:19:31.447 | 99.00th=[62653], 99.50th=[76022], 99.90th=[76022], 99.95th=[76022], 00:19:31.447 | 99.99th=[76022] 00:19:31.447 write: IOPS=4083, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1003msec); 0 zone resets 00:19:31.447 slat (usec): min=3, max=16189, avg=95.44, stdev=626.71 00:19:31.447 clat (usec): min=3994, max=87049, avg=14854.12, stdev=12668.15 00:19:31.447 lat (usec): min=3999, max=87056, avg=14949.56, stdev=12700.79 00:19:31.447 clat percentiles (usec): 00:19:31.447 | 1.00th=[ 6128], 5.00th=[ 7177], 10.00th=[ 9110], 20.00th=[10028], 00:19:31.447 | 30.00th=[10159], 40.00th=[10421], 50.00th=[10683], 60.00th=[11207], 00:19:31.447 | 70.00th=[13960], 80.00th=[15401], 90.00th=[18744], 95.00th=[41681], 00:19:31.447 | 99.00th=[81265], 99.50th=[86508], 99.90th=[87557], 99.95th=[87557], 00:19:31.447 | 99.99th=[87557] 00:19:31.447 bw ( KiB/s): min=11784, max=20984, per=26.31%, avg=16384.00, stdev=6505.38, samples=2 00:19:31.447 iops : min= 2946, max= 5246, avg=4096.00, stdev=1626.35, samples=2 00:19:31.447 lat (msec) : 4=0.76%, 10=28.52%, 20=53.00%, 50=14.48%, 100=3.24% 00:19:31.447 cpu : usr=5.49%, sys=7.58%, ctx=319, majf=0, minf=1 00:19:31.447 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:31.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:31.447 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:31.447 issued rwts: total=3751,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:31.447 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:31.447 job2: (groupid=0, jobs=1): err= 0: pid=3314849: Tue Nov 26 05:15:32 2024 00:19:31.447 read: IOPS=4517, BW=17.6MiB/s (18.5MB/s)(17.8MiB/1006msec) 00:19:31.447 slat (usec): min=2, max=10539, avg=97.63, stdev=610.68 00:19:31.447 clat (usec): min=2249, max=44564, avg=12856.07, stdev=4359.00 00:19:31.447 lat (usec): min=2254, max=44568, avg=12953.70, stdev=4404.12 00:19:31.447 clat percentiles (usec): 00:19:31.447 | 1.00th=[ 7177], 5.00th=[ 8848], 10.00th=[10290], 20.00th=[10814], 00:19:31.447 | 30.00th=[11338], 40.00th=[11600], 50.00th=[11863], 60.00th=[12125], 00:19:31.447 | 70.00th=[12387], 80.00th=[13304], 90.00th=[16057], 95.00th=[21365], 00:19:31.447 | 99.00th=[32375], 99.50th=[36963], 99.90th=[44303], 99.95th=[44303], 00:19:31.447 | 99.99th=[44827] 00:19:31.447 write: IOPS=4580, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1006msec); 0 zone resets 00:19:31.447 slat (usec): min=3, max=14357, avg=107.33, stdev=626.34 00:19:31.447 clat (usec): min=1678, max=44511, avg=15005.57, stdev=5926.48 00:19:31.447 lat (usec): min=1691, max=44516, avg=15112.90, stdev=5957.23 00:19:31.447 clat percentiles (usec): 00:19:31.447 | 1.00th=[ 4621], 5.00th=[ 7767], 10.00th=[ 9110], 20.00th=[ 9896], 00:19:31.447 | 30.00th=[12125], 40.00th=[12518], 50.00th=[12911], 60.00th=[13435], 00:19:31.447 | 70.00th=[17433], 80.00th=[21627], 90.00th=[22676], 95.00th=[25822], 00:19:31.447 | 99.00th=[32637], 99.50th=[32900], 99.90th=[33817], 99.95th=[33817], 00:19:31.447 | 99.99th=[44303] 00:19:31.447 bw ( KiB/s): min=16384, max=20480, per=29.60%, avg=18432.00, stdev=2896.31, samples=2 00:19:31.447 iops : min= 4096, max= 5120, avg=4608.00, stdev=724.08, samples=2 00:19:31.447 lat (msec) : 2=0.07%, 4=0.39%, 10=13.08%, 20=71.19%, 50=15.27% 00:19:31.447 cpu : usr=5.67%, sys=6.17%, ctx=413, majf=0, minf=1 00:19:31.447 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:31.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:31.447 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:31.447 issued rwts: total=4545,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:31.447 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:31.447 job3: (groupid=0, jobs=1): err= 0: pid=3314850: Tue Nov 26 05:15:32 2024 00:19:31.447 read: IOPS=3566, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1005msec) 00:19:31.447 slat (usec): min=2, max=10689, avg=123.16, stdev=679.63 00:19:31.447 clat (usec): min=3144, max=28261, avg=16338.66, stdev=4089.77 00:19:31.447 lat (usec): min=3162, max=28277, avg=16461.82, stdev=4147.20 00:19:31.447 clat percentiles (usec): 00:19:31.447 | 1.00th=[ 5342], 5.00th=[ 9896], 10.00th=[10683], 20.00th=[12518], 00:19:31.447 | 30.00th=[13829], 40.00th=[15401], 50.00th=[16909], 60.00th=[18482], 00:19:31.447 | 70.00th=[19268], 80.00th=[19792], 90.00th=[21365], 95.00th=[22152], 00:19:31.447 | 99.00th=[23987], 99.50th=[25560], 99.90th=[26608], 99.95th=[27132], 00:19:31.447 | 99.99th=[28181] 00:19:31.447 write: IOPS=4062, BW=15.9MiB/s (16.6MB/s)(15.9MiB/1005msec); 0 zone resets 00:19:31.447 slat (usec): min=3, max=8939, avg=127.66, stdev=632.47 00:19:31.447 clat (usec): min=1036, max=32892, avg=16732.07, stdev=6123.50 00:19:31.447 lat (usec): min=3955, max=32909, avg=16859.73, stdev=6174.87 00:19:31.447 clat percentiles (usec): 00:19:31.447 | 1.00th=[ 7046], 5.00th=[10028], 10.00th=[10159], 20.00th=[10945], 00:19:31.447 | 30.00th=[11994], 40.00th=[13304], 50.00th=[15008], 60.00th=[18744], 00:19:31.447 | 70.00th=[19530], 80.00th=[20317], 90.00th=[25822], 95.00th=[29492], 00:19:31.448 | 99.00th=[32637], 99.50th=[32900], 99.90th=[32900], 99.95th=[32900], 00:19:31.448 | 99.99th=[32900] 00:19:31.448 bw ( KiB/s): min=13384, max=18256, per=25.41%, avg=15820.00, stdev=3445.02, samples=2 00:19:31.448 iops : min= 3346, max= 4564, avg=3955.00, stdev=861.26, samples=2 00:19:31.448 lat (msec) : 2=0.01%, 4=0.09%, 10=5.40%, 20=73.37%, 50=21.13% 00:19:31.448 cpu : usr=4.88%, sys=5.58%, ctx=429, majf=0, minf=1 00:19:31.448 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:31.448 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:31.448 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:31.448 issued rwts: total=3584,4083,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:31.448 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:31.448 00:19:31.448 Run status group 0 (all jobs): 00:19:31.448 READ: bw=56.1MiB/s (58.8MB/s), 9.95MiB/s-17.6MiB/s (10.4MB/s-18.5MB/s), io=56.4MiB (59.1MB), run=1003-1006msec 00:19:31.448 WRITE: bw=60.8MiB/s (63.8MB/s), 11.2MiB/s-17.9MiB/s (11.7MB/s-18.8MB/s), io=61.2MiB (64.1MB), run=1003-1006msec 00:19:31.448 00:19:31.448 Disk stats (read/write): 00:19:31.448 nvme0n1: ios=2183/2560, merge=0/0, ticks=15858/18121, in_queue=33979, util=95.89% 00:19:31.448 nvme0n2: ios=2881/3072, merge=0/0, ticks=19964/15598, in_queue=35562, util=85.79% 00:19:31.448 nvme0n3: ios=3584/3901, merge=0/0, ticks=35942/46965, in_queue=82907, util=88.22% 00:19:31.448 nvme0n4: ios=3072/3583, merge=0/0, ticks=23588/25248, in_queue=48836, util=89.61% 00:19:31.448 05:15:32 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:31.448 [global] 00:19:31.448 thread=1 00:19:31.448 invalidate=1 00:19:31.448 rw=randwrite 00:19:31.448 time_based=1 00:19:31.448 runtime=1 00:19:31.448 ioengine=libaio 00:19:31.448 direct=1 00:19:31.448 bs=4096 00:19:31.448 iodepth=128 00:19:31.448 norandommap=0 00:19:31.448 numjobs=1 00:19:31.448 00:19:31.448 verify_dump=1 00:19:31.448 verify_backlog=512 00:19:31.448 verify_state_save=0 00:19:31.448 do_verify=1 00:19:31.448 verify=crc32c-intel 00:19:31.448 [job0] 00:19:31.448 filename=/dev/nvme0n1 00:19:31.448 [job1] 00:19:31.448 filename=/dev/nvme0n2 00:19:31.448 [job2] 00:19:31.448 filename=/dev/nvme0n3 00:19:31.448 [job3] 00:19:31.448 filename=/dev/nvme0n4 00:19:31.448 Could not set queue depth (nvme0n1) 00:19:31.448 Could not set queue depth (nvme0n2) 00:19:31.448 Could not set queue depth (nvme0n3) 00:19:31.448 Could not set queue depth (nvme0n4) 00:19:31.448 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:31.448 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:31.448 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:31.448 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:31.448 fio-3.35 00:19:31.448 Starting 4 threads 00:19:32.826 00:19:32.826 job0: (groupid=0, jobs=1): err= 0: pid=3315080: Tue Nov 26 05:15:34 2024 00:19:32.826 read: IOPS=6053, BW=23.6MiB/s (24.8MB/s)(23.7MiB/1001msec) 00:19:32.826 slat (usec): min=3, max=3077, avg=76.20, stdev=339.26 00:19:32.826 clat (usec): min=704, max=13847, avg=10337.10, stdev=1253.57 00:19:32.826 lat (usec): min=1180, max=13852, avg=10413.30, stdev=1224.26 00:19:32.826 clat percentiles (usec): 00:19:32.826 | 1.00th=[ 6456], 5.00th=[ 8586], 10.00th=[ 8979], 20.00th=[ 9372], 00:19:32.826 | 30.00th=[ 9896], 40.00th=[10159], 50.00th=[10421], 60.00th=[10683], 00:19:32.826 | 70.00th=[10945], 80.00th=[11207], 90.00th=[11731], 95.00th=[12256], 00:19:32.826 | 99.00th=[13173], 99.50th=[13435], 99.90th=[13829], 99.95th=[13829], 00:19:32.826 | 99.99th=[13829] 00:19:32.826 write: IOPS=6137, BW=24.0MiB/s (25.1MB/s)(24.0MiB/1001msec); 0 zone resets 00:19:32.826 slat (usec): min=4, max=3294, avg=77.35, stdev=363.02 00:19:32.826 clat (usec): min=6405, max=14167, avg=10435.80, stdev=1281.72 00:19:32.826 lat (usec): min=6418, max=14176, avg=10513.15, stdev=1261.90 00:19:32.826 clat percentiles (usec): 00:19:32.826 | 1.00th=[ 7504], 5.00th=[ 8586], 10.00th=[ 8848], 20.00th=[ 9110], 00:19:32.826 | 30.00th=[ 9503], 40.00th=[10290], 50.00th=[10683], 60.00th=[10945], 00:19:32.826 | 70.00th=[11076], 80.00th=[11469], 90.00th=[12125], 95.00th=[12518], 00:19:32.826 | 99.00th=[13698], 99.50th=[13960], 99.90th=[14091], 99.95th=[14091], 00:19:32.826 | 99.99th=[14222] 00:19:32.826 bw ( KiB/s): min=24576, max=24576, per=36.63%, avg=24576.00, stdev= 0.00, samples=1 00:19:32.826 iops : min= 6144, max= 6144, avg=6144.00, stdev= 0.00, samples=1 00:19:32.826 lat (usec) : 750=0.01% 00:19:32.826 lat (msec) : 2=0.09%, 4=0.22%, 10=34.83%, 20=64.85% 00:19:32.827 cpu : usr=8.60%, sys=10.60%, ctx=635, majf=0, minf=1 00:19:32.827 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:32.827 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:32.827 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:32.827 issued rwts: total=6060,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:32.827 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:32.827 job1: (groupid=0, jobs=1): err= 0: pid=3315083: Tue Nov 26 05:15:34 2024 00:19:32.827 read: IOPS=2552, BW=9.97MiB/s (10.5MB/s)(10.0MiB/1003msec) 00:19:32.827 slat (usec): min=3, max=8403, avg=207.19, stdev=867.61 00:19:32.827 clat (usec): min=9455, max=44350, avg=26324.93, stdev=6780.30 00:19:32.827 lat (usec): min=9695, max=44354, avg=26532.12, stdev=6778.60 00:19:32.827 clat percentiles (usec): 00:19:32.827 | 1.00th=[11994], 5.00th=[16909], 10.00th=[18744], 20.00th=[21365], 00:19:32.827 | 30.00th=[21627], 40.00th=[23200], 50.00th=[24773], 60.00th=[26608], 00:19:32.827 | 70.00th=[31065], 80.00th=[33162], 90.00th=[35390], 95.00th=[38011], 00:19:32.827 | 99.00th=[42730], 99.50th=[42730], 99.90th=[44303], 99.95th=[44303], 00:19:32.827 | 99.99th=[44303] 00:19:32.827 write: IOPS=2887, BW=11.3MiB/s (11.8MB/s)(11.3MiB/1003msec); 0 zone resets 00:19:32.827 slat (usec): min=4, max=8214, avg=152.80, stdev=810.58 00:19:32.827 clat (usec): min=1478, max=35875, avg=20245.67, stdev=6040.18 00:19:32.827 lat (usec): min=6406, max=35884, avg=20398.47, stdev=6022.21 00:19:32.827 clat percentiles (usec): 00:19:32.827 | 1.00th=[ 7177], 5.00th=[14746], 10.00th=[15795], 20.00th=[16057], 00:19:32.827 | 30.00th=[16319], 40.00th=[16581], 50.00th=[16909], 60.00th=[18744], 00:19:32.827 | 70.00th=[21890], 80.00th=[26870], 90.00th=[30016], 95.00th=[32637], 00:19:32.827 | 99.00th=[34341], 99.50th=[34341], 99.90th=[35914], 99.95th=[35914], 00:19:32.827 | 99.99th=[35914] 00:19:32.827 bw ( KiB/s): min=10000, max=12168, per=16.52%, avg=11084.00, stdev=1533.01, samples=2 00:19:32.827 iops : min= 2500, max= 3042, avg=2771.00, stdev=383.25, samples=2 00:19:32.827 lat (msec) : 2=0.02%, 10=0.64%, 20=41.02%, 50=58.32% 00:19:32.827 cpu : usr=3.39%, sys=5.58%, ctx=257, majf=0, minf=1 00:19:32.827 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:32.827 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:32.827 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:32.827 issued rwts: total=2560,2896,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:32.827 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:32.827 job2: (groupid=0, jobs=1): err= 0: pid=3315084: Tue Nov 26 05:15:34 2024 00:19:32.827 read: IOPS=4305, BW=16.8MiB/s (17.6MB/s)(17.0MiB/1010msec) 00:19:32.827 slat (usec): min=3, max=7114, avg=110.57, stdev=578.31 00:19:32.827 clat (usec): min=8607, max=44149, avg=13880.10, stdev=6596.26 00:19:32.827 lat (usec): min=8766, max=44154, avg=13990.67, stdev=6650.25 00:19:32.827 clat percentiles (usec): 00:19:32.827 | 1.00th=[ 9241], 5.00th=[ 9896], 10.00th=[10683], 20.00th=[11600], 00:19:32.827 | 30.00th=[11731], 40.00th=[11994], 50.00th=[12125], 60.00th=[12387], 00:19:32.827 | 70.00th=[12649], 80.00th=[13042], 90.00th=[15008], 95.00th=[35914], 00:19:32.827 | 99.00th=[42730], 99.50th=[43779], 99.90th=[43779], 99.95th=[44303], 00:19:32.827 | 99.99th=[44303] 00:19:32.827 write: IOPS=4562, BW=17.8MiB/s (18.7MB/s)(18.0MiB/1010msec); 0 zone resets 00:19:32.827 slat (usec): min=4, max=10440, avg=102.96, stdev=526.33 00:19:32.827 clat (usec): min=7383, max=41809, avg=14635.56, stdev=6593.82 00:19:32.827 lat (usec): min=7399, max=41817, avg=14738.52, stdev=6629.19 00:19:32.827 clat percentiles (usec): 00:19:32.827 | 1.00th=[ 9110], 5.00th=[ 9765], 10.00th=[11338], 20.00th=[11863], 00:19:32.827 | 30.00th=[11994], 40.00th=[12125], 50.00th=[12256], 60.00th=[12387], 00:19:32.827 | 70.00th=[12518], 80.00th=[13960], 90.00th=[26346], 95.00th=[33162], 00:19:32.827 | 99.00th=[36439], 99.50th=[39060], 99.90th=[39060], 99.95th=[41681], 00:19:32.827 | 99.99th=[41681] 00:19:32.827 bw ( KiB/s): min=16032, max=20832, per=27.47%, avg=18432.00, stdev=3394.11, samples=2 00:19:32.827 iops : min= 4008, max= 5208, avg=4608.00, stdev=848.53, samples=2 00:19:32.827 lat (msec) : 10=6.05%, 20=83.78%, 50=10.17% 00:19:32.827 cpu : usr=5.65%, sys=8.72%, ctx=533, majf=0, minf=1 00:19:32.827 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:32.827 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:32.827 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:32.827 issued rwts: total=4349,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:32.827 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:32.827 job3: (groupid=0, jobs=1): err= 0: pid=3315085: Tue Nov 26 05:15:34 2024 00:19:32.827 read: IOPS=3059, BW=12.0MiB/s (12.5MB/s)(12.0MiB/1004msec) 00:19:32.827 slat (usec): min=2, max=8151, avg=158.27, stdev=761.58 00:19:32.827 clat (usec): min=7367, max=38033, avg=20876.68, stdev=6131.34 00:19:32.827 lat (usec): min=7377, max=38053, avg=21034.96, stdev=6171.28 00:19:32.827 clat percentiles (usec): 00:19:32.827 | 1.00th=[ 9634], 5.00th=[11600], 10.00th=[12256], 20.00th=[14877], 00:19:32.827 | 30.00th=[17957], 40.00th=[19792], 50.00th=[21103], 60.00th=[21627], 00:19:32.827 | 70.00th=[23462], 80.00th=[26870], 90.00th=[30016], 95.00th=[32113], 00:19:32.827 | 99.00th=[32900], 99.50th=[32900], 99.90th=[32900], 99.95th=[35914], 00:19:32.827 | 99.99th=[38011] 00:19:32.827 write: IOPS=3279, BW=12.8MiB/s (13.4MB/s)(12.9MiB/1004msec); 0 zone resets 00:19:32.827 slat (usec): min=4, max=8250, avg=148.46, stdev=747.72 00:19:32.827 clat (usec): min=3109, max=35737, avg=18963.92, stdev=5271.58 00:19:32.827 lat (usec): min=3120, max=35763, avg=19112.38, stdev=5295.98 00:19:32.827 clat percentiles (usec): 00:19:32.827 | 1.00th=[ 7177], 5.00th=[11600], 10.00th=[12518], 20.00th=[15795], 00:19:32.827 | 30.00th=[16581], 40.00th=[17171], 50.00th=[17695], 60.00th=[18744], 00:19:32.827 | 70.00th=[21103], 80.00th=[23987], 90.00th=[25822], 95.00th=[28705], 00:19:32.827 | 99.00th=[33817], 99.50th=[33817], 99.90th=[33817], 99.95th=[34341], 00:19:32.827 | 99.99th=[35914] 00:19:32.827 bw ( KiB/s): min=12208, max=13120, per=18.88%, avg=12664.00, stdev=644.88, samples=2 00:19:32.827 iops : min= 3052, max= 3280, avg=3166.00, stdev=161.22, samples=2 00:19:32.827 lat (msec) : 4=0.31%, 10=1.87%, 20=53.50%, 50=44.32% 00:19:32.827 cpu : usr=3.09%, sys=4.59%, ctx=335, majf=0, minf=1 00:19:32.827 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:32.827 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:32.827 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:32.827 issued rwts: total=3072,3293,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:32.827 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:32.827 00:19:32.827 Run status group 0 (all jobs): 00:19:32.827 READ: bw=62.0MiB/s (65.1MB/s), 9.97MiB/s-23.6MiB/s (10.5MB/s-24.8MB/s), io=62.7MiB (65.7MB), run=1001-1010msec 00:19:32.827 WRITE: bw=65.5MiB/s (68.7MB/s), 11.3MiB/s-24.0MiB/s (11.8MB/s-25.1MB/s), io=66.2MiB (69.4MB), run=1001-1010msec 00:19:32.827 00:19:32.827 Disk stats (read/write): 00:19:32.827 nvme0n1: ios=5170/5191, merge=0/0, ticks=12959/12476, in_queue=25435, util=86.67% 00:19:32.827 nvme0n2: ios=2179/2560, merge=0/0, ticks=14886/11458, in_queue=26344, util=95.83% 00:19:32.827 nvme0n3: ios=3641/3743, merge=0/0, ticks=15863/16145, in_queue=32008, util=94.98% 00:19:32.827 nvme0n4: ios=2607/2831, merge=0/0, ticks=17313/15513, in_queue=32826, util=100.00% 00:19:32.827 05:15:34 -- target/fio.sh@55 -- # sync 00:19:32.827 05:15:34 -- target/fio.sh@59 -- # fio_pid=3315225 00:19:32.827 05:15:34 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:32.827 05:15:34 -- target/fio.sh@61 -- # sleep 3 00:19:32.827 [global] 00:19:32.827 thread=1 00:19:32.827 invalidate=1 00:19:32.827 rw=read 00:19:32.827 time_based=1 00:19:32.827 runtime=10 00:19:32.827 ioengine=libaio 00:19:32.827 direct=1 00:19:32.827 bs=4096 00:19:32.827 iodepth=1 00:19:32.827 norandommap=1 00:19:32.827 numjobs=1 00:19:32.827 00:19:32.827 [job0] 00:19:32.827 filename=/dev/nvme0n1 00:19:32.827 [job1] 00:19:32.827 filename=/dev/nvme0n2 00:19:32.827 [job2] 00:19:32.827 filename=/dev/nvme0n3 00:19:32.827 [job3] 00:19:32.827 filename=/dev/nvme0n4 00:19:32.827 Could not set queue depth (nvme0n1) 00:19:32.827 Could not set queue depth (nvme0n2) 00:19:32.827 Could not set queue depth (nvme0n3) 00:19:32.827 Could not set queue depth (nvme0n4) 00:19:32.827 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:32.827 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:32.827 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:32.827 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:32.827 fio-3.35 00:19:32.827 Starting 4 threads 00:19:36.117 05:15:37 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:36.117 05:15:37 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:36.117 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=36659200, buflen=4096 00:19:36.117 fio: pid=3315325, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:36.375 05:15:37 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:36.375 05:15:37 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:36.375 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=39526400, buflen=4096 00:19:36.375 fio: pid=3315324, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:36.634 05:15:38 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:36.634 05:15:38 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:36.634 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=8392704, buflen=4096 00:19:36.634 fio: pid=3315322, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:36.892 05:15:38 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:36.892 05:15:38 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:36.892 fio: io_u error on file /dev/nvme0n2: Input/output error: read offset=52424704, buflen=4096 00:19:36.892 fio: pid=3315323, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:19:36.892 00:19:36.892 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3315322: Tue Nov 26 05:15:38 2024 00:19:36.892 read: IOPS=587, BW=2350KiB/s (2407kB/s)(8196KiB/3487msec) 00:19:36.892 slat (usec): min=4, max=27901, avg=35.02, stdev=720.05 00:19:36.892 clat (usec): min=194, max=42078, avg=1651.85, stdev=7290.34 00:19:36.892 lat (usec): min=208, max=69980, avg=1686.87, stdev=7446.93 00:19:36.892 clat percentiles (usec): 00:19:36.892 | 1.00th=[ 206], 5.00th=[ 223], 10.00th=[ 239], 20.00th=[ 262], 00:19:36.892 | 30.00th=[ 281], 40.00th=[ 293], 50.00th=[ 306], 60.00th=[ 318], 00:19:36.892 | 70.00th=[ 334], 80.00th=[ 379], 90.00th=[ 404], 95.00th=[ 486], 00:19:36.892 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:36.892 | 99.99th=[42206] 00:19:36.892 bw ( KiB/s): min= 96, max= 9232, per=7.63%, avg=2717.33, stdev=3656.68, samples=6 00:19:36.892 iops : min= 24, max= 2308, avg=679.33, stdev=914.17, samples=6 00:19:36.892 lat (usec) : 250=15.66%, 500=79.85%, 750=1.17% 00:19:36.892 lat (msec) : 50=3.27% 00:19:36.892 cpu : usr=0.26%, sys=0.92%, ctx=2056, majf=0, minf=2 00:19:36.892 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:36.892 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.892 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.892 issued rwts: total=2050,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.892 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:36.892 job1: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=3315323: Tue Nov 26 05:15:38 2024 00:19:36.892 read: IOPS=3406, BW=13.3MiB/s (13.9MB/s)(50.0MiB/3758msec) 00:19:36.892 slat (usec): min=3, max=9589, avg=12.80, stdev=154.50 00:19:36.892 clat (usec): min=182, max=45438, avg=278.36, stdev=985.17 00:19:36.892 lat (usec): min=186, max=45452, avg=290.58, stdev=995.44 00:19:36.892 clat percentiles (usec): 00:19:36.892 | 1.00th=[ 196], 5.00th=[ 204], 10.00th=[ 210], 20.00th=[ 217], 00:19:36.892 | 30.00th=[ 223], 40.00th=[ 229], 50.00th=[ 241], 60.00th=[ 260], 00:19:36.892 | 70.00th=[ 277], 80.00th=[ 293], 90.00th=[ 314], 95.00th=[ 338], 00:19:36.892 | 99.00th=[ 412], 99.50th=[ 465], 99.90th=[ 709], 99.95th=[41157], 00:19:36.892 | 99.99th=[42206] 00:19:36.892 bw ( KiB/s): min=11926, max=15984, per=40.10%, avg=14275.14, stdev=1542.01, samples=7 00:19:36.892 iops : min= 2981, max= 3996, avg=3568.71, stdev=385.63, samples=7 00:19:36.892 lat (usec) : 250=57.48%, 500=42.26%, 750=0.16%, 1000=0.02% 00:19:36.892 lat (msec) : 2=0.02%, 10=0.01%, 50=0.05% 00:19:36.892 cpu : usr=1.76%, sys=4.50%, ctx=12807, majf=0, minf=1 00:19:36.892 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:36.892 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.892 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.892 issued rwts: total=12800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.892 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:36.892 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3315324: Tue Nov 26 05:15:38 2024 00:19:36.892 read: IOPS=3019, BW=11.8MiB/s (12.4MB/s)(37.7MiB/3196msec) 00:19:36.892 slat (nsec): min=4500, max=71593, avg=15807.82, stdev=9649.77 00:19:36.892 clat (usec): min=200, max=42348, avg=309.33, stdev=555.11 00:19:36.893 lat (usec): min=213, max=42376, avg=325.14, stdev=555.37 00:19:36.893 clat percentiles (usec): 00:19:36.893 | 1.00th=[ 219], 5.00th=[ 231], 10.00th=[ 241], 20.00th=[ 253], 00:19:36.893 | 30.00th=[ 269], 40.00th=[ 281], 50.00th=[ 293], 60.00th=[ 310], 00:19:36.893 | 70.00th=[ 330], 80.00th=[ 347], 90.00th=[ 379], 95.00th=[ 383], 00:19:36.893 | 99.00th=[ 420], 99.50th=[ 449], 99.90th=[ 586], 99.95th=[ 906], 00:19:36.893 | 99.99th=[42206] 00:19:36.893 bw ( KiB/s): min=10480, max=13360, per=34.08%, avg=12133.33, stdev=948.93, samples=6 00:19:36.893 iops : min= 2620, max= 3340, avg=3033.33, stdev=237.23, samples=6 00:19:36.893 lat (usec) : 250=18.05%, 500=81.75%, 750=0.12%, 1000=0.02% 00:19:36.893 lat (msec) : 2=0.02%, 50=0.02% 00:19:36.893 cpu : usr=2.25%, sys=5.13%, ctx=9653, majf=0, minf=2 00:19:36.893 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:36.893 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.893 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.893 issued rwts: total=9651,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.893 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:36.893 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3315325: Tue Nov 26 05:15:38 2024 00:19:36.893 read: IOPS=3066, BW=12.0MiB/s (12.6MB/s)(35.0MiB/2919msec) 00:19:36.893 slat (nsec): min=5192, max=61053, avg=11790.06, stdev=5679.92 00:19:36.893 clat (usec): min=209, max=41981, avg=308.57, stdev=1372.74 00:19:36.893 lat (usec): min=216, max=41997, avg=320.36, stdev=1372.94 00:19:36.893 clat percentiles (usec): 00:19:36.893 | 1.00th=[ 223], 5.00th=[ 231], 10.00th=[ 235], 20.00th=[ 241], 00:19:36.893 | 30.00th=[ 247], 40.00th=[ 253], 50.00th=[ 260], 60.00th=[ 269], 00:19:36.893 | 70.00th=[ 277], 80.00th=[ 285], 90.00th=[ 293], 95.00th=[ 302], 00:19:36.893 | 99.00th=[ 338], 99.50th=[ 363], 99.90th=[40633], 99.95th=[41681], 00:19:36.893 | 99.99th=[42206] 00:19:36.893 bw ( KiB/s): min=13544, max=15384, per=39.91%, avg=14208.00, stdev=722.97, samples=5 00:19:36.893 iops : min= 3386, max= 3846, avg=3552.00, stdev=180.74, samples=5 00:19:36.893 lat (usec) : 250=35.64%, 500=64.14%, 750=0.07%, 1000=0.03% 00:19:36.893 lat (msec) : 50=0.11% 00:19:36.893 cpu : usr=2.23%, sys=5.65%, ctx=8952, majf=0, minf=2 00:19:36.893 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:36.893 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.893 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.893 issued rwts: total=8951,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.893 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:36.893 00:19:36.893 Run status group 0 (all jobs): 00:19:36.893 READ: bw=34.8MiB/s (36.5MB/s), 2350KiB/s-13.3MiB/s (2407kB/s-13.9MB/s), io=131MiB (137MB), run=2919-3758msec 00:19:36.893 00:19:36.893 Disk stats (read/write): 00:19:36.893 nvme0n1: ios=2086/0, merge=0/0, ticks=4032/0, in_queue=4032, util=98.20% 00:19:36.893 nvme0n2: ios=12795/0, merge=0/0, ticks=3239/0, in_queue=3239, util=95.85% 00:19:36.893 nvme0n3: ios=9482/0, merge=0/0, ticks=3056/0, in_queue=3056, util=99.53% 00:19:36.893 nvme0n4: ios=8998/0, merge=0/0, ticks=3677/0, in_queue=3677, util=99.22% 00:19:37.151 05:15:38 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:37.151 05:15:38 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:37.410 05:15:38 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:37.410 05:15:38 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:37.666 05:15:39 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:37.666 05:15:39 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:37.923 05:15:39 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:37.923 05:15:39 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:38.181 05:15:39 -- target/fio.sh@69 -- # fio_status=0 00:19:38.181 05:15:39 -- target/fio.sh@70 -- # wait 3315225 00:19:38.181 05:15:39 -- target/fio.sh@70 -- # fio_status=4 00:19:38.181 05:15:39 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:38.181 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:38.181 05:15:39 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:38.181 05:15:39 -- common/autotest_common.sh@1208 -- # local i=0 00:19:38.181 05:15:39 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:38.181 05:15:39 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:38.181 05:15:39 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:38.181 05:15:39 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:38.181 05:15:39 -- common/autotest_common.sh@1220 -- # return 0 00:19:38.181 05:15:39 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:38.181 05:15:39 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:38.181 nvmf hotplug test: fio failed as expected 00:19:38.181 05:15:39 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:38.439 05:15:40 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:38.439 05:15:40 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:38.439 05:15:40 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:38.439 05:15:40 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:38.439 05:15:40 -- target/fio.sh@91 -- # nvmftestfini 00:19:38.439 05:15:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:38.439 05:15:40 -- nvmf/common.sh@116 -- # sync 00:19:38.439 05:15:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:38.439 05:15:40 -- nvmf/common.sh@119 -- # set +e 00:19:38.439 05:15:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:38.439 05:15:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:38.439 rmmod nvme_tcp 00:19:38.439 rmmod nvme_fabrics 00:19:38.700 rmmod nvme_keyring 00:19:38.700 05:15:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:38.700 05:15:40 -- nvmf/common.sh@123 -- # set -e 00:19:38.700 05:15:40 -- nvmf/common.sh@124 -- # return 0 00:19:38.700 05:15:40 -- nvmf/common.sh@477 -- # '[' -n 3313141 ']' 00:19:38.700 05:15:40 -- nvmf/common.sh@478 -- # killprocess 3313141 00:19:38.700 05:15:40 -- common/autotest_common.sh@936 -- # '[' -z 3313141 ']' 00:19:38.700 05:15:40 -- common/autotest_common.sh@940 -- # kill -0 3313141 00:19:38.700 05:15:40 -- common/autotest_common.sh@941 -- # uname 00:19:38.700 05:15:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:38.700 05:15:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3313141 00:19:38.700 05:15:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:38.700 05:15:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:38.700 05:15:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3313141' 00:19:38.700 killing process with pid 3313141 00:19:38.700 05:15:40 -- common/autotest_common.sh@955 -- # kill 3313141 00:19:38.700 05:15:40 -- common/autotest_common.sh@960 -- # wait 3313141 00:19:38.960 05:15:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:38.960 05:15:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:38.960 05:15:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:38.960 05:15:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:38.960 05:15:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:38.960 05:15:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:38.960 05:15:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:38.960 05:15:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:40.865 05:15:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:40.865 00:19:40.865 real 0m24.253s 00:19:40.865 user 1m24.415s 00:19:40.865 sys 0m8.026s 00:19:40.865 05:15:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:40.865 05:15:42 -- common/autotest_common.sh@10 -- # set +x 00:19:40.865 ************************************ 00:19:40.865 END TEST nvmf_fio_target 00:19:40.865 ************************************ 00:19:40.865 05:15:42 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:40.865 05:15:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:40.865 05:15:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:40.865 05:15:42 -- common/autotest_common.sh@10 -- # set +x 00:19:40.865 ************************************ 00:19:40.865 START TEST nvmf_bdevio 00:19:40.865 ************************************ 00:19:40.865 05:15:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:40.865 * Looking for test storage... 00:19:40.865 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:40.865 05:15:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:40.865 05:15:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:40.865 05:15:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:41.123 05:15:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:41.123 05:15:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:41.123 05:15:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:41.123 05:15:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:41.123 05:15:42 -- scripts/common.sh@335 -- # IFS=.-: 00:19:41.123 05:15:42 -- scripts/common.sh@335 -- # read -ra ver1 00:19:41.123 05:15:42 -- scripts/common.sh@336 -- # IFS=.-: 00:19:41.123 05:15:42 -- scripts/common.sh@336 -- # read -ra ver2 00:19:41.123 05:15:42 -- scripts/common.sh@337 -- # local 'op=<' 00:19:41.123 05:15:42 -- scripts/common.sh@339 -- # ver1_l=2 00:19:41.123 05:15:42 -- scripts/common.sh@340 -- # ver2_l=1 00:19:41.123 05:15:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:41.123 05:15:42 -- scripts/common.sh@343 -- # case "$op" in 00:19:41.123 05:15:42 -- scripts/common.sh@344 -- # : 1 00:19:41.123 05:15:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:41.123 05:15:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:41.123 05:15:42 -- scripts/common.sh@364 -- # decimal 1 00:19:41.123 05:15:42 -- scripts/common.sh@352 -- # local d=1 00:19:41.123 05:15:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:41.123 05:15:42 -- scripts/common.sh@354 -- # echo 1 00:19:41.123 05:15:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:41.123 05:15:42 -- scripts/common.sh@365 -- # decimal 2 00:19:41.123 05:15:42 -- scripts/common.sh@352 -- # local d=2 00:19:41.123 05:15:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:41.123 05:15:42 -- scripts/common.sh@354 -- # echo 2 00:19:41.123 05:15:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:41.123 05:15:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:41.123 05:15:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:41.123 05:15:42 -- scripts/common.sh@367 -- # return 0 00:19:41.123 05:15:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:41.123 05:15:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:41.123 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:41.123 --rc genhtml_branch_coverage=1 00:19:41.123 --rc genhtml_function_coverage=1 00:19:41.123 --rc genhtml_legend=1 00:19:41.123 --rc geninfo_all_blocks=1 00:19:41.123 --rc geninfo_unexecuted_blocks=1 00:19:41.123 00:19:41.123 ' 00:19:41.123 05:15:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:41.123 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:41.123 --rc genhtml_branch_coverage=1 00:19:41.123 --rc genhtml_function_coverage=1 00:19:41.123 --rc genhtml_legend=1 00:19:41.123 --rc geninfo_all_blocks=1 00:19:41.123 --rc geninfo_unexecuted_blocks=1 00:19:41.123 00:19:41.123 ' 00:19:41.123 05:15:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:41.123 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:41.123 --rc genhtml_branch_coverage=1 00:19:41.123 --rc genhtml_function_coverage=1 00:19:41.123 --rc genhtml_legend=1 00:19:41.123 --rc geninfo_all_blocks=1 00:19:41.123 --rc geninfo_unexecuted_blocks=1 00:19:41.123 00:19:41.123 ' 00:19:41.123 05:15:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:41.123 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:41.123 --rc genhtml_branch_coverage=1 00:19:41.123 --rc genhtml_function_coverage=1 00:19:41.123 --rc genhtml_legend=1 00:19:41.123 --rc geninfo_all_blocks=1 00:19:41.123 --rc geninfo_unexecuted_blocks=1 00:19:41.123 00:19:41.123 ' 00:19:41.123 05:15:42 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:41.123 05:15:42 -- nvmf/common.sh@7 -- # uname -s 00:19:41.123 05:15:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:41.123 05:15:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:41.123 05:15:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:41.123 05:15:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:41.123 05:15:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:41.123 05:15:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:41.123 05:15:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:41.123 05:15:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:41.123 05:15:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:41.123 05:15:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:41.123 05:15:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:41.123 05:15:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:41.124 05:15:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:41.124 05:15:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:41.124 05:15:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:41.124 05:15:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:41.124 05:15:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:41.124 05:15:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:41.124 05:15:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:41.124 05:15:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:41.124 05:15:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:41.124 05:15:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:41.124 05:15:42 -- paths/export.sh@5 -- # export PATH 00:19:41.124 05:15:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:41.124 05:15:42 -- nvmf/common.sh@46 -- # : 0 00:19:41.124 05:15:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:41.124 05:15:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:41.124 05:15:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:41.124 05:15:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:41.124 05:15:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:41.124 05:15:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:41.124 05:15:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:41.124 05:15:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:41.124 05:15:42 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:41.124 05:15:42 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:41.124 05:15:42 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:41.124 05:15:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:41.124 05:15:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:41.124 05:15:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:41.124 05:15:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:41.124 05:15:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:41.124 05:15:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:41.124 05:15:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:41.124 05:15:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:41.124 05:15:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:41.124 05:15:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:41.124 05:15:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:41.124 05:15:42 -- common/autotest_common.sh@10 -- # set +x 00:19:43.027 05:15:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:43.027 05:15:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:43.027 05:15:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:43.027 05:15:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:43.027 05:15:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:43.027 05:15:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:43.027 05:15:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:43.027 05:15:44 -- nvmf/common.sh@294 -- # net_devs=() 00:19:43.027 05:15:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:43.027 05:15:44 -- nvmf/common.sh@295 -- # e810=() 00:19:43.027 05:15:44 -- nvmf/common.sh@295 -- # local -ga e810 00:19:43.027 05:15:44 -- nvmf/common.sh@296 -- # x722=() 00:19:43.027 05:15:44 -- nvmf/common.sh@296 -- # local -ga x722 00:19:43.027 05:15:44 -- nvmf/common.sh@297 -- # mlx=() 00:19:43.027 05:15:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:43.027 05:15:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:43.027 05:15:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:43.027 05:15:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:43.027 05:15:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:43.027 05:15:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:43.027 05:15:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:43.027 05:15:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:43.027 05:15:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:43.027 05:15:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:43.027 05:15:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:43.027 05:15:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:43.027 05:15:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:43.027 05:15:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:43.027 05:15:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:43.027 05:15:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:43.027 05:15:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:43.027 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:43.027 05:15:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:43.027 05:15:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:43.027 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:43.027 05:15:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:43.027 05:15:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:43.027 05:15:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:43.027 05:15:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:43.027 05:15:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:43.027 05:15:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:43.027 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:43.027 05:15:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:43.027 05:15:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:43.027 05:15:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:43.027 05:15:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:43.027 05:15:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:43.027 05:15:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:43.027 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:43.027 05:15:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:43.027 05:15:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:43.027 05:15:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:43.027 05:15:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:43.027 05:15:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:43.027 05:15:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:43.027 05:15:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:43.027 05:15:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:43.027 05:15:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:43.028 05:15:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:43.028 05:15:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:43.028 05:15:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:43.028 05:15:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:43.028 05:15:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:43.028 05:15:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:43.028 05:15:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:43.028 05:15:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:43.028 05:15:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:43.028 05:15:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:43.028 05:15:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:43.028 05:15:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:43.028 05:15:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:43.028 05:15:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:43.028 05:15:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:43.028 05:15:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:43.028 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:43.028 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:19:43.028 00:19:43.028 --- 10.0.0.2 ping statistics --- 00:19:43.028 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:43.028 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:19:43.028 05:15:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:43.028 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:43.028 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:19:43.028 00:19:43.028 --- 10.0.0.1 ping statistics --- 00:19:43.028 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:43.028 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:19:43.028 05:15:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:43.028 05:15:44 -- nvmf/common.sh@410 -- # return 0 00:19:43.028 05:15:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:43.028 05:15:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:43.028 05:15:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:43.028 05:15:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:43.028 05:15:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:43.028 05:15:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:43.028 05:15:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:43.028 05:15:44 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:43.028 05:15:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:43.028 05:15:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:43.028 05:15:44 -- common/autotest_common.sh@10 -- # set +x 00:19:43.028 05:15:44 -- nvmf/common.sh@469 -- # nvmfpid=3317982 00:19:43.028 05:15:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:43.028 05:15:44 -- nvmf/common.sh@470 -- # waitforlisten 3317982 00:19:43.028 05:15:44 -- common/autotest_common.sh@829 -- # '[' -z 3317982 ']' 00:19:43.028 05:15:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:43.028 05:15:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:43.028 05:15:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:43.028 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:43.028 05:15:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:43.028 05:15:44 -- common/autotest_common.sh@10 -- # set +x 00:19:43.288 [2024-11-26 05:15:44.821833] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:43.288 [2024-11-26 05:15:44.821916] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:43.288 EAL: No free 2048 kB hugepages reported on node 1 00:19:43.288 [2024-11-26 05:15:44.893317] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:43.288 [2024-11-26 05:15:44.990743] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:43.288 [2024-11-26 05:15:44.990923] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:43.288 [2024-11-26 05:15:44.990955] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:43.288 [2024-11-26 05:15:44.990970] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:43.288 [2024-11-26 05:15:44.991087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:43.288 [2024-11-26 05:15:44.991149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:43.288 [2024-11-26 05:15:44.991205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:43.288 [2024-11-26 05:15:44.991208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:44.225 05:15:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:44.225 05:15:45 -- common/autotest_common.sh@862 -- # return 0 00:19:44.225 05:15:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:44.225 05:15:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:44.225 05:15:45 -- common/autotest_common.sh@10 -- # set +x 00:19:44.225 05:15:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:44.225 05:15:45 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:44.225 05:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:44.225 05:15:45 -- common/autotest_common.sh@10 -- # set +x 00:19:44.225 [2024-11-26 05:15:45.885528] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:44.225 05:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:44.225 05:15:45 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:44.225 05:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:44.225 05:15:45 -- common/autotest_common.sh@10 -- # set +x 00:19:44.225 Malloc0 00:19:44.225 05:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:44.225 05:15:45 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:44.225 05:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:44.225 05:15:45 -- common/autotest_common.sh@10 -- # set +x 00:19:44.225 05:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:44.225 05:15:45 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:44.225 05:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:44.225 05:15:45 -- common/autotest_common.sh@10 -- # set +x 00:19:44.225 05:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:44.225 05:15:45 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:44.225 05:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:44.225 05:15:45 -- common/autotest_common.sh@10 -- # set +x 00:19:44.225 [2024-11-26 05:15:45.936747] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:44.225 05:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:44.225 05:15:45 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:44.225 05:15:45 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:44.225 05:15:45 -- nvmf/common.sh@520 -- # config=() 00:19:44.225 05:15:45 -- nvmf/common.sh@520 -- # local subsystem config 00:19:44.225 05:15:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:44.225 05:15:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:44.225 { 00:19:44.225 "params": { 00:19:44.225 "name": "Nvme$subsystem", 00:19:44.225 "trtype": "$TEST_TRANSPORT", 00:19:44.225 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:44.225 "adrfam": "ipv4", 00:19:44.225 "trsvcid": "$NVMF_PORT", 00:19:44.225 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:44.225 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:44.225 "hdgst": ${hdgst:-false}, 00:19:44.225 "ddgst": ${ddgst:-false} 00:19:44.225 }, 00:19:44.225 "method": "bdev_nvme_attach_controller" 00:19:44.225 } 00:19:44.225 EOF 00:19:44.225 )") 00:19:44.225 05:15:45 -- nvmf/common.sh@542 -- # cat 00:19:44.225 05:15:45 -- nvmf/common.sh@544 -- # jq . 00:19:44.225 05:15:45 -- nvmf/common.sh@545 -- # IFS=, 00:19:44.225 05:15:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:44.225 "params": { 00:19:44.225 "name": "Nvme1", 00:19:44.225 "trtype": "tcp", 00:19:44.225 "traddr": "10.0.0.2", 00:19:44.225 "adrfam": "ipv4", 00:19:44.225 "trsvcid": "4420", 00:19:44.225 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:44.225 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:44.225 "hdgst": false, 00:19:44.225 "ddgst": false 00:19:44.225 }, 00:19:44.225 "method": "bdev_nvme_attach_controller" 00:19:44.225 }' 00:19:44.225 [2024-11-26 05:15:45.980282] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:44.225 [2024-11-26 05:15:45.980375] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3318160 ] 00:19:44.483 EAL: No free 2048 kB hugepages reported on node 1 00:19:44.483 [2024-11-26 05:15:46.047197] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:44.483 [2024-11-26 05:15:46.133420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:44.483 [2024-11-26 05:15:46.133473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:44.483 [2024-11-26 05:15:46.133476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:44.742 [2024-11-26 05:15:46.459355] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:44.742 [2024-11-26 05:15:46.459423] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:44.742 I/O targets: 00:19:44.742 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:44.742 00:19:44.742 00:19:44.742 CUnit - A unit testing framework for C - Version 2.1-3 00:19:44.742 http://cunit.sourceforge.net/ 00:19:44.742 00:19:44.742 00:19:44.742 Suite: bdevio tests on: Nvme1n1 00:19:45.002 Test: blockdev write read block ...passed 00:19:45.002 Test: blockdev write zeroes read block ...passed 00:19:45.002 Test: blockdev write zeroes read no split ...passed 00:19:45.002 Test: blockdev write zeroes read split ...passed 00:19:45.002 Test: blockdev write zeroes read split partial ...passed 00:19:45.002 Test: blockdev reset ...[2024-11-26 05:15:46.617957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:45.002 [2024-11-26 05:15:46.618075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2410670 (9): Bad file descriptor 00:19:45.002 [2024-11-26 05:15:46.719138] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:45.002 passed 00:19:45.002 Test: blockdev write read 8 blocks ...passed 00:19:45.002 Test: blockdev write read size > 128k ...passed 00:19:45.002 Test: blockdev write read invalid size ...passed 00:19:45.002 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:45.002 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:45.002 Test: blockdev write read max offset ...passed 00:19:45.262 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:45.262 Test: blockdev writev readv 8 blocks ...passed 00:19:45.262 Test: blockdev writev readv 30 x 1block ...passed 00:19:45.262 Test: blockdev writev readv block ...passed 00:19:45.262 Test: blockdev writev readv size > 128k ...passed 00:19:45.262 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:45.262 Test: blockdev comparev and writev ...[2024-11-26 05:15:46.975009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:45.262 [2024-11-26 05:15:46.975048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:45.262 [2024-11-26 05:15:46.975083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:45.262 [2024-11-26 05:15:46.975101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:45.262 [2024-11-26 05:15:46.975483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:45.262 [2024-11-26 05:15:46.975509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:45.262 [2024-11-26 05:15:46.975530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:45.262 [2024-11-26 05:15:46.975546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:45.262 [2024-11-26 05:15:46.975924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:45.262 [2024-11-26 05:15:46.975960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:45.262 [2024-11-26 05:15:46.975982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:45.262 [2024-11-26 05:15:46.975998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:45.262 [2024-11-26 05:15:46.976365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:45.262 [2024-11-26 05:15:46.976391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:45.262 [2024-11-26 05:15:46.976414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:45.262 [2024-11-26 05:15:46.976431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:45.262 passed 00:19:45.522 Test: blockdev nvme passthru rw ...passed 00:19:45.522 Test: blockdev nvme passthru vendor specific ...[2024-11-26 05:15:47.058990] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:45.522 [2024-11-26 05:15:47.059017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:45.522 [2024-11-26 05:15:47.059165] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:45.522 [2024-11-26 05:15:47.059187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:45.522 [2024-11-26 05:15:47.059336] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:45.523 [2024-11-26 05:15:47.059359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:45.523 [2024-11-26 05:15:47.059501] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:45.523 [2024-11-26 05:15:47.059523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:45.523 passed 00:19:45.523 Test: blockdev nvme admin passthru ...passed 00:19:45.523 Test: blockdev copy ...passed 00:19:45.523 00:19:45.523 Run Summary: Type Total Ran Passed Failed Inactive 00:19:45.523 suites 1 1 n/a 0 0 00:19:45.523 tests 23 23 23 0 0 00:19:45.523 asserts 152 152 152 0 n/a 00:19:45.523 00:19:45.523 Elapsed time = 1.323 seconds 00:19:45.781 05:15:47 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:45.781 05:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:45.781 05:15:47 -- common/autotest_common.sh@10 -- # set +x 00:19:45.781 05:15:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:45.781 05:15:47 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:45.781 05:15:47 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:45.781 05:15:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:45.781 05:15:47 -- nvmf/common.sh@116 -- # sync 00:19:45.781 05:15:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:45.781 05:15:47 -- nvmf/common.sh@119 -- # set +e 00:19:45.781 05:15:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:45.781 05:15:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:45.781 rmmod nvme_tcp 00:19:45.781 rmmod nvme_fabrics 00:19:45.781 rmmod nvme_keyring 00:19:45.781 05:15:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:45.781 05:15:47 -- nvmf/common.sh@123 -- # set -e 00:19:45.781 05:15:47 -- nvmf/common.sh@124 -- # return 0 00:19:45.781 05:15:47 -- nvmf/common.sh@477 -- # '[' -n 3317982 ']' 00:19:45.781 05:15:47 -- nvmf/common.sh@478 -- # killprocess 3317982 00:19:45.781 05:15:47 -- common/autotest_common.sh@936 -- # '[' -z 3317982 ']' 00:19:45.781 05:15:47 -- common/autotest_common.sh@940 -- # kill -0 3317982 00:19:45.781 05:15:47 -- common/autotest_common.sh@941 -- # uname 00:19:45.781 05:15:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:45.781 05:15:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3317982 00:19:45.781 05:15:47 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:45.781 05:15:47 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:45.781 05:15:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3317982' 00:19:45.781 killing process with pid 3317982 00:19:45.782 05:15:47 -- common/autotest_common.sh@955 -- # kill 3317982 00:19:45.782 05:15:47 -- common/autotest_common.sh@960 -- # wait 3317982 00:19:46.039 05:15:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:46.039 05:15:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:46.039 05:15:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:46.039 05:15:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:46.039 05:15:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:46.039 05:15:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:46.039 05:15:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:46.039 05:15:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:47.944 05:15:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:47.944 00:19:47.944 real 0m7.129s 00:19:47.944 user 0m14.303s 00:19:47.944 sys 0m2.030s 00:19:47.944 05:15:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:47.944 05:15:49 -- common/autotest_common.sh@10 -- # set +x 00:19:47.944 ************************************ 00:19:47.944 END TEST nvmf_bdevio 00:19:47.944 ************************************ 00:19:48.203 05:15:49 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:48.203 05:15:49 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:48.203 05:15:49 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:19:48.203 05:15:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:48.203 05:15:49 -- common/autotest_common.sh@10 -- # set +x 00:19:48.203 ************************************ 00:19:48.203 START TEST nvmf_bdevio_no_huge 00:19:48.203 ************************************ 00:19:48.203 05:15:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:48.203 * Looking for test storage... 00:19:48.203 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:48.203 05:15:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:48.203 05:15:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:48.203 05:15:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:48.203 05:15:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:48.203 05:15:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:48.203 05:15:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:48.203 05:15:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:48.203 05:15:49 -- scripts/common.sh@335 -- # IFS=.-: 00:19:48.203 05:15:49 -- scripts/common.sh@335 -- # read -ra ver1 00:19:48.203 05:15:49 -- scripts/common.sh@336 -- # IFS=.-: 00:19:48.203 05:15:49 -- scripts/common.sh@336 -- # read -ra ver2 00:19:48.203 05:15:49 -- scripts/common.sh@337 -- # local 'op=<' 00:19:48.203 05:15:49 -- scripts/common.sh@339 -- # ver1_l=2 00:19:48.203 05:15:49 -- scripts/common.sh@340 -- # ver2_l=1 00:19:48.203 05:15:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:48.203 05:15:49 -- scripts/common.sh@343 -- # case "$op" in 00:19:48.203 05:15:49 -- scripts/common.sh@344 -- # : 1 00:19:48.203 05:15:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:48.203 05:15:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:48.203 05:15:49 -- scripts/common.sh@364 -- # decimal 1 00:19:48.203 05:15:49 -- scripts/common.sh@352 -- # local d=1 00:19:48.203 05:15:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:48.203 05:15:49 -- scripts/common.sh@354 -- # echo 1 00:19:48.203 05:15:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:48.203 05:15:49 -- scripts/common.sh@365 -- # decimal 2 00:19:48.203 05:15:49 -- scripts/common.sh@352 -- # local d=2 00:19:48.203 05:15:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:48.203 05:15:49 -- scripts/common.sh@354 -- # echo 2 00:19:48.203 05:15:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:48.203 05:15:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:48.203 05:15:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:48.203 05:15:49 -- scripts/common.sh@367 -- # return 0 00:19:48.203 05:15:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:48.203 05:15:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:48.203 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:48.203 --rc genhtml_branch_coverage=1 00:19:48.203 --rc genhtml_function_coverage=1 00:19:48.203 --rc genhtml_legend=1 00:19:48.203 --rc geninfo_all_blocks=1 00:19:48.203 --rc geninfo_unexecuted_blocks=1 00:19:48.203 00:19:48.203 ' 00:19:48.203 05:15:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:48.203 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:48.203 --rc genhtml_branch_coverage=1 00:19:48.203 --rc genhtml_function_coverage=1 00:19:48.203 --rc genhtml_legend=1 00:19:48.203 --rc geninfo_all_blocks=1 00:19:48.203 --rc geninfo_unexecuted_blocks=1 00:19:48.203 00:19:48.203 ' 00:19:48.203 05:15:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:48.203 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:48.203 --rc genhtml_branch_coverage=1 00:19:48.203 --rc genhtml_function_coverage=1 00:19:48.203 --rc genhtml_legend=1 00:19:48.203 --rc geninfo_all_blocks=1 00:19:48.203 --rc geninfo_unexecuted_blocks=1 00:19:48.203 00:19:48.203 ' 00:19:48.203 05:15:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:48.203 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:48.203 --rc genhtml_branch_coverage=1 00:19:48.203 --rc genhtml_function_coverage=1 00:19:48.203 --rc genhtml_legend=1 00:19:48.203 --rc geninfo_all_blocks=1 00:19:48.203 --rc geninfo_unexecuted_blocks=1 00:19:48.203 00:19:48.203 ' 00:19:48.203 05:15:49 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:48.203 05:15:49 -- nvmf/common.sh@7 -- # uname -s 00:19:48.203 05:15:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:48.203 05:15:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:48.203 05:15:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:48.203 05:15:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:48.203 05:15:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:48.203 05:15:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:48.203 05:15:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:48.203 05:15:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:48.203 05:15:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:48.203 05:15:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:48.203 05:15:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:48.203 05:15:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:48.203 05:15:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:48.203 05:15:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:48.203 05:15:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:48.204 05:15:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:48.204 05:15:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:48.204 05:15:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:48.204 05:15:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:48.204 05:15:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.204 05:15:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.204 05:15:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.204 05:15:49 -- paths/export.sh@5 -- # export PATH 00:19:48.204 05:15:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.204 05:15:49 -- nvmf/common.sh@46 -- # : 0 00:19:48.204 05:15:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:48.204 05:15:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:48.204 05:15:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:48.204 05:15:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:48.204 05:15:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:48.204 05:15:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:48.204 05:15:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:48.204 05:15:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:48.204 05:15:49 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:48.204 05:15:49 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:48.204 05:15:49 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:48.204 05:15:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:48.204 05:15:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:48.204 05:15:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:48.204 05:15:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:48.204 05:15:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:48.204 05:15:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:48.204 05:15:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:48.204 05:15:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:48.204 05:15:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:48.204 05:15:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:48.204 05:15:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:48.204 05:15:49 -- common/autotest_common.sh@10 -- # set +x 00:19:50.742 05:15:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:50.742 05:15:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:50.742 05:15:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:50.742 05:15:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:50.742 05:15:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:50.742 05:15:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:50.742 05:15:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:50.742 05:15:51 -- nvmf/common.sh@294 -- # net_devs=() 00:19:50.742 05:15:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:50.742 05:15:51 -- nvmf/common.sh@295 -- # e810=() 00:19:50.742 05:15:51 -- nvmf/common.sh@295 -- # local -ga e810 00:19:50.742 05:15:51 -- nvmf/common.sh@296 -- # x722=() 00:19:50.742 05:15:51 -- nvmf/common.sh@296 -- # local -ga x722 00:19:50.742 05:15:51 -- nvmf/common.sh@297 -- # mlx=() 00:19:50.742 05:15:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:50.742 05:15:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:50.742 05:15:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:50.742 05:15:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:50.742 05:15:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:50.742 05:15:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:50.742 05:15:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:50.742 05:15:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:50.742 05:15:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:50.742 05:15:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:50.742 05:15:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:50.742 05:15:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:50.742 05:15:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:50.742 05:15:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:50.742 05:15:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:50.742 05:15:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:50.742 05:15:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:50.742 05:15:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:50.742 05:15:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:50.742 05:15:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:50.742 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:50.742 05:15:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:50.742 05:15:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:50.742 05:15:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:50.742 05:15:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:50.742 05:15:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:50.742 05:15:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:50.743 05:15:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:50.743 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:50.743 05:15:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:50.743 05:15:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:50.743 05:15:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:50.743 05:15:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:50.743 05:15:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:50.743 05:15:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:50.743 05:15:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:50.743 05:15:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:50.743 05:15:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:50.743 05:15:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:50.743 05:15:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:50.743 05:15:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:50.743 05:15:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:50.743 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:50.743 05:15:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:50.743 05:15:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:50.743 05:15:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:50.743 05:15:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:50.743 05:15:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:50.743 05:15:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:50.743 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:50.743 05:15:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:50.743 05:15:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:50.743 05:15:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:50.743 05:15:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:50.743 05:15:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:50.743 05:15:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:50.743 05:15:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:50.743 05:15:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:50.743 05:15:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:50.743 05:15:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:50.743 05:15:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:50.743 05:15:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:50.743 05:15:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:50.743 05:15:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:50.743 05:15:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:50.743 05:15:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:50.743 05:15:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:50.743 05:15:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:50.743 05:15:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:50.743 05:15:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:50.743 05:15:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:50.743 05:15:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:50.743 05:15:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:50.743 05:15:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:50.743 05:15:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:50.743 05:15:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:50.743 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:50.743 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:19:50.743 00:19:50.743 --- 10.0.0.2 ping statistics --- 00:19:50.743 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:50.743 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:19:50.743 05:15:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:50.743 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:50.743 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.087 ms 00:19:50.743 00:19:50.743 --- 10.0.0.1 ping statistics --- 00:19:50.743 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:50.743 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:19:50.743 05:15:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:50.743 05:15:52 -- nvmf/common.sh@410 -- # return 0 00:19:50.743 05:15:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:50.743 05:15:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:50.743 05:15:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:50.743 05:15:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:50.743 05:15:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:50.743 05:15:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:50.743 05:15:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:50.743 05:15:52 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:50.743 05:15:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:50.743 05:15:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:50.743 05:15:52 -- common/autotest_common.sh@10 -- # set +x 00:19:50.743 05:15:52 -- nvmf/common.sh@469 -- # nvmfpid=3320352 00:19:50.743 05:15:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:50.743 05:15:52 -- nvmf/common.sh@470 -- # waitforlisten 3320352 00:19:50.743 05:15:52 -- common/autotest_common.sh@829 -- # '[' -z 3320352 ']' 00:19:50.743 05:15:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:50.743 05:15:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:50.743 05:15:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:50.743 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:50.743 05:15:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:50.743 05:15:52 -- common/autotest_common.sh@10 -- # set +x 00:19:50.743 [2024-11-26 05:15:52.084178] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:50.743 [2024-11-26 05:15:52.084262] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:50.743 [2024-11-26 05:15:52.154459] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:50.743 [2024-11-26 05:15:52.246474] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:50.743 [2024-11-26 05:15:52.246661] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:50.743 [2024-11-26 05:15:52.246681] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:50.743 [2024-11-26 05:15:52.246706] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:50.743 [2024-11-26 05:15:52.246810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:50.743 [2024-11-26 05:15:52.246870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:50.743 [2024-11-26 05:15:52.246922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:50.743 [2024-11-26 05:15:52.246924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:50.743 05:15:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:50.743 05:15:52 -- common/autotest_common.sh@862 -- # return 0 00:19:50.743 05:15:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:50.743 05:15:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:50.743 05:15:52 -- common/autotest_common.sh@10 -- # set +x 00:19:50.743 05:15:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:50.743 05:15:52 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:50.743 05:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:50.743 05:15:52 -- common/autotest_common.sh@10 -- # set +x 00:19:50.743 [2024-11-26 05:15:52.362805] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:50.743 05:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:50.743 05:15:52 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:50.743 05:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:50.743 05:15:52 -- common/autotest_common.sh@10 -- # set +x 00:19:50.743 Malloc0 00:19:50.743 05:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:50.743 05:15:52 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:50.743 05:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:50.743 05:15:52 -- common/autotest_common.sh@10 -- # set +x 00:19:50.743 05:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:50.743 05:15:52 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:50.743 05:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:50.743 05:15:52 -- common/autotest_common.sh@10 -- # set +x 00:19:50.743 05:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:50.743 05:15:52 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:50.743 05:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:50.743 05:15:52 -- common/autotest_common.sh@10 -- # set +x 00:19:50.743 [2024-11-26 05:15:52.400507] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:50.743 05:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:50.743 05:15:52 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:50.743 05:15:52 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:50.743 05:15:52 -- nvmf/common.sh@520 -- # config=() 00:19:50.743 05:15:52 -- nvmf/common.sh@520 -- # local subsystem config 00:19:50.743 05:15:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:50.743 05:15:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:50.743 { 00:19:50.743 "params": { 00:19:50.743 "name": "Nvme$subsystem", 00:19:50.743 "trtype": "$TEST_TRANSPORT", 00:19:50.743 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:50.743 "adrfam": "ipv4", 00:19:50.743 "trsvcid": "$NVMF_PORT", 00:19:50.743 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:50.743 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:50.743 "hdgst": ${hdgst:-false}, 00:19:50.743 "ddgst": ${ddgst:-false} 00:19:50.743 }, 00:19:50.743 "method": "bdev_nvme_attach_controller" 00:19:50.743 } 00:19:50.743 EOF 00:19:50.743 )") 00:19:50.743 05:15:52 -- nvmf/common.sh@542 -- # cat 00:19:50.743 05:15:52 -- nvmf/common.sh@544 -- # jq . 00:19:50.743 05:15:52 -- nvmf/common.sh@545 -- # IFS=, 00:19:50.743 05:15:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:50.743 "params": { 00:19:50.743 "name": "Nvme1", 00:19:50.744 "trtype": "tcp", 00:19:50.744 "traddr": "10.0.0.2", 00:19:50.744 "adrfam": "ipv4", 00:19:50.744 "trsvcid": "4420", 00:19:50.744 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:50.744 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:50.744 "hdgst": false, 00:19:50.744 "ddgst": false 00:19:50.744 }, 00:19:50.744 "method": "bdev_nvme_attach_controller" 00:19:50.744 }' 00:19:50.744 [2024-11-26 05:15:52.441099] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:50.744 [2024-11-26 05:15:52.441191] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid3320377 ] 00:19:50.744 [2024-11-26 05:15:52.503360] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:51.002 [2024-11-26 05:15:52.590428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:51.002 [2024-11-26 05:15:52.590479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:51.002 [2024-11-26 05:15:52.590482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:51.263 [2024-11-26 05:15:52.785723] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:51.263 [2024-11-26 05:15:52.785779] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:51.263 I/O targets: 00:19:51.263 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:51.263 00:19:51.263 00:19:51.263 CUnit - A unit testing framework for C - Version 2.1-3 00:19:51.263 http://cunit.sourceforge.net/ 00:19:51.263 00:19:51.263 00:19:51.263 Suite: bdevio tests on: Nvme1n1 00:19:51.263 Test: blockdev write read block ...passed 00:19:51.263 Test: blockdev write zeroes read block ...passed 00:19:51.263 Test: blockdev write zeroes read no split ...passed 00:19:51.263 Test: blockdev write zeroes read split ...passed 00:19:51.263 Test: blockdev write zeroes read split partial ...passed 00:19:51.263 Test: blockdev reset ...[2024-11-26 05:15:52.952040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:51.263 [2024-11-26 05:15:52.952154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c35150 (9): Bad file descriptor 00:19:51.263 [2024-11-26 05:15:52.965054] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:51.263 passed 00:19:51.263 Test: blockdev write read 8 blocks ...passed 00:19:51.263 Test: blockdev write read size > 128k ...passed 00:19:51.263 Test: blockdev write read invalid size ...passed 00:19:51.263 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:51.263 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:51.263 Test: blockdev write read max offset ...passed 00:19:51.524 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:51.524 Test: blockdev writev readv 8 blocks ...passed 00:19:51.524 Test: blockdev writev readv 30 x 1block ...passed 00:19:51.524 Test: blockdev writev readv block ...passed 00:19:51.524 Test: blockdev writev readv size > 128k ...passed 00:19:51.524 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:51.524 Test: blockdev comparev and writev ...[2024-11-26 05:15:53.138081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:51.524 [2024-11-26 05:15:53.138120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:51.524 [2024-11-26 05:15:53.138144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:51.524 [2024-11-26 05:15:53.138162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:51.524 [2024-11-26 05:15:53.138538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:51.524 [2024-11-26 05:15:53.138563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:51.524 [2024-11-26 05:15:53.138585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:51.524 [2024-11-26 05:15:53.138602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:51.524 [2024-11-26 05:15:53.138969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:51.524 [2024-11-26 05:15:53.138995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:51.524 [2024-11-26 05:15:53.139017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:51.524 [2024-11-26 05:15:53.139040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:51.524 [2024-11-26 05:15:53.139415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:51.524 [2024-11-26 05:15:53.139440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:51.524 [2024-11-26 05:15:53.139462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:51.524 [2024-11-26 05:15:53.139478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:51.524 passed 00:19:51.524 Test: blockdev nvme passthru rw ...passed 00:19:51.524 Test: blockdev nvme passthru vendor specific ...[2024-11-26 05:15:53.222972] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:51.524 [2024-11-26 05:15:53.223000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:51.524 [2024-11-26 05:15:53.223154] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:51.524 [2024-11-26 05:15:53.223177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:51.524 [2024-11-26 05:15:53.223322] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:51.524 [2024-11-26 05:15:53.223344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:51.524 [2024-11-26 05:15:53.223493] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:51.524 [2024-11-26 05:15:53.223515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:51.524 passed 00:19:51.524 Test: blockdev nvme admin passthru ...passed 00:19:51.524 Test: blockdev copy ...passed 00:19:51.524 00:19:51.524 Run Summary: Type Total Ran Passed Failed Inactive 00:19:51.524 suites 1 1 n/a 0 0 00:19:51.524 tests 23 23 23 0 0 00:19:51.524 asserts 152 152 152 0 n/a 00:19:51.524 00:19:51.524 Elapsed time = 0.994 seconds 00:19:52.091 05:15:53 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:52.091 05:15:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.091 05:15:53 -- common/autotest_common.sh@10 -- # set +x 00:19:52.091 05:15:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.091 05:15:53 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:52.091 05:15:53 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:52.091 05:15:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:52.091 05:15:53 -- nvmf/common.sh@116 -- # sync 00:19:52.091 05:15:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:52.091 05:15:53 -- nvmf/common.sh@119 -- # set +e 00:19:52.091 05:15:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:52.091 05:15:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:52.091 rmmod nvme_tcp 00:19:52.091 rmmod nvme_fabrics 00:19:52.091 rmmod nvme_keyring 00:19:52.091 05:15:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:52.091 05:15:53 -- nvmf/common.sh@123 -- # set -e 00:19:52.091 05:15:53 -- nvmf/common.sh@124 -- # return 0 00:19:52.091 05:15:53 -- nvmf/common.sh@477 -- # '[' -n 3320352 ']' 00:19:52.091 05:15:53 -- nvmf/common.sh@478 -- # killprocess 3320352 00:19:52.091 05:15:53 -- common/autotest_common.sh@936 -- # '[' -z 3320352 ']' 00:19:52.091 05:15:53 -- common/autotest_common.sh@940 -- # kill -0 3320352 00:19:52.091 05:15:53 -- common/autotest_common.sh@941 -- # uname 00:19:52.091 05:15:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:52.091 05:15:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3320352 00:19:52.091 05:15:53 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:52.091 05:15:53 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:52.091 05:15:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3320352' 00:19:52.091 killing process with pid 3320352 00:19:52.091 05:15:53 -- common/autotest_common.sh@955 -- # kill 3320352 00:19:52.091 05:15:53 -- common/autotest_common.sh@960 -- # wait 3320352 00:19:52.350 05:15:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:52.350 05:15:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:52.350 05:15:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:52.350 05:15:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:52.350 05:15:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:52.350 05:15:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:52.350 05:15:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:52.350 05:15:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:54.891 05:15:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:54.891 00:19:54.891 real 0m6.400s 00:19:54.891 user 0m9.727s 00:19:54.891 sys 0m2.533s 00:19:54.891 05:15:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:54.891 05:15:56 -- common/autotest_common.sh@10 -- # set +x 00:19:54.891 ************************************ 00:19:54.891 END TEST nvmf_bdevio_no_huge 00:19:54.891 ************************************ 00:19:54.891 05:15:56 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:54.891 05:15:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:54.891 05:15:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:54.891 05:15:56 -- common/autotest_common.sh@10 -- # set +x 00:19:54.891 ************************************ 00:19:54.891 START TEST nvmf_tls 00:19:54.891 ************************************ 00:19:54.891 05:15:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:54.891 * Looking for test storage... 00:19:54.891 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:54.891 05:15:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:54.891 05:15:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:54.891 05:15:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:54.891 05:15:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:54.891 05:15:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:54.891 05:15:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:54.891 05:15:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:54.891 05:15:56 -- scripts/common.sh@335 -- # IFS=.-: 00:19:54.891 05:15:56 -- scripts/common.sh@335 -- # read -ra ver1 00:19:54.891 05:15:56 -- scripts/common.sh@336 -- # IFS=.-: 00:19:54.891 05:15:56 -- scripts/common.sh@336 -- # read -ra ver2 00:19:54.891 05:15:56 -- scripts/common.sh@337 -- # local 'op=<' 00:19:54.891 05:15:56 -- scripts/common.sh@339 -- # ver1_l=2 00:19:54.891 05:15:56 -- scripts/common.sh@340 -- # ver2_l=1 00:19:54.892 05:15:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:54.892 05:15:56 -- scripts/common.sh@343 -- # case "$op" in 00:19:54.892 05:15:56 -- scripts/common.sh@344 -- # : 1 00:19:54.892 05:15:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:54.892 05:15:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:54.892 05:15:56 -- scripts/common.sh@364 -- # decimal 1 00:19:54.892 05:15:56 -- scripts/common.sh@352 -- # local d=1 00:19:54.892 05:15:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:54.892 05:15:56 -- scripts/common.sh@354 -- # echo 1 00:19:54.892 05:15:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:54.892 05:15:56 -- scripts/common.sh@365 -- # decimal 2 00:19:54.892 05:15:56 -- scripts/common.sh@352 -- # local d=2 00:19:54.892 05:15:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:54.892 05:15:56 -- scripts/common.sh@354 -- # echo 2 00:19:54.892 05:15:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:54.892 05:15:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:54.892 05:15:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:54.892 05:15:56 -- scripts/common.sh@367 -- # return 0 00:19:54.892 05:15:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:54.892 05:15:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:54.892 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:54.892 --rc genhtml_branch_coverage=1 00:19:54.892 --rc genhtml_function_coverage=1 00:19:54.892 --rc genhtml_legend=1 00:19:54.892 --rc geninfo_all_blocks=1 00:19:54.892 --rc geninfo_unexecuted_blocks=1 00:19:54.892 00:19:54.892 ' 00:19:54.892 05:15:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:54.892 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:54.892 --rc genhtml_branch_coverage=1 00:19:54.892 --rc genhtml_function_coverage=1 00:19:54.892 --rc genhtml_legend=1 00:19:54.892 --rc geninfo_all_blocks=1 00:19:54.892 --rc geninfo_unexecuted_blocks=1 00:19:54.892 00:19:54.892 ' 00:19:54.892 05:15:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:54.892 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:54.892 --rc genhtml_branch_coverage=1 00:19:54.892 --rc genhtml_function_coverage=1 00:19:54.892 --rc genhtml_legend=1 00:19:54.892 --rc geninfo_all_blocks=1 00:19:54.892 --rc geninfo_unexecuted_blocks=1 00:19:54.892 00:19:54.892 ' 00:19:54.892 05:15:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:54.892 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:54.892 --rc genhtml_branch_coverage=1 00:19:54.892 --rc genhtml_function_coverage=1 00:19:54.892 --rc genhtml_legend=1 00:19:54.892 --rc geninfo_all_blocks=1 00:19:54.892 --rc geninfo_unexecuted_blocks=1 00:19:54.892 00:19:54.892 ' 00:19:54.892 05:15:56 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:54.892 05:15:56 -- nvmf/common.sh@7 -- # uname -s 00:19:54.892 05:15:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:54.892 05:15:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:54.892 05:15:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:54.892 05:15:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:54.892 05:15:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:54.892 05:15:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:54.892 05:15:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:54.892 05:15:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:54.892 05:15:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:54.892 05:15:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:54.892 05:15:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:54.892 05:15:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:54.892 05:15:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:54.892 05:15:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:54.892 05:15:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:54.892 05:15:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:54.892 05:15:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:54.892 05:15:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:54.892 05:15:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:54.892 05:15:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:54.892 05:15:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:54.892 05:15:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:54.892 05:15:56 -- paths/export.sh@5 -- # export PATH 00:19:54.892 05:15:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:54.892 05:15:56 -- nvmf/common.sh@46 -- # : 0 00:19:54.892 05:15:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:54.892 05:15:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:54.892 05:15:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:54.892 05:15:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:54.892 05:15:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:54.892 05:15:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:54.892 05:15:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:54.892 05:15:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:54.892 05:15:56 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:54.892 05:15:56 -- target/tls.sh@71 -- # nvmftestinit 00:19:54.892 05:15:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:54.892 05:15:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:54.892 05:15:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:54.892 05:15:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:54.892 05:15:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:54.892 05:15:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:54.892 05:15:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:54.892 05:15:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:54.892 05:15:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:54.892 05:15:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:54.892 05:15:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:54.892 05:15:56 -- common/autotest_common.sh@10 -- # set +x 00:19:56.799 05:15:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:56.799 05:15:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:56.799 05:15:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:56.799 05:15:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:56.799 05:15:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:56.799 05:15:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:56.799 05:15:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:56.800 05:15:58 -- nvmf/common.sh@294 -- # net_devs=() 00:19:56.800 05:15:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:56.800 05:15:58 -- nvmf/common.sh@295 -- # e810=() 00:19:56.800 05:15:58 -- nvmf/common.sh@295 -- # local -ga e810 00:19:56.800 05:15:58 -- nvmf/common.sh@296 -- # x722=() 00:19:56.800 05:15:58 -- nvmf/common.sh@296 -- # local -ga x722 00:19:56.800 05:15:58 -- nvmf/common.sh@297 -- # mlx=() 00:19:56.800 05:15:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:56.800 05:15:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:56.800 05:15:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:56.800 05:15:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:56.800 05:15:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:56.800 05:15:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:56.800 05:15:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:56.800 05:15:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:56.800 05:15:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:56.800 05:15:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:56.800 05:15:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:56.800 05:15:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:56.800 05:15:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:56.800 05:15:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:56.800 05:15:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:56.800 05:15:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:56.800 05:15:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:56.800 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:56.800 05:15:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:56.800 05:15:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:56.800 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:56.800 05:15:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:56.800 05:15:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:56.800 05:15:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:56.800 05:15:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:56.800 05:15:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:56.800 05:15:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:56.800 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:56.800 05:15:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:56.800 05:15:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:56.800 05:15:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:56.800 05:15:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:56.800 05:15:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:56.800 05:15:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:56.800 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:56.800 05:15:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:56.800 05:15:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:56.800 05:15:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:56.800 05:15:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:56.800 05:15:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:56.800 05:15:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:56.800 05:15:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:56.800 05:15:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:56.800 05:15:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:56.800 05:15:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:56.800 05:15:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:56.800 05:15:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:56.800 05:15:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:56.800 05:15:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:56.800 05:15:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:56.800 05:15:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:56.800 05:15:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:56.800 05:15:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:56.800 05:15:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:56.800 05:15:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:56.800 05:15:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:56.800 05:15:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:57.059 05:15:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:57.059 05:15:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:57.059 05:15:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:57.059 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:57.059 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:19:57.059 00:19:57.059 --- 10.0.0.2 ping statistics --- 00:19:57.059 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:57.059 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:19:57.059 05:15:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:57.059 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:57.059 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:19:57.059 00:19:57.059 --- 10.0.0.1 ping statistics --- 00:19:57.059 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:57.059 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:19:57.059 05:15:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:57.059 05:15:58 -- nvmf/common.sh@410 -- # return 0 00:19:57.059 05:15:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:57.059 05:15:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:57.059 05:15:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:57.059 05:15:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:57.059 05:15:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:57.059 05:15:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:57.059 05:15:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:57.059 05:15:58 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:19:57.059 05:15:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:57.059 05:15:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:57.059 05:15:58 -- common/autotest_common.sh@10 -- # set +x 00:19:57.059 05:15:58 -- nvmf/common.sh@469 -- # nvmfpid=3322591 00:19:57.059 05:15:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:19:57.059 05:15:58 -- nvmf/common.sh@470 -- # waitforlisten 3322591 00:19:57.059 05:15:58 -- common/autotest_common.sh@829 -- # '[' -z 3322591 ']' 00:19:57.059 05:15:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:57.059 05:15:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:57.059 05:15:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:57.059 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:57.059 05:15:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:57.059 05:15:58 -- common/autotest_common.sh@10 -- # set +x 00:19:57.059 [2024-11-26 05:15:58.647856] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:57.059 [2024-11-26 05:15:58.647949] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:57.059 EAL: No free 2048 kB hugepages reported on node 1 00:19:57.059 [2024-11-26 05:15:58.717200] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:57.059 [2024-11-26 05:15:58.799225] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:57.059 [2024-11-26 05:15:58.799387] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:57.059 [2024-11-26 05:15:58.799412] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:57.059 [2024-11-26 05:15:58.799431] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:57.059 [2024-11-26 05:15:58.799467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:57.318 05:15:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:57.318 05:15:58 -- common/autotest_common.sh@862 -- # return 0 00:19:57.318 05:15:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:57.318 05:15:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:57.318 05:15:58 -- common/autotest_common.sh@10 -- # set +x 00:19:57.318 05:15:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:57.318 05:15:58 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:19:57.318 05:15:58 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:19:57.575 true 00:19:57.575 05:15:59 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:57.575 05:15:59 -- target/tls.sh@82 -- # jq -r .tls_version 00:19:57.831 05:15:59 -- target/tls.sh@82 -- # version=0 00:19:57.831 05:15:59 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:19:57.831 05:15:59 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:58.089 05:15:59 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:58.089 05:15:59 -- target/tls.sh@90 -- # jq -r .tls_version 00:19:58.347 05:15:59 -- target/tls.sh@90 -- # version=13 00:19:58.347 05:15:59 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:19:58.347 05:15:59 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:19:58.604 05:16:00 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:58.604 05:16:00 -- target/tls.sh@98 -- # jq -r .tls_version 00:19:58.863 05:16:00 -- target/tls.sh@98 -- # version=7 00:19:58.863 05:16:00 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:19:58.863 05:16:00 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:58.863 05:16:00 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:19:59.121 05:16:00 -- target/tls.sh@105 -- # ktls=false 00:19:59.122 05:16:00 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:19:59.122 05:16:00 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:19:59.380 05:16:01 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:59.380 05:16:01 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:19:59.638 05:16:01 -- target/tls.sh@113 -- # ktls=true 00:19:59.638 05:16:01 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:19:59.638 05:16:01 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:19:59.896 05:16:01 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:59.896 05:16:01 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:20:00.461 05:16:01 -- target/tls.sh@121 -- # ktls=false 00:20:00.461 05:16:01 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:20:00.461 05:16:01 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:20:00.461 05:16:01 -- target/tls.sh@49 -- # local key hash crc 00:20:00.461 05:16:01 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:20:00.461 05:16:01 -- target/tls.sh@51 -- # hash=01 00:20:00.461 05:16:01 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:20:00.461 05:16:01 -- target/tls.sh@52 -- # gzip -1 -c 00:20:00.461 05:16:01 -- target/tls.sh@52 -- # tail -c8 00:20:00.461 05:16:01 -- target/tls.sh@52 -- # head -c 4 00:20:00.461 05:16:01 -- target/tls.sh@52 -- # crc='p$H�' 00:20:00.461 05:16:01 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:00.461 05:16:01 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:20:00.461 05:16:01 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:00.461 05:16:01 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:00.461 05:16:01 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:20:00.461 05:16:01 -- target/tls.sh@49 -- # local key hash crc 00:20:00.461 05:16:01 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:20:00.461 05:16:01 -- target/tls.sh@51 -- # hash=01 00:20:00.461 05:16:01 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:20:00.461 05:16:01 -- target/tls.sh@52 -- # gzip -1 -c 00:20:00.461 05:16:01 -- target/tls.sh@52 -- # tail -c8 00:20:00.461 05:16:01 -- target/tls.sh@52 -- # head -c 4 00:20:00.461 05:16:01 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:20:00.461 05:16:01 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:00.461 05:16:01 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:20:00.461 05:16:01 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:00.461 05:16:01 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:00.461 05:16:01 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:00.461 05:16:01 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:00.461 05:16:01 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:00.461 05:16:01 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:00.461 05:16:01 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:00.461 05:16:01 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:00.461 05:16:01 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:00.720 05:16:02 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:20:01.017 05:16:02 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:01.017 05:16:02 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:01.017 05:16:02 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:01.301 [2024-11-26 05:16:02.842231] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:01.301 05:16:02 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:01.559 05:16:03 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:01.818 [2024-11-26 05:16:03.339600] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:01.818 [2024-11-26 05:16:03.339937] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:01.818 05:16:03 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:02.076 malloc0 00:20:02.076 05:16:03 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:02.335 05:16:03 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:02.592 05:16:04 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:02.592 EAL: No free 2048 kB hugepages reported on node 1 00:20:12.556 Initializing NVMe Controllers 00:20:12.556 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:12.556 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:12.556 Initialization complete. Launching workers. 00:20:12.556 ======================================================== 00:20:12.556 Latency(us) 00:20:12.556 Device Information : IOPS MiB/s Average min max 00:20:12.556 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7777.39 30.38 8231.59 1263.36 9376.70 00:20:12.556 ======================================================== 00:20:12.556 Total : 7777.39 30.38 8231.59 1263.36 9376.70 00:20:12.556 00:20:12.556 05:16:14 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:12.556 05:16:14 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:12.556 05:16:14 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:12.556 05:16:14 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:12.556 05:16:14 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:12.556 05:16:14 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:12.556 05:16:14 -- target/tls.sh@28 -- # bdevperf_pid=3324438 00:20:12.556 05:16:14 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:12.556 05:16:14 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:12.556 05:16:14 -- target/tls.sh@31 -- # waitforlisten 3324438 /var/tmp/bdevperf.sock 00:20:12.556 05:16:14 -- common/autotest_common.sh@829 -- # '[' -z 3324438 ']' 00:20:12.556 05:16:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:12.556 05:16:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:12.556 05:16:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:12.556 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:12.556 05:16:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:12.556 05:16:14 -- common/autotest_common.sh@10 -- # set +x 00:20:12.556 [2024-11-26 05:16:14.265831] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:12.556 [2024-11-26 05:16:14.265906] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3324438 ] 00:20:12.556 EAL: No free 2048 kB hugepages reported on node 1 00:20:12.815 [2024-11-26 05:16:14.329716] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:12.815 [2024-11-26 05:16:14.415220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:13.748 05:16:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:13.748 05:16:15 -- common/autotest_common.sh@862 -- # return 0 00:20:13.748 05:16:15 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:14.007 [2024-11-26 05:16:15.547941] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:14.007 TLSTESTn1 00:20:14.007 05:16:15 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:14.007 Running I/O for 10 seconds... 00:20:26.207 00:20:26.207 Latency(us) 00:20:26.207 [2024-11-26T04:16:27.975Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:26.207 [2024-11-26T04:16:27.975Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:26.207 Verification LBA range: start 0x0 length 0x2000 00:20:26.207 TLSTESTn1 : 10.02 3060.85 11.96 0.00 0.00 41756.33 5655.51 49127.73 00:20:26.207 [2024-11-26T04:16:27.975Z] =================================================================================================================== 00:20:26.207 [2024-11-26T04:16:27.975Z] Total : 3060.85 11.96 0.00 0.00 41756.33 5655.51 49127.73 00:20:26.207 0 00:20:26.207 05:16:25 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:26.207 05:16:25 -- target/tls.sh@45 -- # killprocess 3324438 00:20:26.207 05:16:25 -- common/autotest_common.sh@936 -- # '[' -z 3324438 ']' 00:20:26.207 05:16:25 -- common/autotest_common.sh@940 -- # kill -0 3324438 00:20:26.207 05:16:25 -- common/autotest_common.sh@941 -- # uname 00:20:26.207 05:16:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:26.207 05:16:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3324438 00:20:26.207 05:16:25 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:26.207 05:16:25 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:26.207 05:16:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3324438' 00:20:26.207 killing process with pid 3324438 00:20:26.207 05:16:25 -- common/autotest_common.sh@955 -- # kill 3324438 00:20:26.207 Received shutdown signal, test time was about 10.000000 seconds 00:20:26.207 00:20:26.207 Latency(us) 00:20:26.207 [2024-11-26T04:16:27.975Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:26.207 [2024-11-26T04:16:27.975Z] =================================================================================================================== 00:20:26.207 [2024-11-26T04:16:27.975Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:26.207 05:16:25 -- common/autotest_common.sh@960 -- # wait 3324438 00:20:26.207 05:16:26 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:26.207 05:16:26 -- common/autotest_common.sh@650 -- # local es=0 00:20:26.207 05:16:26 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:26.207 05:16:26 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:26.207 05:16:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:26.207 05:16:26 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:26.207 05:16:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:26.207 05:16:26 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:26.207 05:16:26 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:26.207 05:16:26 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:26.207 05:16:26 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:26.207 05:16:26 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:26.207 05:16:26 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:26.207 05:16:26 -- target/tls.sh@28 -- # bdevperf_pid=3325929 00:20:26.207 05:16:26 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:26.207 05:16:26 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:26.207 05:16:26 -- target/tls.sh@31 -- # waitforlisten 3325929 /var/tmp/bdevperf.sock 00:20:26.207 05:16:26 -- common/autotest_common.sh@829 -- # '[' -z 3325929 ']' 00:20:26.207 05:16:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:26.207 05:16:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:26.207 05:16:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:26.207 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:26.207 05:16:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:26.208 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:20:26.208 [2024-11-26 05:16:26.083051] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:26.208 [2024-11-26 05:16:26.083153] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3325929 ] 00:20:26.208 EAL: No free 2048 kB hugepages reported on node 1 00:20:26.208 [2024-11-26 05:16:26.142990] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:26.208 [2024-11-26 05:16:26.229364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:26.208 05:16:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:26.208 05:16:27 -- common/autotest_common.sh@862 -- # return 0 00:20:26.208 05:16:27 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:26.208 [2024-11-26 05:16:27.354292] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:26.208 [2024-11-26 05:16:27.366132] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:26.208 [2024-11-26 05:16:27.366166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78cf0 (107): Transport endpoint is not connected 00:20:26.208 [2024-11-26 05:16:27.367129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78cf0 (9): Bad file descriptor 00:20:26.208 [2024-11-26 05:16:27.368129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:26.208 [2024-11-26 05:16:27.368156] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:26.208 [2024-11-26 05:16:27.368180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:26.208 request: 00:20:26.208 { 00:20:26.208 "name": "TLSTEST", 00:20:26.208 "trtype": "tcp", 00:20:26.208 "traddr": "10.0.0.2", 00:20:26.208 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:26.208 "adrfam": "ipv4", 00:20:26.208 "trsvcid": "4420", 00:20:26.208 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:26.208 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:26.208 "method": "bdev_nvme_attach_controller", 00:20:26.208 "req_id": 1 00:20:26.208 } 00:20:26.208 Got JSON-RPC error response 00:20:26.208 response: 00:20:26.208 { 00:20:26.208 "code": -32602, 00:20:26.208 "message": "Invalid parameters" 00:20:26.208 } 00:20:26.208 05:16:27 -- target/tls.sh@36 -- # killprocess 3325929 00:20:26.208 05:16:27 -- common/autotest_common.sh@936 -- # '[' -z 3325929 ']' 00:20:26.208 05:16:27 -- common/autotest_common.sh@940 -- # kill -0 3325929 00:20:26.208 05:16:27 -- common/autotest_common.sh@941 -- # uname 00:20:26.208 05:16:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:26.208 05:16:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3325929 00:20:26.208 05:16:27 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:26.208 05:16:27 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:26.208 05:16:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3325929' 00:20:26.208 killing process with pid 3325929 00:20:26.208 05:16:27 -- common/autotest_common.sh@955 -- # kill 3325929 00:20:26.208 Received shutdown signal, test time was about 10.000000 seconds 00:20:26.208 00:20:26.208 Latency(us) 00:20:26.208 [2024-11-26T04:16:27.976Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:26.208 [2024-11-26T04:16:27.976Z] =================================================================================================================== 00:20:26.208 [2024-11-26T04:16:27.976Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:26.208 05:16:27 -- common/autotest_common.sh@960 -- # wait 3325929 00:20:26.208 05:16:27 -- target/tls.sh@37 -- # return 1 00:20:26.208 05:16:27 -- common/autotest_common.sh@653 -- # es=1 00:20:26.208 05:16:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:26.208 05:16:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:26.208 05:16:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:26.208 05:16:27 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:26.208 05:16:27 -- common/autotest_common.sh@650 -- # local es=0 00:20:26.208 05:16:27 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:26.208 05:16:27 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:26.208 05:16:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:26.208 05:16:27 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:26.208 05:16:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:26.208 05:16:27 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:26.208 05:16:27 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:26.208 05:16:27 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:26.208 05:16:27 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:26.208 05:16:27 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:26.208 05:16:27 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:26.208 05:16:27 -- target/tls.sh@28 -- # bdevperf_pid=3326079 00:20:26.208 05:16:27 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:26.208 05:16:27 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:26.208 05:16:27 -- target/tls.sh@31 -- # waitforlisten 3326079 /var/tmp/bdevperf.sock 00:20:26.208 05:16:27 -- common/autotest_common.sh@829 -- # '[' -z 3326079 ']' 00:20:26.208 05:16:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:26.208 05:16:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:26.208 05:16:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:26.208 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:26.208 05:16:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:26.208 05:16:27 -- common/autotest_common.sh@10 -- # set +x 00:20:26.208 [2024-11-26 05:16:27.648378] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:26.208 [2024-11-26 05:16:27.648464] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326079 ] 00:20:26.208 EAL: No free 2048 kB hugepages reported on node 1 00:20:26.208 [2024-11-26 05:16:27.708107] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:26.208 [2024-11-26 05:16:27.795079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:27.143 05:16:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:27.143 05:16:28 -- common/autotest_common.sh@862 -- # return 0 00:20:27.143 05:16:28 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:27.401 [2024-11-26 05:16:28.909429] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:27.401 [2024-11-26 05:16:28.920107] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:27.401 [2024-11-26 05:16:28.920139] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:27.401 [2024-11-26 05:16:28.920194] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:27.401 [2024-11-26 05:16:28.920365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f7acf0 (107): Transport endpoint is not connected 00:20:27.401 [2024-11-26 05:16:28.921354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f7acf0 (9): Bad file descriptor 00:20:27.401 [2024-11-26 05:16:28.922354] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:27.401 [2024-11-26 05:16:28.922390] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:27.401 [2024-11-26 05:16:28.922404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:27.401 request: 00:20:27.401 { 00:20:27.401 "name": "TLSTEST", 00:20:27.401 "trtype": "tcp", 00:20:27.401 "traddr": "10.0.0.2", 00:20:27.401 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:27.401 "adrfam": "ipv4", 00:20:27.401 "trsvcid": "4420", 00:20:27.401 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:27.401 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:27.401 "method": "bdev_nvme_attach_controller", 00:20:27.401 "req_id": 1 00:20:27.401 } 00:20:27.401 Got JSON-RPC error response 00:20:27.401 response: 00:20:27.401 { 00:20:27.401 "code": -32602, 00:20:27.401 "message": "Invalid parameters" 00:20:27.401 } 00:20:27.401 05:16:28 -- target/tls.sh@36 -- # killprocess 3326079 00:20:27.401 05:16:28 -- common/autotest_common.sh@936 -- # '[' -z 3326079 ']' 00:20:27.401 05:16:28 -- common/autotest_common.sh@940 -- # kill -0 3326079 00:20:27.401 05:16:28 -- common/autotest_common.sh@941 -- # uname 00:20:27.401 05:16:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:27.401 05:16:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3326079 00:20:27.401 05:16:28 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:27.401 05:16:28 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:27.401 05:16:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3326079' 00:20:27.401 killing process with pid 3326079 00:20:27.401 05:16:28 -- common/autotest_common.sh@955 -- # kill 3326079 00:20:27.401 Received shutdown signal, test time was about 10.000000 seconds 00:20:27.401 00:20:27.401 Latency(us) 00:20:27.401 [2024-11-26T04:16:29.169Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:27.401 [2024-11-26T04:16:29.169Z] =================================================================================================================== 00:20:27.401 [2024-11-26T04:16:29.169Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:27.401 05:16:28 -- common/autotest_common.sh@960 -- # wait 3326079 00:20:27.659 05:16:29 -- target/tls.sh@37 -- # return 1 00:20:27.659 05:16:29 -- common/autotest_common.sh@653 -- # es=1 00:20:27.659 05:16:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:27.659 05:16:29 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:27.660 05:16:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:27.660 05:16:29 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:27.660 05:16:29 -- common/autotest_common.sh@650 -- # local es=0 00:20:27.660 05:16:29 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:27.660 05:16:29 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:27.660 05:16:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:27.660 05:16:29 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:27.660 05:16:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:27.660 05:16:29 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:27.660 05:16:29 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:27.660 05:16:29 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:27.660 05:16:29 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:27.660 05:16:29 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:27.660 05:16:29 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:27.660 05:16:29 -- target/tls.sh@28 -- # bdevperf_pid=3326352 00:20:27.660 05:16:29 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:27.660 05:16:29 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:27.660 05:16:29 -- target/tls.sh@31 -- # waitforlisten 3326352 /var/tmp/bdevperf.sock 00:20:27.660 05:16:29 -- common/autotest_common.sh@829 -- # '[' -z 3326352 ']' 00:20:27.660 05:16:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:27.660 05:16:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:27.660 05:16:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:27.660 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:27.660 05:16:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:27.660 05:16:29 -- common/autotest_common.sh@10 -- # set +x 00:20:27.660 [2024-11-26 05:16:29.242170] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:27.660 [2024-11-26 05:16:29.242258] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326352 ] 00:20:27.660 EAL: No free 2048 kB hugepages reported on node 1 00:20:27.660 [2024-11-26 05:16:29.301356] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:27.660 [2024-11-26 05:16:29.383784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:28.594 05:16:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:28.594 05:16:30 -- common/autotest_common.sh@862 -- # return 0 00:20:28.594 05:16:30 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:28.853 [2024-11-26 05:16:30.492199] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:28.853 [2024-11-26 05:16:30.497303] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:28.853 [2024-11-26 05:16:30.497336] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:28.853 [2024-11-26 05:16:30.497378] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:28.853 [2024-11-26 05:16:30.497902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23decf0 (107): Transport endpoint is not connected 00:20:28.853 [2024-11-26 05:16:30.498889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23decf0 (9): Bad file descriptor 00:20:28.853 [2024-11-26 05:16:30.499887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:28.853 [2024-11-26 05:16:30.499908] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:28.853 [2024-11-26 05:16:30.499922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:28.853 request: 00:20:28.853 { 00:20:28.853 "name": "TLSTEST", 00:20:28.853 "trtype": "tcp", 00:20:28.853 "traddr": "10.0.0.2", 00:20:28.853 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:28.853 "adrfam": "ipv4", 00:20:28.853 "trsvcid": "4420", 00:20:28.853 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:28.853 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:28.853 "method": "bdev_nvme_attach_controller", 00:20:28.853 "req_id": 1 00:20:28.853 } 00:20:28.853 Got JSON-RPC error response 00:20:28.853 response: 00:20:28.853 { 00:20:28.853 "code": -32602, 00:20:28.853 "message": "Invalid parameters" 00:20:28.853 } 00:20:28.853 05:16:30 -- target/tls.sh@36 -- # killprocess 3326352 00:20:28.853 05:16:30 -- common/autotest_common.sh@936 -- # '[' -z 3326352 ']' 00:20:28.853 05:16:30 -- common/autotest_common.sh@940 -- # kill -0 3326352 00:20:28.853 05:16:30 -- common/autotest_common.sh@941 -- # uname 00:20:28.853 05:16:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:28.853 05:16:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3326352 00:20:28.853 05:16:30 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:28.853 05:16:30 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:28.853 05:16:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3326352' 00:20:28.853 killing process with pid 3326352 00:20:28.853 05:16:30 -- common/autotest_common.sh@955 -- # kill 3326352 00:20:28.853 Received shutdown signal, test time was about 10.000000 seconds 00:20:28.853 00:20:28.853 Latency(us) 00:20:28.853 [2024-11-26T04:16:30.621Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:28.853 [2024-11-26T04:16:30.621Z] =================================================================================================================== 00:20:28.853 [2024-11-26T04:16:30.621Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:28.853 05:16:30 -- common/autotest_common.sh@960 -- # wait 3326352 00:20:29.111 05:16:30 -- target/tls.sh@37 -- # return 1 00:20:29.111 05:16:30 -- common/autotest_common.sh@653 -- # es=1 00:20:29.111 05:16:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:29.111 05:16:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:29.111 05:16:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:29.111 05:16:30 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:29.111 05:16:30 -- common/autotest_common.sh@650 -- # local es=0 00:20:29.111 05:16:30 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:29.111 05:16:30 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:29.111 05:16:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:29.111 05:16:30 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:29.111 05:16:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:29.111 05:16:30 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:29.111 05:16:30 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:29.111 05:16:30 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:29.111 05:16:30 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:29.111 05:16:30 -- target/tls.sh@23 -- # psk= 00:20:29.111 05:16:30 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:29.111 05:16:30 -- target/tls.sh@28 -- # bdevperf_pid=3326504 00:20:29.111 05:16:30 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:29.111 05:16:30 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:29.111 05:16:30 -- target/tls.sh@31 -- # waitforlisten 3326504 /var/tmp/bdevperf.sock 00:20:29.111 05:16:30 -- common/autotest_common.sh@829 -- # '[' -z 3326504 ']' 00:20:29.111 05:16:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:29.111 05:16:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:29.111 05:16:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:29.111 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:29.111 05:16:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:29.111 05:16:30 -- common/autotest_common.sh@10 -- # set +x 00:20:29.111 [2024-11-26 05:16:30.821274] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:29.111 [2024-11-26 05:16:30.821346] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326504 ] 00:20:29.111 EAL: No free 2048 kB hugepages reported on node 1 00:20:29.370 [2024-11-26 05:16:30.880850] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:29.370 [2024-11-26 05:16:30.963555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:30.303 05:16:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:30.303 05:16:31 -- common/autotest_common.sh@862 -- # return 0 00:20:30.303 05:16:31 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:30.304 [2024-11-26 05:16:32.019496] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:30.304 [2024-11-26 05:16:32.021367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21d4720 (9): Bad file descriptor 00:20:30.304 [2024-11-26 05:16:32.022362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:30.304 [2024-11-26 05:16:32.022381] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:30.304 [2024-11-26 05:16:32.022410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:30.304 request: 00:20:30.304 { 00:20:30.304 "name": "TLSTEST", 00:20:30.304 "trtype": "tcp", 00:20:30.304 "traddr": "10.0.0.2", 00:20:30.304 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:30.304 "adrfam": "ipv4", 00:20:30.304 "trsvcid": "4420", 00:20:30.304 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:30.304 "method": "bdev_nvme_attach_controller", 00:20:30.304 "req_id": 1 00:20:30.304 } 00:20:30.304 Got JSON-RPC error response 00:20:30.304 response: 00:20:30.304 { 00:20:30.304 "code": -32602, 00:20:30.304 "message": "Invalid parameters" 00:20:30.304 } 00:20:30.304 05:16:32 -- target/tls.sh@36 -- # killprocess 3326504 00:20:30.304 05:16:32 -- common/autotest_common.sh@936 -- # '[' -z 3326504 ']' 00:20:30.304 05:16:32 -- common/autotest_common.sh@940 -- # kill -0 3326504 00:20:30.304 05:16:32 -- common/autotest_common.sh@941 -- # uname 00:20:30.304 05:16:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:30.304 05:16:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3326504 00:20:30.562 05:16:32 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:30.562 05:16:32 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:30.562 05:16:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3326504' 00:20:30.562 killing process with pid 3326504 00:20:30.562 05:16:32 -- common/autotest_common.sh@955 -- # kill 3326504 00:20:30.562 Received shutdown signal, test time was about 10.000000 seconds 00:20:30.562 00:20:30.562 Latency(us) 00:20:30.562 [2024-11-26T04:16:32.330Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:30.562 [2024-11-26T04:16:32.330Z] =================================================================================================================== 00:20:30.562 [2024-11-26T04:16:32.330Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:30.562 05:16:32 -- common/autotest_common.sh@960 -- # wait 3326504 00:20:30.562 05:16:32 -- target/tls.sh@37 -- # return 1 00:20:30.562 05:16:32 -- common/autotest_common.sh@653 -- # es=1 00:20:30.562 05:16:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:30.562 05:16:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:30.562 05:16:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:30.562 05:16:32 -- target/tls.sh@167 -- # killprocess 3322591 00:20:30.562 05:16:32 -- common/autotest_common.sh@936 -- # '[' -z 3322591 ']' 00:20:30.562 05:16:32 -- common/autotest_common.sh@940 -- # kill -0 3322591 00:20:30.562 05:16:32 -- common/autotest_common.sh@941 -- # uname 00:20:30.562 05:16:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:30.562 05:16:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3322591 00:20:30.562 05:16:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:30.562 05:16:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:30.562 05:16:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3322591' 00:20:30.562 killing process with pid 3322591 00:20:30.562 05:16:32 -- common/autotest_common.sh@955 -- # kill 3322591 00:20:30.562 05:16:32 -- common/autotest_common.sh@960 -- # wait 3322591 00:20:30.820 05:16:32 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:30.820 05:16:32 -- target/tls.sh@49 -- # local key hash crc 00:20:30.820 05:16:32 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:30.820 05:16:32 -- target/tls.sh@51 -- # hash=02 00:20:30.820 05:16:32 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:30.820 05:16:32 -- target/tls.sh@52 -- # gzip -1 -c 00:20:30.820 05:16:32 -- target/tls.sh@52 -- # tail -c8 00:20:30.820 05:16:32 -- target/tls.sh@52 -- # head -c 4 00:20:30.820 05:16:32 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:30.820 05:16:32 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:30.820 05:16:32 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:30.820 05:16:32 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:30.820 05:16:32 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:30.820 05:16:32 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:30.820 05:16:32 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:30.820 05:16:32 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:30.820 05:16:32 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:30.820 05:16:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:30.820 05:16:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:30.820 05:16:32 -- common/autotest_common.sh@10 -- # set +x 00:20:30.820 05:16:32 -- nvmf/common.sh@469 -- # nvmfpid=3326793 00:20:30.820 05:16:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:30.820 05:16:32 -- nvmf/common.sh@470 -- # waitforlisten 3326793 00:20:30.820 05:16:32 -- common/autotest_common.sh@829 -- # '[' -z 3326793 ']' 00:20:30.820 05:16:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:30.820 05:16:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:30.820 05:16:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:30.820 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:30.820 05:16:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:30.820 05:16:32 -- common/autotest_common.sh@10 -- # set +x 00:20:31.078 [2024-11-26 05:16:32.606303] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:31.078 [2024-11-26 05:16:32.606398] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:31.078 EAL: No free 2048 kB hugepages reported on node 1 00:20:31.078 [2024-11-26 05:16:32.671298] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:31.078 [2024-11-26 05:16:32.756579] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:31.078 [2024-11-26 05:16:32.756765] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:31.078 [2024-11-26 05:16:32.756784] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:31.078 [2024-11-26 05:16:32.756797] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:31.078 [2024-11-26 05:16:32.756824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:32.011 05:16:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:32.011 05:16:33 -- common/autotest_common.sh@862 -- # return 0 00:20:32.011 05:16:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:32.011 05:16:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:32.011 05:16:33 -- common/autotest_common.sh@10 -- # set +x 00:20:32.011 05:16:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:32.011 05:16:33 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:32.011 05:16:33 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:32.011 05:16:33 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:32.270 [2024-11-26 05:16:33.870869] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:32.270 05:16:33 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:32.528 05:16:34 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:32.786 [2024-11-26 05:16:34.364180] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:32.786 [2024-11-26 05:16:34.364442] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:32.786 05:16:34 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:33.044 malloc0 00:20:33.044 05:16:34 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:33.302 05:16:34 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:33.561 05:16:35 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:33.561 05:16:35 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:33.561 05:16:35 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:33.561 05:16:35 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:33.561 05:16:35 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:33.561 05:16:35 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:33.561 05:16:35 -- target/tls.sh@28 -- # bdevperf_pid=3327098 00:20:33.561 05:16:35 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:33.561 05:16:35 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:33.561 05:16:35 -- target/tls.sh@31 -- # waitforlisten 3327098 /var/tmp/bdevperf.sock 00:20:33.561 05:16:35 -- common/autotest_common.sh@829 -- # '[' -z 3327098 ']' 00:20:33.561 05:16:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:33.561 05:16:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:33.561 05:16:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:33.561 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:33.561 05:16:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:33.561 05:16:35 -- common/autotest_common.sh@10 -- # set +x 00:20:33.561 [2024-11-26 05:16:35.224497] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:33.561 [2024-11-26 05:16:35.224582] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327098 ] 00:20:33.561 EAL: No free 2048 kB hugepages reported on node 1 00:20:33.561 [2024-11-26 05:16:35.284532] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:33.820 [2024-11-26 05:16:35.369212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:34.754 05:16:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:34.754 05:16:36 -- common/autotest_common.sh@862 -- # return 0 00:20:34.754 05:16:36 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:34.754 [2024-11-26 05:16:36.455486] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:35.012 TLSTESTn1 00:20:35.012 05:16:36 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:35.012 Running I/O for 10 seconds... 00:20:44.976 00:20:44.976 Latency(us) 00:20:44.976 [2024-11-26T04:16:46.744Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:44.976 [2024-11-26T04:16:46.744Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:44.976 Verification LBA range: start 0x0 length 0x2000 00:20:44.976 TLSTESTn1 : 10.03 4426.81 17.29 0.00 0.00 28867.84 4563.25 41554.68 00:20:44.976 [2024-11-26T04:16:46.744Z] =================================================================================================================== 00:20:44.976 [2024-11-26T04:16:46.744Z] Total : 4426.81 17.29 0.00 0.00 28867.84 4563.25 41554.68 00:20:44.976 0 00:20:44.976 05:16:46 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:44.976 05:16:46 -- target/tls.sh@45 -- # killprocess 3327098 00:20:44.976 05:16:46 -- common/autotest_common.sh@936 -- # '[' -z 3327098 ']' 00:20:44.976 05:16:46 -- common/autotest_common.sh@940 -- # kill -0 3327098 00:20:44.976 05:16:46 -- common/autotest_common.sh@941 -- # uname 00:20:44.976 05:16:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:44.976 05:16:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3327098 00:20:45.234 05:16:46 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:45.234 05:16:46 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:45.234 05:16:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3327098' 00:20:45.234 killing process with pid 3327098 00:20:45.234 05:16:46 -- common/autotest_common.sh@955 -- # kill 3327098 00:20:45.234 Received shutdown signal, test time was about 10.000000 seconds 00:20:45.234 00:20:45.234 Latency(us) 00:20:45.234 [2024-11-26T04:16:47.002Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:45.234 [2024-11-26T04:16:47.002Z] =================================================================================================================== 00:20:45.234 [2024-11-26T04:16:47.002Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:45.234 05:16:46 -- common/autotest_common.sh@960 -- # wait 3327098 00:20:45.234 05:16:46 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:45.234 05:16:46 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:45.234 05:16:46 -- common/autotest_common.sh@650 -- # local es=0 00:20:45.234 05:16:46 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:45.234 05:16:46 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:45.234 05:16:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:45.234 05:16:46 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:45.234 05:16:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:45.234 05:16:46 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:45.234 05:16:46 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:45.234 05:16:46 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:45.234 05:16:46 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:45.234 05:16:46 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:45.234 05:16:46 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:45.234 05:16:46 -- target/tls.sh@28 -- # bdevperf_pid=3328464 00:20:45.234 05:16:46 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:45.234 05:16:46 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:45.234 05:16:46 -- target/tls.sh@31 -- # waitforlisten 3328464 /var/tmp/bdevperf.sock 00:20:45.234 05:16:46 -- common/autotest_common.sh@829 -- # '[' -z 3328464 ']' 00:20:45.234 05:16:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:45.234 05:16:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:45.234 05:16:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:45.234 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:45.234 05:16:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:45.234 05:16:46 -- common/autotest_common.sh@10 -- # set +x 00:20:45.494 [2024-11-26 05:16:47.016805] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:45.494 [2024-11-26 05:16:47.016877] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328464 ] 00:20:45.494 EAL: No free 2048 kB hugepages reported on node 1 00:20:45.494 [2024-11-26 05:16:47.073794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:45.494 [2024-11-26 05:16:47.153384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:46.428 05:16:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:46.428 05:16:47 -- common/autotest_common.sh@862 -- # return 0 00:20:46.428 05:16:47 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:46.686 [2024-11-26 05:16:48.267650] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:46.686 [2024-11-26 05:16:48.267756] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:46.686 request: 00:20:46.686 { 00:20:46.686 "name": "TLSTEST", 00:20:46.686 "trtype": "tcp", 00:20:46.686 "traddr": "10.0.0.2", 00:20:46.686 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:46.686 "adrfam": "ipv4", 00:20:46.686 "trsvcid": "4420", 00:20:46.686 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:46.686 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:46.686 "method": "bdev_nvme_attach_controller", 00:20:46.686 "req_id": 1 00:20:46.686 } 00:20:46.686 Got JSON-RPC error response 00:20:46.686 response: 00:20:46.686 { 00:20:46.686 "code": -22, 00:20:46.686 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:46.686 } 00:20:46.686 05:16:48 -- target/tls.sh@36 -- # killprocess 3328464 00:20:46.686 05:16:48 -- common/autotest_common.sh@936 -- # '[' -z 3328464 ']' 00:20:46.686 05:16:48 -- common/autotest_common.sh@940 -- # kill -0 3328464 00:20:46.686 05:16:48 -- common/autotest_common.sh@941 -- # uname 00:20:46.686 05:16:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:46.686 05:16:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3328464 00:20:46.686 05:16:48 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:46.686 05:16:48 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:46.686 05:16:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3328464' 00:20:46.686 killing process with pid 3328464 00:20:46.686 05:16:48 -- common/autotest_common.sh@955 -- # kill 3328464 00:20:46.686 Received shutdown signal, test time was about 10.000000 seconds 00:20:46.686 00:20:46.686 Latency(us) 00:20:46.686 [2024-11-26T04:16:48.454Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:46.686 [2024-11-26T04:16:48.454Z] =================================================================================================================== 00:20:46.686 [2024-11-26T04:16:48.454Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:46.686 05:16:48 -- common/autotest_common.sh@960 -- # wait 3328464 00:20:46.944 05:16:48 -- target/tls.sh@37 -- # return 1 00:20:46.944 05:16:48 -- common/autotest_common.sh@653 -- # es=1 00:20:46.944 05:16:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:46.944 05:16:48 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:46.944 05:16:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:46.944 05:16:48 -- target/tls.sh@183 -- # killprocess 3326793 00:20:46.944 05:16:48 -- common/autotest_common.sh@936 -- # '[' -z 3326793 ']' 00:20:46.944 05:16:48 -- common/autotest_common.sh@940 -- # kill -0 3326793 00:20:46.944 05:16:48 -- common/autotest_common.sh@941 -- # uname 00:20:46.944 05:16:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:46.944 05:16:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3326793 00:20:46.944 05:16:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:46.944 05:16:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:46.944 05:16:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3326793' 00:20:46.944 killing process with pid 3326793 00:20:46.944 05:16:48 -- common/autotest_common.sh@955 -- # kill 3326793 00:20:46.944 05:16:48 -- common/autotest_common.sh@960 -- # wait 3326793 00:20:47.202 05:16:48 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:47.202 05:16:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:47.202 05:16:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:47.202 05:16:48 -- common/autotest_common.sh@10 -- # set +x 00:20:47.202 05:16:48 -- nvmf/common.sh@469 -- # nvmfpid=3328745 00:20:47.202 05:16:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:47.202 05:16:48 -- nvmf/common.sh@470 -- # waitforlisten 3328745 00:20:47.202 05:16:48 -- common/autotest_common.sh@829 -- # '[' -z 3328745 ']' 00:20:47.202 05:16:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:47.202 05:16:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:47.202 05:16:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:47.202 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:47.202 05:16:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:47.202 05:16:48 -- common/autotest_common.sh@10 -- # set +x 00:20:47.202 [2024-11-26 05:16:48.885020] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:47.202 [2024-11-26 05:16:48.885091] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:47.202 EAL: No free 2048 kB hugepages reported on node 1 00:20:47.202 [2024-11-26 05:16:48.952757] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:47.461 [2024-11-26 05:16:49.045306] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:47.461 [2024-11-26 05:16:49.045495] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:47.461 [2024-11-26 05:16:49.045515] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:47.461 [2024-11-26 05:16:49.045529] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:47.461 [2024-11-26 05:16:49.045564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:48.392 05:16:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:48.392 05:16:49 -- common/autotest_common.sh@862 -- # return 0 00:20:48.392 05:16:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:48.392 05:16:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:48.392 05:16:49 -- common/autotest_common.sh@10 -- # set +x 00:20:48.392 05:16:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:48.392 05:16:49 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:48.393 05:16:49 -- common/autotest_common.sh@650 -- # local es=0 00:20:48.393 05:16:49 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:48.393 05:16:49 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:20:48.393 05:16:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:48.393 05:16:49 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:20:48.393 05:16:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:48.393 05:16:49 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:48.393 05:16:49 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:48.393 05:16:49 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:48.650 [2024-11-26 05:16:50.161314] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:48.650 05:16:50 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:48.908 05:16:50 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:49.165 [2024-11-26 05:16:50.686746] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:49.165 [2024-11-26 05:16:50.687035] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:49.165 05:16:50 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:49.423 malloc0 00:20:49.423 05:16:50 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:49.681 05:16:51 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:49.681 [2024-11-26 05:16:51.436852] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:49.681 [2024-11-26 05:16:51.436894] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:49.681 [2024-11-26 05:16:51.436920] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:49.681 request: 00:20:49.681 { 00:20:49.681 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:49.681 "host": "nqn.2016-06.io.spdk:host1", 00:20:49.681 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:49.681 "method": "nvmf_subsystem_add_host", 00:20:49.681 "req_id": 1 00:20:49.681 } 00:20:49.681 Got JSON-RPC error response 00:20:49.681 response: 00:20:49.681 { 00:20:49.681 "code": -32603, 00:20:49.681 "message": "Internal error" 00:20:49.681 } 00:20:49.939 05:16:51 -- common/autotest_common.sh@653 -- # es=1 00:20:49.939 05:16:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:49.939 05:16:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:49.939 05:16:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:49.939 05:16:51 -- target/tls.sh@189 -- # killprocess 3328745 00:20:49.939 05:16:51 -- common/autotest_common.sh@936 -- # '[' -z 3328745 ']' 00:20:49.939 05:16:51 -- common/autotest_common.sh@940 -- # kill -0 3328745 00:20:49.939 05:16:51 -- common/autotest_common.sh@941 -- # uname 00:20:49.939 05:16:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:49.939 05:16:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3328745 00:20:49.939 05:16:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:49.939 05:16:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:49.939 05:16:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3328745' 00:20:49.939 killing process with pid 3328745 00:20:49.939 05:16:51 -- common/autotest_common.sh@955 -- # kill 3328745 00:20:49.939 05:16:51 -- common/autotest_common.sh@960 -- # wait 3328745 00:20:50.198 05:16:51 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:50.198 05:16:51 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:20:50.198 05:16:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:50.198 05:16:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:50.198 05:16:51 -- common/autotest_common.sh@10 -- # set +x 00:20:50.198 05:16:51 -- nvmf/common.sh@469 -- # nvmfpid=3329105 00:20:50.198 05:16:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:50.198 05:16:51 -- nvmf/common.sh@470 -- # waitforlisten 3329105 00:20:50.198 05:16:51 -- common/autotest_common.sh@829 -- # '[' -z 3329105 ']' 00:20:50.198 05:16:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:50.198 05:16:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:50.198 05:16:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:50.198 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:50.198 05:16:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:50.198 05:16:51 -- common/autotest_common.sh@10 -- # set +x 00:20:50.198 [2024-11-26 05:16:51.769261] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:50.198 [2024-11-26 05:16:51.769340] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:50.198 EAL: No free 2048 kB hugepages reported on node 1 00:20:50.198 [2024-11-26 05:16:51.841980] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:50.198 [2024-11-26 05:16:51.934396] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:50.198 [2024-11-26 05:16:51.934578] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:50.198 [2024-11-26 05:16:51.934597] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:50.198 [2024-11-26 05:16:51.934611] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:50.198 [2024-11-26 05:16:51.934652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:51.132 05:16:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:51.132 05:16:52 -- common/autotest_common.sh@862 -- # return 0 00:20:51.132 05:16:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:51.132 05:16:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:51.132 05:16:52 -- common/autotest_common.sh@10 -- # set +x 00:20:51.132 05:16:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:51.132 05:16:52 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:51.132 05:16:52 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:51.132 05:16:52 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:51.390 [2024-11-26 05:16:53.074279] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:51.390 05:16:53 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:51.648 05:16:53 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:51.906 [2024-11-26 05:16:53.635786] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:51.906 [2024-11-26 05:16:53.636069] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:51.906 05:16:53 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:52.164 malloc0 00:20:52.164 05:16:53 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:52.789 05:16:54 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:52.789 05:16:54 -- target/tls.sh@197 -- # bdevperf_pid=3329487 00:20:52.789 05:16:54 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:52.789 05:16:54 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:52.789 05:16:54 -- target/tls.sh@200 -- # waitforlisten 3329487 /var/tmp/bdevperf.sock 00:20:52.789 05:16:54 -- common/autotest_common.sh@829 -- # '[' -z 3329487 ']' 00:20:52.789 05:16:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:52.789 05:16:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:52.789 05:16:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:52.789 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:52.789 05:16:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:52.789 05:16:54 -- common/autotest_common.sh@10 -- # set +x 00:20:52.789 [2024-11-26 05:16:54.512366] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:52.789 [2024-11-26 05:16:54.512455] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329487 ] 00:20:53.047 EAL: No free 2048 kB hugepages reported on node 1 00:20:53.047 [2024-11-26 05:16:54.576271] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:53.047 [2024-11-26 05:16:54.662175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:53.982 05:16:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:53.982 05:16:55 -- common/autotest_common.sh@862 -- # return 0 00:20:53.982 05:16:55 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:54.240 [2024-11-26 05:16:55.790096] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:54.240 TLSTESTn1 00:20:54.240 05:16:55 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:20:54.499 05:16:56 -- target/tls.sh@205 -- # tgtconf='{ 00:20:54.499 "subsystems": [ 00:20:54.499 { 00:20:54.499 "subsystem": "iobuf", 00:20:54.499 "config": [ 00:20:54.499 { 00:20:54.499 "method": "iobuf_set_options", 00:20:54.499 "params": { 00:20:54.499 "small_pool_count": 8192, 00:20:54.499 "large_pool_count": 1024, 00:20:54.499 "small_bufsize": 8192, 00:20:54.499 "large_bufsize": 135168 00:20:54.499 } 00:20:54.499 } 00:20:54.499 ] 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "subsystem": "sock", 00:20:54.499 "config": [ 00:20:54.499 { 00:20:54.499 "method": "sock_impl_set_options", 00:20:54.499 "params": { 00:20:54.499 "impl_name": "posix", 00:20:54.499 "recv_buf_size": 2097152, 00:20:54.499 "send_buf_size": 2097152, 00:20:54.499 "enable_recv_pipe": true, 00:20:54.499 "enable_quickack": false, 00:20:54.499 "enable_placement_id": 0, 00:20:54.499 "enable_zerocopy_send_server": true, 00:20:54.499 "enable_zerocopy_send_client": false, 00:20:54.499 "zerocopy_threshold": 0, 00:20:54.499 "tls_version": 0, 00:20:54.499 "enable_ktls": false 00:20:54.499 } 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "method": "sock_impl_set_options", 00:20:54.499 "params": { 00:20:54.499 "impl_name": "ssl", 00:20:54.499 "recv_buf_size": 4096, 00:20:54.499 "send_buf_size": 4096, 00:20:54.499 "enable_recv_pipe": true, 00:20:54.499 "enable_quickack": false, 00:20:54.499 "enable_placement_id": 0, 00:20:54.499 "enable_zerocopy_send_server": true, 00:20:54.499 "enable_zerocopy_send_client": false, 00:20:54.499 "zerocopy_threshold": 0, 00:20:54.499 "tls_version": 0, 00:20:54.499 "enable_ktls": false 00:20:54.499 } 00:20:54.499 } 00:20:54.499 ] 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "subsystem": "vmd", 00:20:54.499 "config": [] 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "subsystem": "accel", 00:20:54.499 "config": [ 00:20:54.499 { 00:20:54.499 "method": "accel_set_options", 00:20:54.499 "params": { 00:20:54.499 "small_cache_size": 128, 00:20:54.499 "large_cache_size": 16, 00:20:54.499 "task_count": 2048, 00:20:54.499 "sequence_count": 2048, 00:20:54.499 "buf_count": 2048 00:20:54.499 } 00:20:54.499 } 00:20:54.499 ] 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "subsystem": "bdev", 00:20:54.499 "config": [ 00:20:54.499 { 00:20:54.499 "method": "bdev_set_options", 00:20:54.499 "params": { 00:20:54.499 "bdev_io_pool_size": 65535, 00:20:54.499 "bdev_io_cache_size": 256, 00:20:54.499 "bdev_auto_examine": true, 00:20:54.499 "iobuf_small_cache_size": 128, 00:20:54.499 "iobuf_large_cache_size": 16 00:20:54.499 } 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "method": "bdev_raid_set_options", 00:20:54.499 "params": { 00:20:54.499 "process_window_size_kb": 1024 00:20:54.499 } 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "method": "bdev_iscsi_set_options", 00:20:54.499 "params": { 00:20:54.499 "timeout_sec": 30 00:20:54.499 } 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "method": "bdev_nvme_set_options", 00:20:54.499 "params": { 00:20:54.499 "action_on_timeout": "none", 00:20:54.499 "timeout_us": 0, 00:20:54.499 "timeout_admin_us": 0, 00:20:54.499 "keep_alive_timeout_ms": 10000, 00:20:54.499 "transport_retry_count": 4, 00:20:54.499 "arbitration_burst": 0, 00:20:54.499 "low_priority_weight": 0, 00:20:54.499 "medium_priority_weight": 0, 00:20:54.499 "high_priority_weight": 0, 00:20:54.499 "nvme_adminq_poll_period_us": 10000, 00:20:54.499 "nvme_ioq_poll_period_us": 0, 00:20:54.499 "io_queue_requests": 0, 00:20:54.499 "delay_cmd_submit": true, 00:20:54.499 "bdev_retry_count": 3, 00:20:54.499 "transport_ack_timeout": 0, 00:20:54.499 "ctrlr_loss_timeout_sec": 0, 00:20:54.499 "reconnect_delay_sec": 0, 00:20:54.499 "fast_io_fail_timeout_sec": 0, 00:20:54.499 "generate_uuids": false, 00:20:54.499 "transport_tos": 0, 00:20:54.499 "io_path_stat": false, 00:20:54.499 "allow_accel_sequence": false 00:20:54.499 } 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "method": "bdev_nvme_set_hotplug", 00:20:54.499 "params": { 00:20:54.499 "period_us": 100000, 00:20:54.499 "enable": false 00:20:54.499 } 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "method": "bdev_malloc_create", 00:20:54.499 "params": { 00:20:54.499 "name": "malloc0", 00:20:54.499 "num_blocks": 8192, 00:20:54.499 "block_size": 4096, 00:20:54.499 "physical_block_size": 4096, 00:20:54.499 "uuid": "c453ca09-8de1-4681-b5ed-bfc62c7438a8", 00:20:54.499 "optimal_io_boundary": 0 00:20:54.499 } 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "method": "bdev_wait_for_examine" 00:20:54.499 } 00:20:54.499 ] 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "subsystem": "nbd", 00:20:54.499 "config": [] 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "subsystem": "scheduler", 00:20:54.499 "config": [ 00:20:54.499 { 00:20:54.499 "method": "framework_set_scheduler", 00:20:54.499 "params": { 00:20:54.499 "name": "static" 00:20:54.499 } 00:20:54.499 } 00:20:54.499 ] 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "subsystem": "nvmf", 00:20:54.499 "config": [ 00:20:54.499 { 00:20:54.499 "method": "nvmf_set_config", 00:20:54.499 "params": { 00:20:54.499 "discovery_filter": "match_any", 00:20:54.499 "admin_cmd_passthru": { 00:20:54.499 "identify_ctrlr": false 00:20:54.499 } 00:20:54.499 } 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "method": "nvmf_set_max_subsystems", 00:20:54.499 "params": { 00:20:54.499 "max_subsystems": 1024 00:20:54.499 } 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "method": "nvmf_set_crdt", 00:20:54.499 "params": { 00:20:54.499 "crdt1": 0, 00:20:54.499 "crdt2": 0, 00:20:54.499 "crdt3": 0 00:20:54.499 } 00:20:54.499 }, 00:20:54.499 { 00:20:54.499 "method": "nvmf_create_transport", 00:20:54.499 "params": { 00:20:54.499 "trtype": "TCP", 00:20:54.499 "max_queue_depth": 128, 00:20:54.499 "max_io_qpairs_per_ctrlr": 127, 00:20:54.499 "in_capsule_data_size": 4096, 00:20:54.499 "max_io_size": 131072, 00:20:54.499 "io_unit_size": 131072, 00:20:54.499 "max_aq_depth": 128, 00:20:54.499 "num_shared_buffers": 511, 00:20:54.499 "buf_cache_size": 4294967295, 00:20:54.499 "dif_insert_or_strip": false, 00:20:54.499 "zcopy": false, 00:20:54.499 "c2h_success": false, 00:20:54.499 "sock_priority": 0, 00:20:54.499 "abort_timeout_sec": 1 00:20:54.499 } 00:20:54.500 }, 00:20:54.500 { 00:20:54.500 "method": "nvmf_create_subsystem", 00:20:54.500 "params": { 00:20:54.500 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:54.500 "allow_any_host": false, 00:20:54.500 "serial_number": "SPDK00000000000001", 00:20:54.500 "model_number": "SPDK bdev Controller", 00:20:54.500 "max_namespaces": 10, 00:20:54.500 "min_cntlid": 1, 00:20:54.500 "max_cntlid": 65519, 00:20:54.500 "ana_reporting": false 00:20:54.500 } 00:20:54.500 }, 00:20:54.500 { 00:20:54.500 "method": "nvmf_subsystem_add_host", 00:20:54.500 "params": { 00:20:54.500 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:54.500 "host": "nqn.2016-06.io.spdk:host1", 00:20:54.500 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:54.500 } 00:20:54.500 }, 00:20:54.500 { 00:20:54.500 "method": "nvmf_subsystem_add_ns", 00:20:54.500 "params": { 00:20:54.500 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:54.500 "namespace": { 00:20:54.500 "nsid": 1, 00:20:54.500 "bdev_name": "malloc0", 00:20:54.500 "nguid": "C453CA098DE14681B5EDBFC62C7438A8", 00:20:54.500 "uuid": "c453ca09-8de1-4681-b5ed-bfc62c7438a8" 00:20:54.500 } 00:20:54.500 } 00:20:54.500 }, 00:20:54.500 { 00:20:54.500 "method": "nvmf_subsystem_add_listener", 00:20:54.500 "params": { 00:20:54.500 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:54.500 "listen_address": { 00:20:54.500 "trtype": "TCP", 00:20:54.500 "adrfam": "IPv4", 00:20:54.500 "traddr": "10.0.0.2", 00:20:54.500 "trsvcid": "4420" 00:20:54.500 }, 00:20:54.500 "secure_channel": true 00:20:54.500 } 00:20:54.500 } 00:20:54.500 ] 00:20:54.500 } 00:20:54.500 ] 00:20:54.500 }' 00:20:54.500 05:16:56 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:55.068 05:16:56 -- target/tls.sh@206 -- # bdevperfconf='{ 00:20:55.068 "subsystems": [ 00:20:55.068 { 00:20:55.068 "subsystem": "iobuf", 00:20:55.068 "config": [ 00:20:55.068 { 00:20:55.068 "method": "iobuf_set_options", 00:20:55.068 "params": { 00:20:55.068 "small_pool_count": 8192, 00:20:55.068 "large_pool_count": 1024, 00:20:55.068 "small_bufsize": 8192, 00:20:55.068 "large_bufsize": 135168 00:20:55.069 } 00:20:55.069 } 00:20:55.069 ] 00:20:55.069 }, 00:20:55.069 { 00:20:55.069 "subsystem": "sock", 00:20:55.069 "config": [ 00:20:55.069 { 00:20:55.069 "method": "sock_impl_set_options", 00:20:55.069 "params": { 00:20:55.069 "impl_name": "posix", 00:20:55.069 "recv_buf_size": 2097152, 00:20:55.069 "send_buf_size": 2097152, 00:20:55.069 "enable_recv_pipe": true, 00:20:55.069 "enable_quickack": false, 00:20:55.069 "enable_placement_id": 0, 00:20:55.069 "enable_zerocopy_send_server": true, 00:20:55.069 "enable_zerocopy_send_client": false, 00:20:55.069 "zerocopy_threshold": 0, 00:20:55.069 "tls_version": 0, 00:20:55.069 "enable_ktls": false 00:20:55.069 } 00:20:55.069 }, 00:20:55.069 { 00:20:55.069 "method": "sock_impl_set_options", 00:20:55.069 "params": { 00:20:55.069 "impl_name": "ssl", 00:20:55.069 "recv_buf_size": 4096, 00:20:55.069 "send_buf_size": 4096, 00:20:55.069 "enable_recv_pipe": true, 00:20:55.069 "enable_quickack": false, 00:20:55.069 "enable_placement_id": 0, 00:20:55.069 "enable_zerocopy_send_server": true, 00:20:55.069 "enable_zerocopy_send_client": false, 00:20:55.069 "zerocopy_threshold": 0, 00:20:55.069 "tls_version": 0, 00:20:55.069 "enable_ktls": false 00:20:55.069 } 00:20:55.069 } 00:20:55.069 ] 00:20:55.069 }, 00:20:55.069 { 00:20:55.069 "subsystem": "vmd", 00:20:55.069 "config": [] 00:20:55.069 }, 00:20:55.069 { 00:20:55.069 "subsystem": "accel", 00:20:55.069 "config": [ 00:20:55.069 { 00:20:55.069 "method": "accel_set_options", 00:20:55.069 "params": { 00:20:55.069 "small_cache_size": 128, 00:20:55.069 "large_cache_size": 16, 00:20:55.069 "task_count": 2048, 00:20:55.069 "sequence_count": 2048, 00:20:55.069 "buf_count": 2048 00:20:55.069 } 00:20:55.069 } 00:20:55.069 ] 00:20:55.069 }, 00:20:55.069 { 00:20:55.069 "subsystem": "bdev", 00:20:55.069 "config": [ 00:20:55.069 { 00:20:55.069 "method": "bdev_set_options", 00:20:55.069 "params": { 00:20:55.069 "bdev_io_pool_size": 65535, 00:20:55.069 "bdev_io_cache_size": 256, 00:20:55.069 "bdev_auto_examine": true, 00:20:55.069 "iobuf_small_cache_size": 128, 00:20:55.069 "iobuf_large_cache_size": 16 00:20:55.069 } 00:20:55.069 }, 00:20:55.069 { 00:20:55.069 "method": "bdev_raid_set_options", 00:20:55.069 "params": { 00:20:55.069 "process_window_size_kb": 1024 00:20:55.069 } 00:20:55.069 }, 00:20:55.069 { 00:20:55.069 "method": "bdev_iscsi_set_options", 00:20:55.069 "params": { 00:20:55.069 "timeout_sec": 30 00:20:55.069 } 00:20:55.069 }, 00:20:55.069 { 00:20:55.069 "method": "bdev_nvme_set_options", 00:20:55.069 "params": { 00:20:55.069 "action_on_timeout": "none", 00:20:55.069 "timeout_us": 0, 00:20:55.069 "timeout_admin_us": 0, 00:20:55.069 "keep_alive_timeout_ms": 10000, 00:20:55.069 "transport_retry_count": 4, 00:20:55.069 "arbitration_burst": 0, 00:20:55.069 "low_priority_weight": 0, 00:20:55.069 "medium_priority_weight": 0, 00:20:55.069 "high_priority_weight": 0, 00:20:55.069 "nvme_adminq_poll_period_us": 10000, 00:20:55.069 "nvme_ioq_poll_period_us": 0, 00:20:55.069 "io_queue_requests": 512, 00:20:55.069 "delay_cmd_submit": true, 00:20:55.069 "bdev_retry_count": 3, 00:20:55.069 "transport_ack_timeout": 0, 00:20:55.069 "ctrlr_loss_timeout_sec": 0, 00:20:55.069 "reconnect_delay_sec": 0, 00:20:55.069 "fast_io_fail_timeout_sec": 0, 00:20:55.069 "generate_uuids": false, 00:20:55.069 "transport_tos": 0, 00:20:55.069 "io_path_stat": false, 00:20:55.069 "allow_accel_sequence": false 00:20:55.069 } 00:20:55.069 }, 00:20:55.069 { 00:20:55.069 "method": "bdev_nvme_attach_controller", 00:20:55.069 "params": { 00:20:55.069 "name": "TLSTEST", 00:20:55.069 "trtype": "TCP", 00:20:55.069 "adrfam": "IPv4", 00:20:55.069 "traddr": "10.0.0.2", 00:20:55.069 "trsvcid": "4420", 00:20:55.069 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:55.069 "prchk_reftag": false, 00:20:55.069 "prchk_guard": false, 00:20:55.069 "ctrlr_loss_timeout_sec": 0, 00:20:55.069 "reconnect_delay_sec": 0, 00:20:55.069 "fast_io_fail_timeout_sec": 0, 00:20:55.069 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:55.069 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:55.069 "hdgst": false, 00:20:55.069 "ddgst": false 00:20:55.069 } 00:20:55.069 }, 00:20:55.069 { 00:20:55.069 "method": "bdev_nvme_set_hotplug", 00:20:55.069 "params": { 00:20:55.069 "period_us": 100000, 00:20:55.069 "enable": false 00:20:55.069 } 00:20:55.069 }, 00:20:55.069 { 00:20:55.069 "method": "bdev_wait_for_examine" 00:20:55.069 } 00:20:55.069 ] 00:20:55.069 }, 00:20:55.069 { 00:20:55.069 "subsystem": "nbd", 00:20:55.069 "config": [] 00:20:55.069 } 00:20:55.069 ] 00:20:55.069 }' 00:20:55.069 05:16:56 -- target/tls.sh@208 -- # killprocess 3329487 00:20:55.069 05:16:56 -- common/autotest_common.sh@936 -- # '[' -z 3329487 ']' 00:20:55.069 05:16:56 -- common/autotest_common.sh@940 -- # kill -0 3329487 00:20:55.069 05:16:56 -- common/autotest_common.sh@941 -- # uname 00:20:55.069 05:16:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:55.069 05:16:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3329487 00:20:55.069 05:16:56 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:55.069 05:16:56 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:55.069 05:16:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3329487' 00:20:55.069 killing process with pid 3329487 00:20:55.069 05:16:56 -- common/autotest_common.sh@955 -- # kill 3329487 00:20:55.069 Received shutdown signal, test time was about 10.000000 seconds 00:20:55.069 00:20:55.069 Latency(us) 00:20:55.069 [2024-11-26T04:16:56.837Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:55.069 [2024-11-26T04:16:56.837Z] =================================================================================================================== 00:20:55.069 [2024-11-26T04:16:56.837Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:55.069 05:16:56 -- common/autotest_common.sh@960 -- # wait 3329487 00:20:55.069 05:16:56 -- target/tls.sh@209 -- # killprocess 3329105 00:20:55.069 05:16:56 -- common/autotest_common.sh@936 -- # '[' -z 3329105 ']' 00:20:55.069 05:16:56 -- common/autotest_common.sh@940 -- # kill -0 3329105 00:20:55.069 05:16:56 -- common/autotest_common.sh@941 -- # uname 00:20:55.069 05:16:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:55.069 05:16:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3329105 00:20:55.329 05:16:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:55.329 05:16:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:55.329 05:16:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3329105' 00:20:55.329 killing process with pid 3329105 00:20:55.329 05:16:56 -- common/autotest_common.sh@955 -- # kill 3329105 00:20:55.329 05:16:56 -- common/autotest_common.sh@960 -- # wait 3329105 00:20:55.588 05:16:57 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:20:55.588 05:16:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:55.588 05:16:57 -- target/tls.sh@212 -- # echo '{ 00:20:55.588 "subsystems": [ 00:20:55.588 { 00:20:55.588 "subsystem": "iobuf", 00:20:55.588 "config": [ 00:20:55.588 { 00:20:55.588 "method": "iobuf_set_options", 00:20:55.588 "params": { 00:20:55.588 "small_pool_count": 8192, 00:20:55.588 "large_pool_count": 1024, 00:20:55.588 "small_bufsize": 8192, 00:20:55.588 "large_bufsize": 135168 00:20:55.588 } 00:20:55.588 } 00:20:55.588 ] 00:20:55.588 }, 00:20:55.588 { 00:20:55.588 "subsystem": "sock", 00:20:55.588 "config": [ 00:20:55.588 { 00:20:55.588 "method": "sock_impl_set_options", 00:20:55.588 "params": { 00:20:55.588 "impl_name": "posix", 00:20:55.588 "recv_buf_size": 2097152, 00:20:55.588 "send_buf_size": 2097152, 00:20:55.588 "enable_recv_pipe": true, 00:20:55.588 "enable_quickack": false, 00:20:55.588 "enable_placement_id": 0, 00:20:55.588 "enable_zerocopy_send_server": true, 00:20:55.588 "enable_zerocopy_send_client": false, 00:20:55.588 "zerocopy_threshold": 0, 00:20:55.588 "tls_version": 0, 00:20:55.588 "enable_ktls": false 00:20:55.588 } 00:20:55.588 }, 00:20:55.588 { 00:20:55.588 "method": "sock_impl_set_options", 00:20:55.588 "params": { 00:20:55.588 "impl_name": "ssl", 00:20:55.588 "recv_buf_size": 4096, 00:20:55.588 "send_buf_size": 4096, 00:20:55.588 "enable_recv_pipe": true, 00:20:55.588 "enable_quickack": false, 00:20:55.588 "enable_placement_id": 0, 00:20:55.588 "enable_zerocopy_send_server": true, 00:20:55.588 "enable_zerocopy_send_client": false, 00:20:55.588 "zerocopy_threshold": 0, 00:20:55.588 "tls_version": 0, 00:20:55.588 "enable_ktls": false 00:20:55.588 } 00:20:55.588 } 00:20:55.588 ] 00:20:55.588 }, 00:20:55.588 { 00:20:55.588 "subsystem": "vmd", 00:20:55.588 "config": [] 00:20:55.588 }, 00:20:55.588 { 00:20:55.588 "subsystem": "accel", 00:20:55.588 "config": [ 00:20:55.588 { 00:20:55.589 "method": "accel_set_options", 00:20:55.589 "params": { 00:20:55.589 "small_cache_size": 128, 00:20:55.589 "large_cache_size": 16, 00:20:55.589 "task_count": 2048, 00:20:55.589 "sequence_count": 2048, 00:20:55.589 "buf_count": 2048 00:20:55.589 } 00:20:55.589 } 00:20:55.589 ] 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "subsystem": "bdev", 00:20:55.589 "config": [ 00:20:55.589 { 00:20:55.589 "method": "bdev_set_options", 00:20:55.589 "params": { 00:20:55.589 "bdev_io_pool_size": 65535, 00:20:55.589 "bdev_io_cache_size": 256, 00:20:55.589 "bdev_auto_examine": true, 00:20:55.589 "iobuf_small_cache_size": 128, 00:20:55.589 "iobuf_large_cache_size": 16 00:20:55.589 } 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "method": "bdev_raid_set_options", 00:20:55.589 "params": { 00:20:55.589 "process_window_size_kb": 1024 00:20:55.589 } 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "method": "bdev_iscsi_set_options", 00:20:55.589 "params": { 00:20:55.589 "timeout_sec": 30 00:20:55.589 } 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "method": "bdev_nvme_set_options", 00:20:55.589 "params": { 00:20:55.589 "action_on_timeout": "none", 00:20:55.589 "timeout_us": 0, 00:20:55.589 "timeout_admin_us": 0, 00:20:55.589 "keep_alive_timeout_ms": 10000, 00:20:55.589 "transport_retry_count": 4, 00:20:55.589 "arbitration_burst": 0, 00:20:55.589 "low_priority_weight": 0, 00:20:55.589 "medium_priority_weight": 0, 00:20:55.589 "high_priority_weight": 0, 00:20:55.589 "nvme_adminq_poll_period_us": 10000, 00:20:55.589 "nvme_ioq_poll_period_us": 0, 00:20:55.589 "io_queue_requests": 0, 00:20:55.589 "delay_cmd_submit": true, 00:20:55.589 "bdev_retry_count": 3, 00:20:55.589 "transport_ack_timeout": 0, 00:20:55.589 "ctrlr_loss_timeout_sec": 0, 00:20:55.589 "reconnect_delay_sec": 0, 00:20:55.589 "fast_io_fail_timeout_sec": 0, 00:20:55.589 "generate_uuids": false, 00:20:55.589 "transport_tos": 0, 00:20:55.589 "io_path_stat": false, 00:20:55.589 "allow_accel_sequence": false 00:20:55.589 } 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "method": "bdev_nvme_set_hotplug", 00:20:55.589 "params": { 00:20:55.589 "period_us": 100000, 00:20:55.589 "enable": false 00:20:55.589 } 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "method": "bdev_malloc_create", 00:20:55.589 "params": { 00:20:55.589 "name": "malloc0", 00:20:55.589 "num_blocks": 8192, 00:20:55.589 "block_size": 4096, 00:20:55.589 "physical_block_size": 4096, 00:20:55.589 "uuid": "c453ca09-8de1-4681-b5ed-bfc62c7438a8", 00:20:55.589 "optimal_io_boundary": 0 00:20:55.589 } 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "method": "bdev_wait_for_examine" 00:20:55.589 } 00:20:55.589 ] 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "subsystem": "nbd", 00:20:55.589 "config": [] 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "subsystem": "scheduler", 00:20:55.589 "config": [ 00:20:55.589 { 00:20:55.589 "method": "framework_set_scheduler", 00:20:55.589 "params": { 00:20:55.589 "name": "static" 00:20:55.589 } 00:20:55.589 } 00:20:55.589 ] 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "subsystem": "nvmf", 00:20:55.589 "config": [ 00:20:55.589 { 00:20:55.589 "method": "nvmf_set_config", 00:20:55.589 "params": { 00:20:55.589 "discovery_filter": "match_any", 00:20:55.589 "admin_cmd_passthru": { 00:20:55.589 "identify_ctrlr": false 00:20:55.589 } 00:20:55.589 } 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "method": "nvmf_set_max_subsystems", 00:20:55.589 "params": { 00:20:55.589 "max_subsystems": 1024 00:20:55.589 } 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "method": "nvmf_set_crdt", 00:20:55.589 "params": { 00:20:55.589 "crdt1": 0, 00:20:55.589 "crdt2": 0, 00:20:55.589 "crdt3": 0 00:20:55.589 } 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "method": "nvmf_create_transport", 00:20:55.589 "params": { 00:20:55.589 "trtype": "TCP", 00:20:55.589 "max_queue_depth": 128, 00:20:55.589 "max_io_qpairs_per_ctrlr": 127, 00:20:55.589 "in_capsule_data_size": 4096, 00:20:55.589 "max_io_size": 131072, 00:20:55.589 "io_unit_size": 131072, 00:20:55.589 "max_aq_depth": 128, 00:20:55.589 "num_shared_buffers": 511, 00:20:55.589 "buf_cache_size": 4294967295, 00:20:55.589 "dif_insert_or_strip": false, 00:20:55.589 "zcopy": false, 00:20:55.589 "c2h_success": false, 00:20:55.589 "sock_priority": 0, 00:20:55.589 "abort_timeout_sec": 1 00:20:55.589 } 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "method": "nvmf_create_subsystem", 00:20:55.589 "params": { 00:20:55.589 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:55.589 "allow_any_host": false, 00:20:55.589 "serial_number": "SPDK00000000000001", 00:20:55.589 "model_number": "SPDK bdev Controller", 00:20:55.589 "max_namespaces": 10, 00:20:55.589 "min_cntlid": 1, 00:20:55.589 "max_cntlid": 65519, 00:20:55.589 "ana_reporting": false 00:20:55.589 } 00:20:55.589 }, 00:20:55.589 { 00:20:55.589 "method": "nvmf_subsystem_add_host", 00:20:55.589 "params": { 00:20:55.589 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:55.589 "host": "nqn.2016-06.io.spdk:host1", 00:20:55.590 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:55.590 } 00:20:55.590 }, 00:20:55.590 { 00:20:55.590 "method": "nvmf_subsystem_add_ns", 00:20:55.590 "params": { 00:20:55.590 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:55.590 "namespace": { 00:20:55.590 "nsid": 1, 00:20:55.590 "bdev_name": "malloc0", 00:20:55.590 "nguid": "C453CA098DE14681B5EDBFC62C7438A8", 00:20:55.590 "uuid": "c453ca09-8de1-4681-b5ed-bfc62c7438a8" 00:20:55.590 } 00:20:55.590 } 00:20:55.590 }, 00:20:55.590 { 00:20:55.590 "method": "nvmf_subsystem_add_listener", 00:20:55.590 "params": { 00:20:55.590 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:55.590 "listen_address": { 00:20:55.590 "trtype": "TCP", 00:20:55.590 "adrfam": "IPv4", 00:20:55.590 "traddr": "10.0.0.2", 00:20:55.590 "trsvcid": "4420" 00:20:55.590 }, 00:20:55.590 "secure_channel": true 00:20:55.590 } 00:20:55.590 } 00:20:55.590 ] 00:20:55.590 } 00:20:55.590 ] 00:20:55.590 }' 00:20:55.590 05:16:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:55.590 05:16:57 -- common/autotest_common.sh@10 -- # set +x 00:20:55.590 05:16:57 -- nvmf/common.sh@469 -- # nvmfpid=3329783 00:20:55.590 05:16:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:20:55.590 05:16:57 -- nvmf/common.sh@470 -- # waitforlisten 3329783 00:20:55.590 05:16:57 -- common/autotest_common.sh@829 -- # '[' -z 3329783 ']' 00:20:55.590 05:16:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:55.590 05:16:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:55.590 05:16:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:55.590 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:55.590 05:16:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:55.590 05:16:57 -- common/autotest_common.sh@10 -- # set +x 00:20:55.590 [2024-11-26 05:16:57.150469] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:55.590 [2024-11-26 05:16:57.150545] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:55.590 EAL: No free 2048 kB hugepages reported on node 1 00:20:55.590 [2024-11-26 05:16:57.219574] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:55.590 [2024-11-26 05:16:57.304548] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:55.590 [2024-11-26 05:16:57.304738] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:55.590 [2024-11-26 05:16:57.304760] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:55.590 [2024-11-26 05:16:57.304774] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:55.590 [2024-11-26 05:16:57.304806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:55.850 [2024-11-26 05:16:57.533130] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:55.850 [2024-11-26 05:16:57.565160] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:55.850 [2024-11-26 05:16:57.565475] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:56.417 05:16:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:56.417 05:16:58 -- common/autotest_common.sh@862 -- # return 0 00:20:56.417 05:16:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:56.417 05:16:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:56.417 05:16:58 -- common/autotest_common.sh@10 -- # set +x 00:20:56.417 05:16:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:56.417 05:16:58 -- target/tls.sh@216 -- # bdevperf_pid=3329938 00:20:56.417 05:16:58 -- target/tls.sh@217 -- # waitforlisten 3329938 /var/tmp/bdevperf.sock 00:20:56.417 05:16:58 -- common/autotest_common.sh@829 -- # '[' -z 3329938 ']' 00:20:56.417 05:16:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:56.417 05:16:58 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:20:56.417 05:16:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:56.417 05:16:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:56.417 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:56.417 05:16:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:56.417 05:16:58 -- target/tls.sh@213 -- # echo '{ 00:20:56.417 "subsystems": [ 00:20:56.417 { 00:20:56.417 "subsystem": "iobuf", 00:20:56.417 "config": [ 00:20:56.417 { 00:20:56.417 "method": "iobuf_set_options", 00:20:56.417 "params": { 00:20:56.417 "small_pool_count": 8192, 00:20:56.417 "large_pool_count": 1024, 00:20:56.417 "small_bufsize": 8192, 00:20:56.417 "large_bufsize": 135168 00:20:56.417 } 00:20:56.417 } 00:20:56.417 ] 00:20:56.417 }, 00:20:56.417 { 00:20:56.417 "subsystem": "sock", 00:20:56.417 "config": [ 00:20:56.417 { 00:20:56.417 "method": "sock_impl_set_options", 00:20:56.417 "params": { 00:20:56.417 "impl_name": "posix", 00:20:56.417 "recv_buf_size": 2097152, 00:20:56.417 "send_buf_size": 2097152, 00:20:56.417 "enable_recv_pipe": true, 00:20:56.417 "enable_quickack": false, 00:20:56.417 "enable_placement_id": 0, 00:20:56.417 "enable_zerocopy_send_server": true, 00:20:56.417 "enable_zerocopy_send_client": false, 00:20:56.417 "zerocopy_threshold": 0, 00:20:56.417 "tls_version": 0, 00:20:56.417 "enable_ktls": false 00:20:56.417 } 00:20:56.417 }, 00:20:56.417 { 00:20:56.417 "method": "sock_impl_set_options", 00:20:56.417 "params": { 00:20:56.417 "impl_name": "ssl", 00:20:56.417 "recv_buf_size": 4096, 00:20:56.417 "send_buf_size": 4096, 00:20:56.417 "enable_recv_pipe": true, 00:20:56.417 "enable_quickack": false, 00:20:56.417 "enable_placement_id": 0, 00:20:56.417 "enable_zerocopy_send_server": true, 00:20:56.417 "enable_zerocopy_send_client": false, 00:20:56.417 "zerocopy_threshold": 0, 00:20:56.417 "tls_version": 0, 00:20:56.417 "enable_ktls": false 00:20:56.417 } 00:20:56.417 } 00:20:56.417 ] 00:20:56.417 }, 00:20:56.417 { 00:20:56.417 "subsystem": "vmd", 00:20:56.417 "config": [] 00:20:56.417 }, 00:20:56.417 { 00:20:56.417 "subsystem": "accel", 00:20:56.417 "config": [ 00:20:56.417 { 00:20:56.418 "method": "accel_set_options", 00:20:56.418 "params": { 00:20:56.418 "small_cache_size": 128, 00:20:56.418 "large_cache_size": 16, 00:20:56.418 "task_count": 2048, 00:20:56.418 "sequence_count": 2048, 00:20:56.418 "buf_count": 2048 00:20:56.418 } 00:20:56.418 } 00:20:56.418 ] 00:20:56.418 }, 00:20:56.418 { 00:20:56.418 "subsystem": "bdev", 00:20:56.418 "config": [ 00:20:56.418 { 00:20:56.418 "method": "bdev_set_options", 00:20:56.418 "params": { 00:20:56.418 "bdev_io_pool_size": 65535, 00:20:56.418 "bdev_io_cache_size": 256, 00:20:56.418 "bdev_auto_examine": true, 00:20:56.418 "iobuf_small_cache_size": 128, 00:20:56.418 "iobuf_large_cache_size": 16 00:20:56.418 } 00:20:56.418 }, 00:20:56.418 { 00:20:56.418 "method": "bdev_raid_set_options", 00:20:56.418 "params": { 00:20:56.418 "process_window_size_kb": 1024 00:20:56.418 } 00:20:56.418 }, 00:20:56.418 { 00:20:56.418 "method": "bdev_iscsi_set_options", 00:20:56.418 "params": { 00:20:56.418 "timeout_sec": 30 00:20:56.418 } 00:20:56.418 }, 00:20:56.418 { 00:20:56.418 "method": "bdev_nvme_set_options", 00:20:56.418 "params": { 00:20:56.418 "action_on_timeout": "none", 00:20:56.418 "timeout_us": 0, 00:20:56.418 "timeout_admin_us": 0, 00:20:56.418 "keep_alive_timeout_ms": 10000, 00:20:56.418 "transport_retry_count": 4, 00:20:56.418 "arbitration_burst": 0, 00:20:56.418 "low_priority_weight": 0, 00:20:56.418 "medium_priority_weight": 0, 00:20:56.418 "high_priority_weight": 0, 00:20:56.418 "nvme_adminq_poll_period_us": 10000, 00:20:56.418 "nvme_ioq_poll_period_us": 0, 00:20:56.418 "io_queue_requests": 512, 00:20:56.418 "delay_cmd_submit": true, 00:20:56.418 "bdev_retry_count": 3, 00:20:56.418 "transport_ack_timeout": 0, 00:20:56.418 "ctrlr_loss_timeout_sec": 0, 00:20:56.418 "reconnect_delay_sec": 0, 00:20:56.418 "fast_io_fail_timeout_sec": 0, 00:20:56.418 "generate_uuids": false, 00:20:56.418 "transport_tos": 0, 00:20:56.418 "io_path_stat": false, 00:20:56.418 "allow_accel_sequence": false 00:20:56.418 } 00:20:56.418 }, 00:20:56.418 { 00:20:56.418 "method": "bdev_nvme_attach_controller", 00:20:56.418 "params": { 00:20:56.418 "name": "TLSTEST", 00:20:56.418 "trtype": "TCP", 00:20:56.418 "adrfam": "IPv4", 00:20:56.418 "traddr": "10.0.0.2", 00:20:56.418 "trsvcid": "4420", 00:20:56.418 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:56.418 "prchk_reftag": false, 00:20:56.418 "prchk_guard": false, 00:20:56.418 "ctrlr_loss_timeout_sec": 0, 00:20:56.418 "reconnect_delay_sec": 0, 00:20:56.418 "fast_io_fail_timeout_sec": 0, 00:20:56.418 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:56.418 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:56.418 "hdgst": false, 00:20:56.418 "ddgst": false 00:20:56.418 } 00:20:56.418 }, 00:20:56.418 { 00:20:56.418 "method": "bdev_nvme_set_hotplug", 00:20:56.418 "params": { 00:20:56.418 "period_us": 100000, 00:20:56.418 "enable": false 00:20:56.418 } 00:20:56.418 }, 00:20:56.418 { 00:20:56.418 "method": "bdev_wait_for_examine" 00:20:56.418 } 00:20:56.418 ] 00:20:56.418 }, 00:20:56.418 { 00:20:56.418 "subsystem": "nbd", 00:20:56.418 "config": [] 00:20:56.418 } 00:20:56.418 ] 00:20:56.418 }' 00:20:56.418 05:16:58 -- common/autotest_common.sh@10 -- # set +x 00:20:56.418 [2024-11-26 05:16:58.157610] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:56.418 [2024-11-26 05:16:58.157714] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329938 ] 00:20:56.678 EAL: No free 2048 kB hugepages reported on node 1 00:20:56.678 [2024-11-26 05:16:58.216574] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:56.678 [2024-11-26 05:16:58.300154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:56.938 [2024-11-26 05:16:58.459286] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:57.505 05:16:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:57.505 05:16:59 -- common/autotest_common.sh@862 -- # return 0 00:20:57.505 05:16:59 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:57.763 Running I/O for 10 seconds... 00:21:07.746 00:21:07.746 Latency(us) 00:21:07.746 [2024-11-26T04:17:09.514Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:07.746 [2024-11-26T04:17:09.514Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:07.746 Verification LBA range: start 0x0 length 0x2000 00:21:07.746 TLSTESTn1 : 10.02 3831.35 14.97 0.00 0.00 33364.31 7184.69 44079.03 00:21:07.746 [2024-11-26T04:17:09.514Z] =================================================================================================================== 00:21:07.746 [2024-11-26T04:17:09.514Z] Total : 3831.35 14.97 0.00 0.00 33364.31 7184.69 44079.03 00:21:07.746 0 00:21:07.746 05:17:09 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:07.746 05:17:09 -- target/tls.sh@223 -- # killprocess 3329938 00:21:07.746 05:17:09 -- common/autotest_common.sh@936 -- # '[' -z 3329938 ']' 00:21:07.746 05:17:09 -- common/autotest_common.sh@940 -- # kill -0 3329938 00:21:07.746 05:17:09 -- common/autotest_common.sh@941 -- # uname 00:21:07.746 05:17:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:07.746 05:17:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3329938 00:21:07.746 05:17:09 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:07.746 05:17:09 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:07.746 05:17:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3329938' 00:21:07.746 killing process with pid 3329938 00:21:07.746 05:17:09 -- common/autotest_common.sh@955 -- # kill 3329938 00:21:07.746 Received shutdown signal, test time was about 10.000000 seconds 00:21:07.746 00:21:07.746 Latency(us) 00:21:07.746 [2024-11-26T04:17:09.514Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:07.746 [2024-11-26T04:17:09.514Z] =================================================================================================================== 00:21:07.746 [2024-11-26T04:17:09.515Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:07.747 05:17:09 -- common/autotest_common.sh@960 -- # wait 3329938 00:21:08.007 05:17:09 -- target/tls.sh@224 -- # killprocess 3329783 00:21:08.007 05:17:09 -- common/autotest_common.sh@936 -- # '[' -z 3329783 ']' 00:21:08.007 05:17:09 -- common/autotest_common.sh@940 -- # kill -0 3329783 00:21:08.007 05:17:09 -- common/autotest_common.sh@941 -- # uname 00:21:08.007 05:17:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:08.007 05:17:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3329783 00:21:08.007 05:17:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:08.007 05:17:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:08.007 05:17:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3329783' 00:21:08.007 killing process with pid 3329783 00:21:08.007 05:17:09 -- common/autotest_common.sh@955 -- # kill 3329783 00:21:08.007 05:17:09 -- common/autotest_common.sh@960 -- # wait 3329783 00:21:08.267 05:17:09 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:21:08.267 05:17:09 -- target/tls.sh@227 -- # cleanup 00:21:08.267 05:17:09 -- target/tls.sh@15 -- # process_shm --id 0 00:21:08.267 05:17:09 -- common/autotest_common.sh@806 -- # type=--id 00:21:08.267 05:17:09 -- common/autotest_common.sh@807 -- # id=0 00:21:08.267 05:17:09 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:08.267 05:17:09 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:08.267 05:17:09 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:08.267 05:17:09 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:08.267 05:17:09 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:08.267 05:17:09 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:08.267 nvmf_trace.0 00:21:08.267 05:17:09 -- common/autotest_common.sh@821 -- # return 0 00:21:08.267 05:17:09 -- target/tls.sh@16 -- # killprocess 3329938 00:21:08.267 05:17:09 -- common/autotest_common.sh@936 -- # '[' -z 3329938 ']' 00:21:08.267 05:17:09 -- common/autotest_common.sh@940 -- # kill -0 3329938 00:21:08.267 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3329938) - No such process 00:21:08.267 05:17:09 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3329938 is not found' 00:21:08.267 Process with pid 3329938 is not found 00:21:08.267 05:17:09 -- target/tls.sh@17 -- # nvmftestfini 00:21:08.267 05:17:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:08.267 05:17:09 -- nvmf/common.sh@116 -- # sync 00:21:08.267 05:17:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:08.267 05:17:09 -- nvmf/common.sh@119 -- # set +e 00:21:08.267 05:17:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:08.267 05:17:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:08.267 rmmod nvme_tcp 00:21:08.267 rmmod nvme_fabrics 00:21:08.267 rmmod nvme_keyring 00:21:08.267 05:17:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:08.267 05:17:09 -- nvmf/common.sh@123 -- # set -e 00:21:08.267 05:17:09 -- nvmf/common.sh@124 -- # return 0 00:21:08.267 05:17:09 -- nvmf/common.sh@477 -- # '[' -n 3329783 ']' 00:21:08.267 05:17:09 -- nvmf/common.sh@478 -- # killprocess 3329783 00:21:08.268 05:17:09 -- common/autotest_common.sh@936 -- # '[' -z 3329783 ']' 00:21:08.268 05:17:09 -- common/autotest_common.sh@940 -- # kill -0 3329783 00:21:08.268 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3329783) - No such process 00:21:08.268 05:17:09 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3329783 is not found' 00:21:08.268 Process with pid 3329783 is not found 00:21:08.268 05:17:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:08.268 05:17:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:08.268 05:17:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:08.268 05:17:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:08.268 05:17:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:08.268 05:17:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:08.268 05:17:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:08.268 05:17:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:10.808 05:17:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:10.808 05:17:12 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:10.808 00:21:10.808 real 1m15.871s 00:21:10.808 user 1m58.300s 00:21:10.808 sys 0m24.737s 00:21:10.808 05:17:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:10.808 05:17:12 -- common/autotest_common.sh@10 -- # set +x 00:21:10.808 ************************************ 00:21:10.808 END TEST nvmf_tls 00:21:10.808 ************************************ 00:21:10.808 05:17:12 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:10.808 05:17:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:10.808 05:17:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:10.808 05:17:12 -- common/autotest_common.sh@10 -- # set +x 00:21:10.808 ************************************ 00:21:10.808 START TEST nvmf_fips 00:21:10.808 ************************************ 00:21:10.808 05:17:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:10.808 * Looking for test storage... 00:21:10.808 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:21:10.808 05:17:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:10.808 05:17:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:10.808 05:17:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:10.808 05:17:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:10.808 05:17:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:10.808 05:17:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:10.808 05:17:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:10.808 05:17:12 -- scripts/common.sh@335 -- # IFS=.-: 00:21:10.808 05:17:12 -- scripts/common.sh@335 -- # read -ra ver1 00:21:10.808 05:17:12 -- scripts/common.sh@336 -- # IFS=.-: 00:21:10.808 05:17:12 -- scripts/common.sh@336 -- # read -ra ver2 00:21:10.808 05:17:12 -- scripts/common.sh@337 -- # local 'op=<' 00:21:10.808 05:17:12 -- scripts/common.sh@339 -- # ver1_l=2 00:21:10.808 05:17:12 -- scripts/common.sh@340 -- # ver2_l=1 00:21:10.808 05:17:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:10.808 05:17:12 -- scripts/common.sh@343 -- # case "$op" in 00:21:10.808 05:17:12 -- scripts/common.sh@344 -- # : 1 00:21:10.808 05:17:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:10.808 05:17:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:10.808 05:17:12 -- scripts/common.sh@364 -- # decimal 1 00:21:10.808 05:17:12 -- scripts/common.sh@352 -- # local d=1 00:21:10.808 05:17:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:10.808 05:17:12 -- scripts/common.sh@354 -- # echo 1 00:21:10.808 05:17:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:10.808 05:17:12 -- scripts/common.sh@365 -- # decimal 2 00:21:10.808 05:17:12 -- scripts/common.sh@352 -- # local d=2 00:21:10.808 05:17:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:10.808 05:17:12 -- scripts/common.sh@354 -- # echo 2 00:21:10.808 05:17:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:10.808 05:17:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:10.808 05:17:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:10.808 05:17:12 -- scripts/common.sh@367 -- # return 0 00:21:10.808 05:17:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:10.808 05:17:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:10.808 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:10.808 --rc genhtml_branch_coverage=1 00:21:10.808 --rc genhtml_function_coverage=1 00:21:10.808 --rc genhtml_legend=1 00:21:10.808 --rc geninfo_all_blocks=1 00:21:10.808 --rc geninfo_unexecuted_blocks=1 00:21:10.808 00:21:10.808 ' 00:21:10.808 05:17:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:10.808 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:10.808 --rc genhtml_branch_coverage=1 00:21:10.808 --rc genhtml_function_coverage=1 00:21:10.808 --rc genhtml_legend=1 00:21:10.808 --rc geninfo_all_blocks=1 00:21:10.808 --rc geninfo_unexecuted_blocks=1 00:21:10.808 00:21:10.808 ' 00:21:10.808 05:17:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:10.808 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:10.808 --rc genhtml_branch_coverage=1 00:21:10.808 --rc genhtml_function_coverage=1 00:21:10.808 --rc genhtml_legend=1 00:21:10.808 --rc geninfo_all_blocks=1 00:21:10.808 --rc geninfo_unexecuted_blocks=1 00:21:10.808 00:21:10.808 ' 00:21:10.808 05:17:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:10.808 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:10.808 --rc genhtml_branch_coverage=1 00:21:10.808 --rc genhtml_function_coverage=1 00:21:10.808 --rc genhtml_legend=1 00:21:10.808 --rc geninfo_all_blocks=1 00:21:10.808 --rc geninfo_unexecuted_blocks=1 00:21:10.808 00:21:10.808 ' 00:21:10.808 05:17:12 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:10.808 05:17:12 -- nvmf/common.sh@7 -- # uname -s 00:21:10.808 05:17:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:10.808 05:17:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:10.808 05:17:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:10.808 05:17:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:10.808 05:17:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:10.808 05:17:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:10.808 05:17:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:10.808 05:17:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:10.808 05:17:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:10.808 05:17:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:10.808 05:17:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:10.808 05:17:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:10.808 05:17:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:10.808 05:17:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:10.808 05:17:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:10.808 05:17:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:10.808 05:17:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:10.808 05:17:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:10.808 05:17:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:10.808 05:17:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:10.808 05:17:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:10.808 05:17:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:10.808 05:17:12 -- paths/export.sh@5 -- # export PATH 00:21:10.808 05:17:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:10.808 05:17:12 -- nvmf/common.sh@46 -- # : 0 00:21:10.808 05:17:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:10.808 05:17:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:10.808 05:17:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:10.808 05:17:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:10.808 05:17:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:10.808 05:17:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:10.808 05:17:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:10.808 05:17:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:10.808 05:17:12 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:10.808 05:17:12 -- fips/fips.sh@89 -- # check_openssl_version 00:21:10.808 05:17:12 -- fips/fips.sh@83 -- # local target=3.0.0 00:21:10.808 05:17:12 -- fips/fips.sh@85 -- # openssl version 00:21:10.808 05:17:12 -- fips/fips.sh@85 -- # awk '{print $2}' 00:21:10.808 05:17:12 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:21:10.808 05:17:12 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:10.808 05:17:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:10.808 05:17:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:10.808 05:17:12 -- scripts/common.sh@335 -- # IFS=.-: 00:21:10.808 05:17:12 -- scripts/common.sh@335 -- # read -ra ver1 00:21:10.808 05:17:12 -- scripts/common.sh@336 -- # IFS=.-: 00:21:10.808 05:17:12 -- scripts/common.sh@336 -- # read -ra ver2 00:21:10.809 05:17:12 -- scripts/common.sh@337 -- # local 'op=>=' 00:21:10.809 05:17:12 -- scripts/common.sh@339 -- # ver1_l=3 00:21:10.809 05:17:12 -- scripts/common.sh@340 -- # ver2_l=3 00:21:10.809 05:17:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:10.809 05:17:12 -- scripts/common.sh@343 -- # case "$op" in 00:21:10.809 05:17:12 -- scripts/common.sh@347 -- # : 1 00:21:10.809 05:17:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:10.809 05:17:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:10.809 05:17:12 -- scripts/common.sh@364 -- # decimal 3 00:21:10.809 05:17:12 -- scripts/common.sh@352 -- # local d=3 00:21:10.809 05:17:12 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:10.809 05:17:12 -- scripts/common.sh@354 -- # echo 3 00:21:10.809 05:17:12 -- scripts/common.sh@364 -- # ver1[v]=3 00:21:10.809 05:17:12 -- scripts/common.sh@365 -- # decimal 3 00:21:10.809 05:17:12 -- scripts/common.sh@352 -- # local d=3 00:21:10.809 05:17:12 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:10.809 05:17:12 -- scripts/common.sh@354 -- # echo 3 00:21:10.809 05:17:12 -- scripts/common.sh@365 -- # ver2[v]=3 00:21:10.809 05:17:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:10.809 05:17:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:10.809 05:17:12 -- scripts/common.sh@363 -- # (( v++ )) 00:21:10.809 05:17:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:10.809 05:17:12 -- scripts/common.sh@364 -- # decimal 1 00:21:10.809 05:17:12 -- scripts/common.sh@352 -- # local d=1 00:21:10.809 05:17:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:10.809 05:17:12 -- scripts/common.sh@354 -- # echo 1 00:21:10.809 05:17:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:10.809 05:17:12 -- scripts/common.sh@365 -- # decimal 0 00:21:10.809 05:17:12 -- scripts/common.sh@352 -- # local d=0 00:21:10.809 05:17:12 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:10.809 05:17:12 -- scripts/common.sh@354 -- # echo 0 00:21:10.809 05:17:12 -- scripts/common.sh@365 -- # ver2[v]=0 00:21:10.809 05:17:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:10.809 05:17:12 -- scripts/common.sh@366 -- # return 0 00:21:10.809 05:17:12 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:21:10.809 05:17:12 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:10.809 05:17:12 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:21:10.809 05:17:12 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:10.809 05:17:12 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:10.809 05:17:12 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:21:10.809 05:17:12 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:21:10.809 05:17:12 -- fips/fips.sh@113 -- # build_openssl_config 00:21:10.809 05:17:12 -- fips/fips.sh@37 -- # cat 00:21:10.809 05:17:12 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:21:10.809 05:17:12 -- fips/fips.sh@58 -- # cat - 00:21:10.809 05:17:12 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:10.809 05:17:12 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:21:10.809 05:17:12 -- fips/fips.sh@116 -- # mapfile -t providers 00:21:10.809 05:17:12 -- fips/fips.sh@116 -- # openssl list -providers 00:21:10.809 05:17:12 -- fips/fips.sh@116 -- # grep name 00:21:10.809 05:17:12 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:21:10.809 05:17:12 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:21:10.809 05:17:12 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:10.809 05:17:12 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:21:10.809 05:17:12 -- fips/fips.sh@127 -- # : 00:21:10.809 05:17:12 -- common/autotest_common.sh@650 -- # local es=0 00:21:10.809 05:17:12 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:10.809 05:17:12 -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:10.809 05:17:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:10.809 05:17:12 -- common/autotest_common.sh@642 -- # type -t openssl 00:21:10.809 05:17:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:10.809 05:17:12 -- common/autotest_common.sh@644 -- # type -P openssl 00:21:10.809 05:17:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:10.809 05:17:12 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:10.809 05:17:12 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:10.809 05:17:12 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:10.809 Error setting digest 00:21:10.809 4072F095537F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:10.809 4072F095537F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:10.809 05:17:12 -- common/autotest_common.sh@653 -- # es=1 00:21:10.809 05:17:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:10.809 05:17:12 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:10.809 05:17:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:10.809 05:17:12 -- fips/fips.sh@130 -- # nvmftestinit 00:21:10.809 05:17:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:10.809 05:17:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:10.809 05:17:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:10.809 05:17:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:10.809 05:17:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:10.809 05:17:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:10.809 05:17:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:10.809 05:17:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:10.809 05:17:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:10.809 05:17:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:10.809 05:17:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:10.809 05:17:12 -- common/autotest_common.sh@10 -- # set +x 00:21:12.712 05:17:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:12.712 05:17:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:12.712 05:17:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:12.712 05:17:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:12.712 05:17:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:12.712 05:17:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:12.712 05:17:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:12.712 05:17:14 -- nvmf/common.sh@294 -- # net_devs=() 00:21:12.712 05:17:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:12.712 05:17:14 -- nvmf/common.sh@295 -- # e810=() 00:21:12.712 05:17:14 -- nvmf/common.sh@295 -- # local -ga e810 00:21:12.712 05:17:14 -- nvmf/common.sh@296 -- # x722=() 00:21:12.712 05:17:14 -- nvmf/common.sh@296 -- # local -ga x722 00:21:12.712 05:17:14 -- nvmf/common.sh@297 -- # mlx=() 00:21:12.712 05:17:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:12.712 05:17:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:12.712 05:17:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:12.712 05:17:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:12.712 05:17:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:12.712 05:17:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:12.712 05:17:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:12.712 05:17:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:12.712 05:17:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:12.712 05:17:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:12.712 05:17:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:12.712 05:17:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:12.712 05:17:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:12.712 05:17:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:12.712 05:17:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:12.712 05:17:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:12.712 05:17:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:12.712 05:17:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:12.713 05:17:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:12.713 05:17:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:12.713 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:12.713 05:17:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:12.713 05:17:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:12.713 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:12.713 05:17:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:12.713 05:17:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:12.713 05:17:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:12.713 05:17:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:12.713 05:17:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:12.713 05:17:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:12.713 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:12.713 05:17:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:12.713 05:17:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:12.713 05:17:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:12.713 05:17:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:12.713 05:17:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:12.713 05:17:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:12.713 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:12.713 05:17:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:12.713 05:17:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:12.713 05:17:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:12.713 05:17:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:12.713 05:17:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:12.713 05:17:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:12.713 05:17:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:12.713 05:17:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:12.713 05:17:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:12.713 05:17:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:12.713 05:17:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:12.713 05:17:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:12.713 05:17:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:12.713 05:17:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:12.713 05:17:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:12.713 05:17:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:12.713 05:17:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:12.713 05:17:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:12.713 05:17:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:12.713 05:17:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:12.713 05:17:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:12.713 05:17:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:12.973 05:17:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:12.973 05:17:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:12.973 05:17:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:12.973 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:12.973 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.173 ms 00:21:12.973 00:21:12.973 --- 10.0.0.2 ping statistics --- 00:21:12.973 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:12.973 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:21:12.973 05:17:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:12.973 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:12.973 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:21:12.973 00:21:12.973 --- 10.0.0.1 ping statistics --- 00:21:12.973 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:12.973 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:21:12.973 05:17:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:12.973 05:17:14 -- nvmf/common.sh@410 -- # return 0 00:21:12.973 05:17:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:12.973 05:17:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:12.973 05:17:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:12.973 05:17:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:12.973 05:17:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:12.973 05:17:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:12.973 05:17:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:12.973 05:17:14 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:12.973 05:17:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:12.973 05:17:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:12.973 05:17:14 -- common/autotest_common.sh@10 -- # set +x 00:21:12.973 05:17:14 -- nvmf/common.sh@469 -- # nvmfpid=3333398 00:21:12.973 05:17:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:12.973 05:17:14 -- nvmf/common.sh@470 -- # waitforlisten 3333398 00:21:12.973 05:17:14 -- common/autotest_common.sh@829 -- # '[' -z 3333398 ']' 00:21:12.973 05:17:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:12.973 05:17:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:12.973 05:17:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:12.973 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:12.973 05:17:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:12.973 05:17:14 -- common/autotest_common.sh@10 -- # set +x 00:21:12.973 [2024-11-26 05:17:14.615222] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:12.973 [2024-11-26 05:17:14.615290] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:12.973 EAL: No free 2048 kB hugepages reported on node 1 00:21:12.974 [2024-11-26 05:17:14.682129] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:13.234 [2024-11-26 05:17:14.774037] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:13.234 [2024-11-26 05:17:14.774214] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:13.234 [2024-11-26 05:17:14.774231] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:13.234 [2024-11-26 05:17:14.774244] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:13.234 [2024-11-26 05:17:14.774290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:14.172 05:17:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:14.172 05:17:15 -- common/autotest_common.sh@862 -- # return 0 00:21:14.172 05:17:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:14.172 05:17:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:14.172 05:17:15 -- common/autotest_common.sh@10 -- # set +x 00:21:14.172 05:17:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:14.172 05:17:15 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:14.172 05:17:15 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:14.172 05:17:15 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:14.172 05:17:15 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:14.172 05:17:15 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:14.172 05:17:15 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:14.172 05:17:15 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:14.172 05:17:15 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:14.431 [2024-11-26 05:17:15.949815] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:14.431 [2024-11-26 05:17:15.965792] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:14.431 [2024-11-26 05:17:15.966086] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:14.431 malloc0 00:21:14.431 05:17:16 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:14.431 05:17:16 -- fips/fips.sh@147 -- # bdevperf_pid=3333563 00:21:14.431 05:17:16 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:14.431 05:17:16 -- fips/fips.sh@148 -- # waitforlisten 3333563 /var/tmp/bdevperf.sock 00:21:14.431 05:17:16 -- common/autotest_common.sh@829 -- # '[' -z 3333563 ']' 00:21:14.431 05:17:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:14.431 05:17:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:14.431 05:17:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:14.431 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:14.431 05:17:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:14.431 05:17:16 -- common/autotest_common.sh@10 -- # set +x 00:21:14.431 [2024-11-26 05:17:16.086308] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:14.431 [2024-11-26 05:17:16.086387] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3333563 ] 00:21:14.431 EAL: No free 2048 kB hugepages reported on node 1 00:21:14.431 [2024-11-26 05:17:16.144590] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:14.691 [2024-11-26 05:17:16.229313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:15.629 05:17:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:15.629 05:17:17 -- common/autotest_common.sh@862 -- # return 0 00:21:15.629 05:17:17 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:15.629 [2024-11-26 05:17:17.336864] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:15.890 TLSTESTn1 00:21:15.890 05:17:17 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:15.890 Running I/O for 10 seconds... 00:21:25.872 00:21:25.872 Latency(us) 00:21:25.872 [2024-11-26T04:17:27.640Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:25.872 [2024-11-26T04:17:27.640Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:25.872 Verification LBA range: start 0x0 length 0x2000 00:21:25.872 TLSTESTn1 : 10.02 4414.01 17.24 0.00 0.00 28958.08 5072.97 42913.94 00:21:25.872 [2024-11-26T04:17:27.640Z] =================================================================================================================== 00:21:25.872 [2024-11-26T04:17:27.640Z] Total : 4414.01 17.24 0.00 0.00 28958.08 5072.97 42913.94 00:21:25.872 0 00:21:25.872 05:17:27 -- fips/fips.sh@1 -- # cleanup 00:21:25.872 05:17:27 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:25.872 05:17:27 -- common/autotest_common.sh@806 -- # type=--id 00:21:25.872 05:17:27 -- common/autotest_common.sh@807 -- # id=0 00:21:25.872 05:17:27 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:25.872 05:17:27 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:25.872 05:17:27 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:25.872 05:17:27 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:25.872 05:17:27 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:25.872 05:17:27 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:25.872 nvmf_trace.0 00:21:25.872 05:17:27 -- common/autotest_common.sh@821 -- # return 0 00:21:25.872 05:17:27 -- fips/fips.sh@16 -- # killprocess 3333563 00:21:25.872 05:17:27 -- common/autotest_common.sh@936 -- # '[' -z 3333563 ']' 00:21:25.872 05:17:27 -- common/autotest_common.sh@940 -- # kill -0 3333563 00:21:25.872 05:17:27 -- common/autotest_common.sh@941 -- # uname 00:21:25.872 05:17:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:25.872 05:17:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3333563 00:21:26.130 05:17:27 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:26.130 05:17:27 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:26.130 05:17:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3333563' 00:21:26.130 killing process with pid 3333563 00:21:26.130 05:17:27 -- common/autotest_common.sh@955 -- # kill 3333563 00:21:26.130 Received shutdown signal, test time was about 10.000000 seconds 00:21:26.130 00:21:26.130 Latency(us) 00:21:26.130 [2024-11-26T04:17:27.898Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:26.130 [2024-11-26T04:17:27.898Z] =================================================================================================================== 00:21:26.130 [2024-11-26T04:17:27.898Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:26.130 05:17:27 -- common/autotest_common.sh@960 -- # wait 3333563 00:21:26.130 05:17:27 -- fips/fips.sh@17 -- # nvmftestfini 00:21:26.130 05:17:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:26.130 05:17:27 -- nvmf/common.sh@116 -- # sync 00:21:26.130 05:17:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:26.130 05:17:27 -- nvmf/common.sh@119 -- # set +e 00:21:26.130 05:17:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:26.130 05:17:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:26.130 rmmod nvme_tcp 00:21:26.130 rmmod nvme_fabrics 00:21:26.389 rmmod nvme_keyring 00:21:26.389 05:17:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:26.389 05:17:27 -- nvmf/common.sh@123 -- # set -e 00:21:26.389 05:17:27 -- nvmf/common.sh@124 -- # return 0 00:21:26.389 05:17:27 -- nvmf/common.sh@477 -- # '[' -n 3333398 ']' 00:21:26.389 05:17:27 -- nvmf/common.sh@478 -- # killprocess 3333398 00:21:26.389 05:17:27 -- common/autotest_common.sh@936 -- # '[' -z 3333398 ']' 00:21:26.389 05:17:27 -- common/autotest_common.sh@940 -- # kill -0 3333398 00:21:26.389 05:17:27 -- common/autotest_common.sh@941 -- # uname 00:21:26.389 05:17:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:26.389 05:17:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3333398 00:21:26.389 05:17:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:26.389 05:17:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:26.389 05:17:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3333398' 00:21:26.389 killing process with pid 3333398 00:21:26.389 05:17:27 -- common/autotest_common.sh@955 -- # kill 3333398 00:21:26.389 05:17:27 -- common/autotest_common.sh@960 -- # wait 3333398 00:21:26.649 05:17:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:26.649 05:17:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:26.649 05:17:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:26.649 05:17:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:26.649 05:17:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:26.649 05:17:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:26.649 05:17:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:26.649 05:17:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:28.560 05:17:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:28.560 05:17:30 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:28.560 00:21:28.560 real 0m18.197s 00:21:28.560 user 0m23.869s 00:21:28.560 sys 0m6.000s 00:21:28.560 05:17:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:28.560 05:17:30 -- common/autotest_common.sh@10 -- # set +x 00:21:28.560 ************************************ 00:21:28.560 END TEST nvmf_fips 00:21:28.560 ************************************ 00:21:28.560 05:17:30 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:28.560 05:17:30 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:28.560 05:17:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:28.560 05:17:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:28.560 05:17:30 -- common/autotest_common.sh@10 -- # set +x 00:21:28.560 ************************************ 00:21:28.560 START TEST nvmf_fuzz 00:21:28.560 ************************************ 00:21:28.560 05:17:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:28.819 * Looking for test storage... 00:21:28.819 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:28.819 05:17:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:28.819 05:17:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:28.819 05:17:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:28.819 05:17:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:28.819 05:17:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:28.819 05:17:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:28.819 05:17:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:28.819 05:17:30 -- scripts/common.sh@335 -- # IFS=.-: 00:21:28.819 05:17:30 -- scripts/common.sh@335 -- # read -ra ver1 00:21:28.819 05:17:30 -- scripts/common.sh@336 -- # IFS=.-: 00:21:28.819 05:17:30 -- scripts/common.sh@336 -- # read -ra ver2 00:21:28.819 05:17:30 -- scripts/common.sh@337 -- # local 'op=<' 00:21:28.819 05:17:30 -- scripts/common.sh@339 -- # ver1_l=2 00:21:28.819 05:17:30 -- scripts/common.sh@340 -- # ver2_l=1 00:21:28.819 05:17:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:28.819 05:17:30 -- scripts/common.sh@343 -- # case "$op" in 00:21:28.819 05:17:30 -- scripts/common.sh@344 -- # : 1 00:21:28.819 05:17:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:28.819 05:17:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:28.819 05:17:30 -- scripts/common.sh@364 -- # decimal 1 00:21:28.819 05:17:30 -- scripts/common.sh@352 -- # local d=1 00:21:28.819 05:17:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:28.819 05:17:30 -- scripts/common.sh@354 -- # echo 1 00:21:28.819 05:17:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:28.819 05:17:30 -- scripts/common.sh@365 -- # decimal 2 00:21:28.819 05:17:30 -- scripts/common.sh@352 -- # local d=2 00:21:28.819 05:17:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:28.819 05:17:30 -- scripts/common.sh@354 -- # echo 2 00:21:28.819 05:17:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:28.819 05:17:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:28.819 05:17:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:28.819 05:17:30 -- scripts/common.sh@367 -- # return 0 00:21:28.819 05:17:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:28.819 05:17:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:28.819 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:28.819 --rc genhtml_branch_coverage=1 00:21:28.819 --rc genhtml_function_coverage=1 00:21:28.819 --rc genhtml_legend=1 00:21:28.819 --rc geninfo_all_blocks=1 00:21:28.819 --rc geninfo_unexecuted_blocks=1 00:21:28.819 00:21:28.819 ' 00:21:28.819 05:17:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:28.819 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:28.819 --rc genhtml_branch_coverage=1 00:21:28.819 --rc genhtml_function_coverage=1 00:21:28.819 --rc genhtml_legend=1 00:21:28.819 --rc geninfo_all_blocks=1 00:21:28.819 --rc geninfo_unexecuted_blocks=1 00:21:28.819 00:21:28.819 ' 00:21:28.819 05:17:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:28.819 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:28.819 --rc genhtml_branch_coverage=1 00:21:28.819 --rc genhtml_function_coverage=1 00:21:28.819 --rc genhtml_legend=1 00:21:28.819 --rc geninfo_all_blocks=1 00:21:28.819 --rc geninfo_unexecuted_blocks=1 00:21:28.819 00:21:28.819 ' 00:21:28.819 05:17:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:28.819 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:28.819 --rc genhtml_branch_coverage=1 00:21:28.819 --rc genhtml_function_coverage=1 00:21:28.819 --rc genhtml_legend=1 00:21:28.819 --rc geninfo_all_blocks=1 00:21:28.819 --rc geninfo_unexecuted_blocks=1 00:21:28.819 00:21:28.819 ' 00:21:28.819 05:17:30 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:28.819 05:17:30 -- nvmf/common.sh@7 -- # uname -s 00:21:28.819 05:17:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:28.819 05:17:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:28.819 05:17:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:28.819 05:17:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:28.819 05:17:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:28.819 05:17:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:28.819 05:17:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:28.819 05:17:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:28.819 05:17:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:28.819 05:17:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:28.819 05:17:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:28.819 05:17:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:28.819 05:17:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:28.819 05:17:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:28.819 05:17:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:28.819 05:17:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:28.819 05:17:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:28.819 05:17:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:28.819 05:17:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:28.820 05:17:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:28.820 05:17:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:28.820 05:17:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:28.820 05:17:30 -- paths/export.sh@5 -- # export PATH 00:21:28.820 05:17:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:28.820 05:17:30 -- nvmf/common.sh@46 -- # : 0 00:21:28.820 05:17:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:28.820 05:17:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:28.820 05:17:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:28.820 05:17:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:28.820 05:17:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:28.820 05:17:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:28.820 05:17:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:28.820 05:17:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:28.820 05:17:30 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:28.820 05:17:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:28.820 05:17:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:28.820 05:17:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:28.820 05:17:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:28.820 05:17:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:28.820 05:17:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:28.820 05:17:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:28.820 05:17:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:28.820 05:17:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:28.820 05:17:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:28.820 05:17:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:28.820 05:17:30 -- common/autotest_common.sh@10 -- # set +x 00:21:30.722 05:17:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:30.722 05:17:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:30.722 05:17:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:30.722 05:17:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:30.722 05:17:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:30.722 05:17:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:30.722 05:17:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:30.722 05:17:32 -- nvmf/common.sh@294 -- # net_devs=() 00:21:30.722 05:17:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:30.722 05:17:32 -- nvmf/common.sh@295 -- # e810=() 00:21:30.722 05:17:32 -- nvmf/common.sh@295 -- # local -ga e810 00:21:30.722 05:17:32 -- nvmf/common.sh@296 -- # x722=() 00:21:30.722 05:17:32 -- nvmf/common.sh@296 -- # local -ga x722 00:21:30.722 05:17:32 -- nvmf/common.sh@297 -- # mlx=() 00:21:30.722 05:17:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:30.722 05:17:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:30.722 05:17:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:30.722 05:17:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:30.722 05:17:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:30.723 05:17:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:30.723 05:17:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:30.723 05:17:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:30.723 05:17:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:30.723 05:17:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:30.723 05:17:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:30.723 05:17:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:30.723 05:17:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:30.723 05:17:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:30.723 05:17:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:30.723 05:17:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:30.723 05:17:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:30.723 05:17:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:30.723 05:17:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:30.723 05:17:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:30.723 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:30.723 05:17:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:30.723 05:17:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:30.723 05:17:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:30.723 05:17:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:30.723 05:17:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:30.723 05:17:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:30.723 05:17:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:30.723 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:30.723 05:17:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:30.723 05:17:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:30.723 05:17:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:30.723 05:17:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:30.723 05:17:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:30.981 05:17:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:30.981 05:17:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:30.982 05:17:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:30.982 05:17:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:30.982 05:17:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:30.982 05:17:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:30.982 05:17:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:30.982 05:17:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:30.982 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:30.982 05:17:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:30.982 05:17:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:30.982 05:17:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:30.982 05:17:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:30.982 05:17:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:30.982 05:17:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:30.982 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:30.982 05:17:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:30.982 05:17:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:30.982 05:17:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:30.982 05:17:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:30.982 05:17:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:30.982 05:17:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:30.982 05:17:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:30.982 05:17:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:30.982 05:17:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:30.982 05:17:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:30.982 05:17:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:30.982 05:17:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:30.982 05:17:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:30.982 05:17:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:30.982 05:17:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:30.982 05:17:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:30.982 05:17:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:30.982 05:17:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:30.982 05:17:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:30.982 05:17:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:30.982 05:17:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:30.982 05:17:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:30.982 05:17:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:30.982 05:17:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:30.982 05:17:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:30.982 05:17:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:30.982 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:30.982 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:21:30.982 00:21:30.982 --- 10.0.0.2 ping statistics --- 00:21:30.982 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:30.982 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:21:30.982 05:17:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:30.982 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:30.982 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:21:30.982 00:21:30.982 --- 10.0.0.1 ping statistics --- 00:21:30.982 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:30.982 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:21:30.982 05:17:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:30.982 05:17:32 -- nvmf/common.sh@410 -- # return 0 00:21:30.982 05:17:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:30.982 05:17:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:30.982 05:17:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:30.982 05:17:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:30.982 05:17:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:30.982 05:17:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:30.982 05:17:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:30.982 05:17:32 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=3336955 00:21:30.982 05:17:32 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:30.982 05:17:32 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:30.982 05:17:32 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 3336955 00:21:30.982 05:17:32 -- common/autotest_common.sh@829 -- # '[' -z 3336955 ']' 00:21:30.982 05:17:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:30.982 05:17:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:30.982 05:17:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:30.982 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:30.982 05:17:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:30.982 05:17:32 -- common/autotest_common.sh@10 -- # set +x 00:21:31.919 05:17:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:31.919 05:17:33 -- common/autotest_common.sh@862 -- # return 0 00:21:31.919 05:17:33 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:31.919 05:17:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:31.919 05:17:33 -- common/autotest_common.sh@10 -- # set +x 00:21:32.179 05:17:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.179 05:17:33 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:32.179 05:17:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:32.179 05:17:33 -- common/autotest_common.sh@10 -- # set +x 00:21:32.179 Malloc0 00:21:32.179 05:17:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.179 05:17:33 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:32.179 05:17:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:32.179 05:17:33 -- common/autotest_common.sh@10 -- # set +x 00:21:32.179 05:17:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.179 05:17:33 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:32.179 05:17:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:32.179 05:17:33 -- common/autotest_common.sh@10 -- # set +x 00:21:32.179 05:17:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.179 05:17:33 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:32.179 05:17:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:32.179 05:17:33 -- common/autotest_common.sh@10 -- # set +x 00:21:32.179 05:17:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.179 05:17:33 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:32.179 05:17:33 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:22:04.306 Fuzzing completed. Shutting down the fuzz application 00:22:04.306 00:22:04.306 Dumping successful admin opcodes: 00:22:04.306 8, 9, 10, 24, 00:22:04.306 Dumping successful io opcodes: 00:22:04.306 0, 9, 00:22:04.306 NS: 0x200003aeff00 I/O qp, Total commands completed: 475050, total successful commands: 2743, random_seed: 3012659392 00:22:04.306 NS: 0x200003aeff00 admin qp, Total commands completed: 57456, total successful commands: 459, random_seed: 499390016 00:22:04.306 05:18:04 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:22:04.306 Fuzzing completed. Shutting down the fuzz application 00:22:04.306 00:22:04.306 Dumping successful admin opcodes: 00:22:04.306 24, 00:22:04.306 Dumping successful io opcodes: 00:22:04.306 00:22:04.306 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1870003189 00:22:04.306 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1870105432 00:22:04.306 05:18:05 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:04.306 05:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.307 05:18:05 -- common/autotest_common.sh@10 -- # set +x 00:22:04.307 05:18:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.307 05:18:05 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:22:04.307 05:18:05 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:22:04.307 05:18:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:04.307 05:18:05 -- nvmf/common.sh@116 -- # sync 00:22:04.307 05:18:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:04.307 05:18:05 -- nvmf/common.sh@119 -- # set +e 00:22:04.307 05:18:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:04.307 05:18:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:04.307 rmmod nvme_tcp 00:22:04.307 rmmod nvme_fabrics 00:22:04.307 rmmod nvme_keyring 00:22:04.307 05:18:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:04.307 05:18:05 -- nvmf/common.sh@123 -- # set -e 00:22:04.307 05:18:05 -- nvmf/common.sh@124 -- # return 0 00:22:04.307 05:18:05 -- nvmf/common.sh@477 -- # '[' -n 3336955 ']' 00:22:04.307 05:18:05 -- nvmf/common.sh@478 -- # killprocess 3336955 00:22:04.307 05:18:05 -- common/autotest_common.sh@936 -- # '[' -z 3336955 ']' 00:22:04.307 05:18:05 -- common/autotest_common.sh@940 -- # kill -0 3336955 00:22:04.307 05:18:05 -- common/autotest_common.sh@941 -- # uname 00:22:04.307 05:18:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:04.307 05:18:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3336955 00:22:04.307 05:18:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:04.307 05:18:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:04.307 05:18:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3336955' 00:22:04.307 killing process with pid 3336955 00:22:04.307 05:18:05 -- common/autotest_common.sh@955 -- # kill 3336955 00:22:04.307 05:18:05 -- common/autotest_common.sh@960 -- # wait 3336955 00:22:04.307 05:18:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:04.307 05:18:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:04.307 05:18:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:04.307 05:18:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:04.307 05:18:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:04.307 05:18:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:04.307 05:18:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:04.307 05:18:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:06.864 05:18:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:06.864 05:18:08 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:22:06.864 00:22:06.864 real 0m37.748s 00:22:06.864 user 0m52.128s 00:22:06.864 sys 0m15.109s 00:22:06.864 05:18:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:06.864 05:18:08 -- common/autotest_common.sh@10 -- # set +x 00:22:06.864 ************************************ 00:22:06.864 END TEST nvmf_fuzz 00:22:06.864 ************************************ 00:22:06.864 05:18:08 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:06.864 05:18:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:06.864 05:18:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:06.864 05:18:08 -- common/autotest_common.sh@10 -- # set +x 00:22:06.864 ************************************ 00:22:06.864 START TEST nvmf_multiconnection 00:22:06.864 ************************************ 00:22:06.864 05:18:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:06.864 * Looking for test storage... 00:22:06.864 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:06.864 05:18:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:06.864 05:18:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:06.864 05:18:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:06.864 05:18:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:06.864 05:18:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:06.864 05:18:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:06.864 05:18:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:06.864 05:18:08 -- scripts/common.sh@335 -- # IFS=.-: 00:22:06.864 05:18:08 -- scripts/common.sh@335 -- # read -ra ver1 00:22:06.864 05:18:08 -- scripts/common.sh@336 -- # IFS=.-: 00:22:06.864 05:18:08 -- scripts/common.sh@336 -- # read -ra ver2 00:22:06.864 05:18:08 -- scripts/common.sh@337 -- # local 'op=<' 00:22:06.864 05:18:08 -- scripts/common.sh@339 -- # ver1_l=2 00:22:06.864 05:18:08 -- scripts/common.sh@340 -- # ver2_l=1 00:22:06.864 05:18:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:06.864 05:18:08 -- scripts/common.sh@343 -- # case "$op" in 00:22:06.864 05:18:08 -- scripts/common.sh@344 -- # : 1 00:22:06.864 05:18:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:06.864 05:18:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:06.864 05:18:08 -- scripts/common.sh@364 -- # decimal 1 00:22:06.864 05:18:08 -- scripts/common.sh@352 -- # local d=1 00:22:06.864 05:18:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:06.864 05:18:08 -- scripts/common.sh@354 -- # echo 1 00:22:06.864 05:18:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:06.864 05:18:08 -- scripts/common.sh@365 -- # decimal 2 00:22:06.864 05:18:08 -- scripts/common.sh@352 -- # local d=2 00:22:06.864 05:18:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:06.864 05:18:08 -- scripts/common.sh@354 -- # echo 2 00:22:06.864 05:18:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:06.864 05:18:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:06.864 05:18:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:06.864 05:18:08 -- scripts/common.sh@367 -- # return 0 00:22:06.864 05:18:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:06.864 05:18:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:06.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:06.864 --rc genhtml_branch_coverage=1 00:22:06.864 --rc genhtml_function_coverage=1 00:22:06.864 --rc genhtml_legend=1 00:22:06.864 --rc geninfo_all_blocks=1 00:22:06.864 --rc geninfo_unexecuted_blocks=1 00:22:06.864 00:22:06.864 ' 00:22:06.864 05:18:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:06.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:06.864 --rc genhtml_branch_coverage=1 00:22:06.864 --rc genhtml_function_coverage=1 00:22:06.864 --rc genhtml_legend=1 00:22:06.864 --rc geninfo_all_blocks=1 00:22:06.864 --rc geninfo_unexecuted_blocks=1 00:22:06.864 00:22:06.864 ' 00:22:06.864 05:18:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:06.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:06.864 --rc genhtml_branch_coverage=1 00:22:06.864 --rc genhtml_function_coverage=1 00:22:06.864 --rc genhtml_legend=1 00:22:06.864 --rc geninfo_all_blocks=1 00:22:06.864 --rc geninfo_unexecuted_blocks=1 00:22:06.864 00:22:06.864 ' 00:22:06.864 05:18:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:06.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:06.864 --rc genhtml_branch_coverage=1 00:22:06.864 --rc genhtml_function_coverage=1 00:22:06.864 --rc genhtml_legend=1 00:22:06.864 --rc geninfo_all_blocks=1 00:22:06.864 --rc geninfo_unexecuted_blocks=1 00:22:06.864 00:22:06.864 ' 00:22:06.864 05:18:08 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:06.864 05:18:08 -- nvmf/common.sh@7 -- # uname -s 00:22:06.864 05:18:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:06.864 05:18:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:06.864 05:18:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:06.864 05:18:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:06.864 05:18:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:06.864 05:18:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:06.864 05:18:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:06.864 05:18:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:06.864 05:18:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:06.864 05:18:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:06.864 05:18:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:06.864 05:18:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:06.864 05:18:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:06.865 05:18:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:06.865 05:18:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:06.865 05:18:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:06.865 05:18:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:06.865 05:18:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:06.865 05:18:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:06.865 05:18:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:06.865 05:18:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:06.865 05:18:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:06.865 05:18:08 -- paths/export.sh@5 -- # export PATH 00:22:06.865 05:18:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:06.865 05:18:08 -- nvmf/common.sh@46 -- # : 0 00:22:06.865 05:18:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:06.865 05:18:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:06.865 05:18:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:06.865 05:18:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:06.865 05:18:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:06.865 05:18:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:06.865 05:18:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:06.865 05:18:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:06.865 05:18:08 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:06.865 05:18:08 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:06.865 05:18:08 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:22:06.865 05:18:08 -- target/multiconnection.sh@16 -- # nvmftestinit 00:22:06.865 05:18:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:06.865 05:18:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:06.865 05:18:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:06.865 05:18:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:06.865 05:18:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:06.865 05:18:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:06.865 05:18:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:06.865 05:18:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:06.865 05:18:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:06.865 05:18:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:06.865 05:18:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:06.865 05:18:08 -- common/autotest_common.sh@10 -- # set +x 00:22:08.771 05:18:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:08.771 05:18:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:08.771 05:18:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:08.771 05:18:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:08.771 05:18:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:08.771 05:18:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:08.771 05:18:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:08.771 05:18:10 -- nvmf/common.sh@294 -- # net_devs=() 00:22:08.771 05:18:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:08.771 05:18:10 -- nvmf/common.sh@295 -- # e810=() 00:22:08.771 05:18:10 -- nvmf/common.sh@295 -- # local -ga e810 00:22:08.771 05:18:10 -- nvmf/common.sh@296 -- # x722=() 00:22:08.771 05:18:10 -- nvmf/common.sh@296 -- # local -ga x722 00:22:08.771 05:18:10 -- nvmf/common.sh@297 -- # mlx=() 00:22:08.771 05:18:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:08.771 05:18:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:08.771 05:18:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:08.771 05:18:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:08.771 05:18:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:08.771 05:18:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:08.771 05:18:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:08.771 05:18:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:08.771 05:18:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:08.771 05:18:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:08.771 05:18:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:08.771 05:18:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:08.771 05:18:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:08.771 05:18:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:08.771 05:18:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:08.772 05:18:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:08.772 05:18:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:08.772 05:18:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:08.772 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:08.772 05:18:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:08.772 05:18:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:08.772 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:08.772 05:18:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:08.772 05:18:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:08.772 05:18:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:08.772 05:18:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:08.772 05:18:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:08.772 05:18:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:08.772 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:08.772 05:18:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:08.772 05:18:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:08.772 05:18:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:08.772 05:18:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:08.772 05:18:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:08.772 05:18:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:08.772 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:08.772 05:18:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:08.772 05:18:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:08.772 05:18:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:08.772 05:18:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:08.772 05:18:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:08.772 05:18:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:08.772 05:18:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:08.772 05:18:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:08.772 05:18:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:08.772 05:18:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:08.772 05:18:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:08.772 05:18:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:08.772 05:18:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:08.772 05:18:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:08.772 05:18:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:08.772 05:18:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:08.772 05:18:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:08.772 05:18:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:08.772 05:18:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:08.772 05:18:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:08.772 05:18:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:08.772 05:18:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:08.772 05:18:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:08.772 05:18:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:08.772 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:08.772 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:22:08.772 00:22:08.772 --- 10.0.0.2 ping statistics --- 00:22:08.772 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:08.772 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:22:08.772 05:18:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:08.772 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:08.772 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:22:08.772 00:22:08.772 --- 10.0.0.1 ping statistics --- 00:22:08.772 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:08.772 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:22:08.772 05:18:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:08.772 05:18:10 -- nvmf/common.sh@410 -- # return 0 00:22:08.772 05:18:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:08.772 05:18:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:08.772 05:18:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:08.772 05:18:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:08.772 05:18:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:08.772 05:18:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:08.772 05:18:10 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:22:08.772 05:18:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:08.772 05:18:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:08.772 05:18:10 -- common/autotest_common.sh@10 -- # set +x 00:22:08.772 05:18:10 -- nvmf/common.sh@469 -- # nvmfpid=3343501 00:22:08.772 05:18:10 -- nvmf/common.sh@470 -- # waitforlisten 3343501 00:22:08.772 05:18:10 -- common/autotest_common.sh@829 -- # '[' -z 3343501 ']' 00:22:08.772 05:18:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:08.772 05:18:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:08.772 05:18:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:08.772 05:18:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:08.772 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:08.772 05:18:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:08.772 05:18:10 -- common/autotest_common.sh@10 -- # set +x 00:22:08.772 [2024-11-26 05:18:10.345005] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:08.772 [2024-11-26 05:18:10.345103] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:08.772 EAL: No free 2048 kB hugepages reported on node 1 00:22:08.772 [2024-11-26 05:18:10.417931] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:08.772 [2024-11-26 05:18:10.514081] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:08.772 [2024-11-26 05:18:10.514250] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:08.772 [2024-11-26 05:18:10.514272] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:08.772 [2024-11-26 05:18:10.514288] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:08.772 [2024-11-26 05:18:10.514382] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:08.772 [2024-11-26 05:18:10.514436] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:08.772 [2024-11-26 05:18:10.514488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:08.772 [2024-11-26 05:18:10.514491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:09.706 05:18:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:09.706 05:18:11 -- common/autotest_common.sh@862 -- # return 0 00:22:09.706 05:18:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:09.706 05:18:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:09.706 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.706 05:18:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:09.706 05:18:11 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:09.706 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.706 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.706 [2024-11-26 05:18:11.343382] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:09.706 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.706 05:18:11 -- target/multiconnection.sh@21 -- # seq 1 11 00:22:09.706 05:18:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:09.706 05:18:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:09.706 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.706 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.706 Malloc1 00:22:09.706 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.706 05:18:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:22:09.706 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.706 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.706 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.706 05:18:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:09.706 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.706 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.706 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.706 05:18:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:09.706 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.706 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.706 [2024-11-26 05:18:11.398253] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:09.706 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.706 05:18:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:09.706 05:18:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:22:09.706 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.706 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.706 Malloc2 00:22:09.706 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.706 05:18:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:22:09.706 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.706 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.706 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.706 05:18:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:22:09.706 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.706 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.706 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.706 05:18:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:09.706 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.706 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.706 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.706 05:18:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:09.706 05:18:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:22:09.706 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.706 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 Malloc3 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:09.966 05:18:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 Malloc4 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:09.966 05:18:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 Malloc5 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:09.966 05:18:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 Malloc6 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:09.966 05:18:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 Malloc7 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:09.966 05:18:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 Malloc8 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:09.966 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.966 05:18:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:22:09.966 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.966 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.227 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.227 05:18:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:22:10.227 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.227 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.227 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.227 05:18:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:10.227 05:18:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:22:10.227 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.227 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.227 Malloc9 00:22:10.227 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.227 05:18:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:22:10.227 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.227 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.227 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.227 05:18:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:22:10.227 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.227 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.227 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.227 05:18:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:22:10.227 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.227 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.227 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.227 05:18:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:10.227 05:18:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:22:10.227 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.227 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.227 Malloc10 00:22:10.227 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.227 05:18:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:22:10.227 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.227 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.227 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.227 05:18:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:22:10.227 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.227 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.227 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.227 05:18:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:22:10.227 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.227 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.227 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.227 05:18:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:10.227 05:18:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:22:10.227 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.227 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.227 Malloc11 00:22:10.227 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.227 05:18:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:10.227 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.227 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.227 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.227 05:18:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:10.227 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.227 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.228 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.228 05:18:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:10.228 05:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.228 05:18:11 -- common/autotest_common.sh@10 -- # set +x 00:22:10.228 05:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.228 05:18:11 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:10.228 05:18:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:10.228 05:18:11 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:10.797 05:18:12 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:22:10.797 05:18:12 -- common/autotest_common.sh@1187 -- # local i=0 00:22:10.797 05:18:12 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:10.797 05:18:12 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:10.797 05:18:12 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:13.329 05:18:14 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:13.329 05:18:14 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:13.329 05:18:14 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:22:13.329 05:18:14 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:13.329 05:18:14 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:13.329 05:18:14 -- common/autotest_common.sh@1197 -- # return 0 00:22:13.329 05:18:14 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.329 05:18:14 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:13.589 05:18:15 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:13.589 05:18:15 -- common/autotest_common.sh@1187 -- # local i=0 00:22:13.589 05:18:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:13.589 05:18:15 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:13.589 05:18:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:15.494 05:18:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:15.494 05:18:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:15.494 05:18:17 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:22:15.752 05:18:17 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:15.752 05:18:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:15.752 05:18:17 -- common/autotest_common.sh@1197 -- # return 0 00:22:15.752 05:18:17 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:15.752 05:18:17 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:16.318 05:18:17 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:16.318 05:18:17 -- common/autotest_common.sh@1187 -- # local i=0 00:22:16.318 05:18:17 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:16.318 05:18:17 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:16.318 05:18:17 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:18.225 05:18:19 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:18.225 05:18:19 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:18.225 05:18:19 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:22:18.225 05:18:19 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:18.485 05:18:19 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:18.485 05:18:19 -- common/autotest_common.sh@1197 -- # return 0 00:22:18.485 05:18:19 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.485 05:18:19 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:19.055 05:18:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:19.055 05:18:20 -- common/autotest_common.sh@1187 -- # local i=0 00:22:19.055 05:18:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:19.055 05:18:20 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:19.055 05:18:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:20.962 05:18:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:20.962 05:18:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:20.962 05:18:22 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:20.962 05:18:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:20.962 05:18:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:20.962 05:18:22 -- common/autotest_common.sh@1197 -- # return 0 00:22:20.962 05:18:22 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:20.962 05:18:22 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:21.900 05:18:23 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:21.900 05:18:23 -- common/autotest_common.sh@1187 -- # local i=0 00:22:21.900 05:18:23 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:21.900 05:18:23 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:21.900 05:18:23 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:23.808 05:18:25 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:23.808 05:18:25 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:23.808 05:18:25 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:23.808 05:18:25 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:23.808 05:18:25 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:23.808 05:18:25 -- common/autotest_common.sh@1197 -- # return 0 00:22:23.808 05:18:25 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:23.808 05:18:25 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:24.743 05:18:26 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:24.743 05:18:26 -- common/autotest_common.sh@1187 -- # local i=0 00:22:24.743 05:18:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:24.743 05:18:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:24.743 05:18:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:26.650 05:18:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:26.650 05:18:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:26.650 05:18:28 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:26.650 05:18:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:26.650 05:18:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:26.650 05:18:28 -- common/autotest_common.sh@1197 -- # return 0 00:22:26.650 05:18:28 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:26.650 05:18:28 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:27.588 05:18:29 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:27.588 05:18:29 -- common/autotest_common.sh@1187 -- # local i=0 00:22:27.588 05:18:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:27.589 05:18:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:27.589 05:18:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:29.491 05:18:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:29.491 05:18:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:29.491 05:18:31 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:29.491 05:18:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:29.491 05:18:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:29.491 05:18:31 -- common/autotest_common.sh@1197 -- # return 0 00:22:29.491 05:18:31 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.491 05:18:31 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:30.429 05:18:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:30.429 05:18:31 -- common/autotest_common.sh@1187 -- # local i=0 00:22:30.429 05:18:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:30.429 05:18:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:30.429 05:18:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:32.334 05:18:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:32.334 05:18:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:32.334 05:18:33 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:32.334 05:18:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:32.334 05:18:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:32.334 05:18:33 -- common/autotest_common.sh@1197 -- # return 0 00:22:32.334 05:18:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:32.334 05:18:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:33.272 05:18:34 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:33.272 05:18:34 -- common/autotest_common.sh@1187 -- # local i=0 00:22:33.272 05:18:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:33.272 05:18:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:33.272 05:18:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:35.180 05:18:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:35.180 05:18:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:35.180 05:18:36 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:35.180 05:18:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:35.180 05:18:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:35.180 05:18:36 -- common/autotest_common.sh@1197 -- # return 0 00:22:35.180 05:18:36 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:35.180 05:18:36 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:36.560 05:18:37 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:36.560 05:18:37 -- common/autotest_common.sh@1187 -- # local i=0 00:22:36.560 05:18:37 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:36.560 05:18:37 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:36.560 05:18:37 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:38.469 05:18:39 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:38.469 05:18:39 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:38.469 05:18:39 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:22:38.469 05:18:39 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:38.469 05:18:39 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:38.469 05:18:39 -- common/autotest_common.sh@1197 -- # return 0 00:22:38.469 05:18:39 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:38.469 05:18:39 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:39.039 05:18:40 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:39.039 05:18:40 -- common/autotest_common.sh@1187 -- # local i=0 00:22:39.039 05:18:40 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:39.039 05:18:40 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:39.039 05:18:40 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:41.576 05:18:42 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:41.576 05:18:42 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:41.576 05:18:42 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:22:41.576 05:18:42 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:41.576 05:18:42 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:41.576 05:18:42 -- common/autotest_common.sh@1197 -- # return 0 00:22:41.576 05:18:42 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:41.576 [global] 00:22:41.576 thread=1 00:22:41.576 invalidate=1 00:22:41.576 rw=read 00:22:41.576 time_based=1 00:22:41.576 runtime=10 00:22:41.576 ioengine=libaio 00:22:41.576 direct=1 00:22:41.576 bs=262144 00:22:41.576 iodepth=64 00:22:41.576 norandommap=1 00:22:41.576 numjobs=1 00:22:41.576 00:22:41.576 [job0] 00:22:41.576 filename=/dev/nvme0n1 00:22:41.576 [job1] 00:22:41.576 filename=/dev/nvme10n1 00:22:41.576 [job2] 00:22:41.576 filename=/dev/nvme1n1 00:22:41.576 [job3] 00:22:41.576 filename=/dev/nvme2n1 00:22:41.576 [job4] 00:22:41.576 filename=/dev/nvme3n1 00:22:41.576 [job5] 00:22:41.576 filename=/dev/nvme4n1 00:22:41.576 [job6] 00:22:41.576 filename=/dev/nvme5n1 00:22:41.576 [job7] 00:22:41.576 filename=/dev/nvme6n1 00:22:41.576 [job8] 00:22:41.576 filename=/dev/nvme7n1 00:22:41.576 [job9] 00:22:41.576 filename=/dev/nvme8n1 00:22:41.576 [job10] 00:22:41.576 filename=/dev/nvme9n1 00:22:41.576 Could not set queue depth (nvme0n1) 00:22:41.576 Could not set queue depth (nvme10n1) 00:22:41.576 Could not set queue depth (nvme1n1) 00:22:41.576 Could not set queue depth (nvme2n1) 00:22:41.576 Could not set queue depth (nvme3n1) 00:22:41.576 Could not set queue depth (nvme4n1) 00:22:41.576 Could not set queue depth (nvme5n1) 00:22:41.576 Could not set queue depth (nvme6n1) 00:22:41.576 Could not set queue depth (nvme7n1) 00:22:41.576 Could not set queue depth (nvme8n1) 00:22:41.576 Could not set queue depth (nvme9n1) 00:22:41.576 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:41.576 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:41.576 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:41.576 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:41.576 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:41.576 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:41.576 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:41.576 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:41.576 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:41.576 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:41.576 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:41.576 fio-3.35 00:22:41.576 Starting 11 threads 00:22:53.860 00:22:53.861 job0: (groupid=0, jobs=1): err= 0: pid=3347952: Tue Nov 26 05:18:53 2024 00:22:53.861 read: IOPS=587, BW=147MiB/s (154MB/s)(1492MiB/10161msec) 00:22:53.861 slat (usec): min=10, max=113572, avg=1426.71, stdev=5512.86 00:22:53.861 clat (msec): min=4, max=429, avg=107.46, stdev=63.25 00:22:53.861 lat (msec): min=7, max=429, avg=108.89, stdev=64.31 00:22:53.861 clat percentiles (msec): 00:22:53.861 | 1.00th=[ 18], 5.00th=[ 34], 10.00th=[ 46], 20.00th=[ 59], 00:22:53.861 | 30.00th=[ 73], 40.00th=[ 85], 50.00th=[ 99], 60.00th=[ 109], 00:22:53.861 | 70.00th=[ 121], 80.00th=[ 140], 90.00th=[ 167], 95.00th=[ 251], 00:22:53.861 | 99.00th=[ 338], 99.50th=[ 368], 99.90th=[ 384], 99.95th=[ 430], 00:22:53.861 | 99.99th=[ 430] 00:22:53.861 bw ( KiB/s): min=47616, max=278528, per=7.53%, avg=151112.85, stdev=63628.95, samples=20 00:22:53.861 iops : min= 186, max= 1088, avg=590.20, stdev=248.52, samples=20 00:22:53.861 lat (msec) : 10=0.08%, 20=1.27%, 50=11.98%, 100=38.58%, 250=42.82% 00:22:53.861 lat (msec) : 500=5.26% 00:22:53.861 cpu : usr=0.34%, sys=2.13%, ctx=1184, majf=0, minf=4097 00:22:53.861 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:22:53.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.861 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.861 issued rwts: total=5967,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.861 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.861 job1: (groupid=0, jobs=1): err= 0: pid=3347981: Tue Nov 26 05:18:53 2024 00:22:53.861 read: IOPS=476, BW=119MiB/s (125MB/s)(1206MiB/10128msec) 00:22:53.861 slat (usec): min=14, max=103189, avg=1835.03, stdev=6020.30 00:22:53.861 clat (msec): min=4, max=446, avg=132.38, stdev=66.78 00:22:53.861 lat (msec): min=4, max=446, avg=134.22, stdev=67.76 00:22:53.861 clat percentiles (msec): 00:22:53.861 | 1.00th=[ 8], 5.00th=[ 27], 10.00th=[ 38], 20.00th=[ 87], 00:22:53.861 | 30.00th=[ 109], 40.00th=[ 123], 50.00th=[ 133], 60.00th=[ 142], 00:22:53.861 | 70.00th=[ 150], 80.00th=[ 165], 90.00th=[ 207], 95.00th=[ 259], 00:22:53.861 | 99.00th=[ 355], 99.50th=[ 372], 99.90th=[ 397], 99.95th=[ 405], 00:22:53.861 | 99.99th=[ 447] 00:22:53.861 bw ( KiB/s): min=46592, max=307712, per=6.07%, avg=121859.95, stdev=57804.32, samples=20 00:22:53.861 iops : min= 182, max= 1202, avg=476.00, stdev=225.80, samples=20 00:22:53.861 lat (msec) : 10=1.68%, 20=1.89%, 50=9.45%, 100=11.03%, 250=70.07% 00:22:53.861 lat (msec) : 500=5.89% 00:22:53.861 cpu : usr=0.32%, sys=1.72%, ctx=1023, majf=0, minf=4097 00:22:53.861 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:22:53.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.861 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.861 issued rwts: total=4824,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.861 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.861 job2: (groupid=0, jobs=1): err= 0: pid=3348023: Tue Nov 26 05:18:53 2024 00:22:53.861 read: IOPS=488, BW=122MiB/s (128MB/s)(1238MiB/10129msec) 00:22:53.861 slat (usec): min=10, max=175240, avg=1798.23, stdev=6977.19 00:22:53.861 clat (msec): min=3, max=493, avg=129.04, stdev=61.94 00:22:53.861 lat (msec): min=3, max=493, avg=130.84, stdev=63.07 00:22:53.861 clat percentiles (msec): 00:22:53.861 | 1.00th=[ 16], 5.00th=[ 47], 10.00th=[ 69], 20.00th=[ 89], 00:22:53.861 | 30.00th=[ 99], 40.00th=[ 108], 50.00th=[ 118], 60.00th=[ 130], 00:22:53.861 | 70.00th=[ 144], 80.00th=[ 157], 90.00th=[ 209], 95.00th=[ 259], 00:22:53.861 | 99.00th=[ 359], 99.50th=[ 372], 99.90th=[ 376], 99.95th=[ 376], 00:22:53.861 | 99.99th=[ 493] 00:22:53.861 bw ( KiB/s): min=34304, max=220160, per=6.23%, avg=125085.35, stdev=44318.32, samples=20 00:22:53.861 iops : min= 134, max= 860, avg=488.60, stdev=173.12, samples=20 00:22:53.861 lat (msec) : 4=0.04%, 10=0.65%, 20=0.69%, 50=4.16%, 100=26.22% 00:22:53.861 lat (msec) : 250=62.37%, 500=5.88% 00:22:53.861 cpu : usr=0.38%, sys=1.76%, ctx=1028, majf=0, minf=4097 00:22:53.861 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:22:53.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.861 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.861 issued rwts: total=4951,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.861 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.861 job3: (groupid=0, jobs=1): err= 0: pid=3348035: Tue Nov 26 05:18:53 2024 00:22:53.861 read: IOPS=609, BW=152MiB/s (160MB/s)(1543MiB/10127msec) 00:22:53.861 slat (usec): min=9, max=98999, avg=1092.31, stdev=4159.23 00:22:53.861 clat (msec): min=2, max=400, avg=103.84, stdev=56.90 00:22:53.861 lat (msec): min=2, max=416, avg=104.93, stdev=57.35 00:22:53.861 clat percentiles (msec): 00:22:53.861 | 1.00th=[ 7], 5.00th=[ 14], 10.00th=[ 50], 20.00th=[ 70], 00:22:53.861 | 30.00th=[ 81], 40.00th=[ 90], 50.00th=[ 100], 60.00th=[ 106], 00:22:53.861 | 70.00th=[ 114], 80.00th=[ 130], 90.00th=[ 155], 95.00th=[ 205], 00:22:53.861 | 99.00th=[ 342], 99.50th=[ 355], 99.90th=[ 372], 99.95th=[ 376], 00:22:53.861 | 99.99th=[ 401] 00:22:53.861 bw ( KiB/s): min=43008, max=224256, per=7.79%, avg=156333.20, stdev=45783.61, samples=20 00:22:53.861 iops : min= 168, max= 876, avg=610.65, stdev=178.82, samples=20 00:22:53.861 lat (msec) : 4=0.24%, 10=2.97%, 20=3.40%, 50=3.81%, 100=41.91% 00:22:53.861 lat (msec) : 250=44.22%, 500=3.45% 00:22:53.861 cpu : usr=0.37%, sys=1.82%, ctx=1361, majf=0, minf=4097 00:22:53.861 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:53.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.861 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.861 issued rwts: total=6171,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.861 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.861 job4: (groupid=0, jobs=1): err= 0: pid=3348036: Tue Nov 26 05:18:53 2024 00:22:53.861 read: IOPS=826, BW=207MiB/s (217MB/s)(2086MiB/10091msec) 00:22:53.861 slat (usec): min=10, max=101949, avg=836.65, stdev=3411.59 00:22:53.861 clat (usec): min=1119, max=334644, avg=76485.85, stdev=49818.76 00:22:53.861 lat (usec): min=1138, max=334670, avg=77322.50, stdev=50279.81 00:22:53.861 clat percentiles (msec): 00:22:53.861 | 1.00th=[ 5], 5.00th=[ 17], 10.00th=[ 29], 20.00th=[ 34], 00:22:53.861 | 30.00th=[ 46], 40.00th=[ 55], 50.00th=[ 65], 60.00th=[ 84], 00:22:53.861 | 70.00th=[ 97], 80.00th=[ 110], 90.00th=[ 128], 95.00th=[ 167], 00:22:53.861 | 99.00th=[ 257], 99.50th=[ 275], 99.90th=[ 300], 99.95th=[ 300], 00:22:53.861 | 99.99th=[ 334] 00:22:53.861 bw ( KiB/s): min=68608, max=435864, per=10.56%, avg=211954.75, stdev=90315.10, samples=20 00:22:53.861 iops : min= 268, max= 1702, avg=827.90, stdev=352.72, samples=20 00:22:53.861 lat (msec) : 2=0.35%, 4=0.40%, 10=1.53%, 20=4.03%, 50=28.42% 00:22:53.861 lat (msec) : 100=37.94%, 250=25.99%, 500=1.34% 00:22:53.861 cpu : usr=0.57%, sys=2.47%, ctx=1801, majf=0, minf=4097 00:22:53.861 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:53.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.861 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.861 issued rwts: total=8345,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.861 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.861 job5: (groupid=0, jobs=1): err= 0: pid=3348037: Tue Nov 26 05:18:53 2024 00:22:53.861 read: IOPS=900, BW=225MiB/s (236MB/s)(2272MiB/10094msec) 00:22:53.861 slat (usec): min=9, max=63138, avg=894.13, stdev=3100.26 00:22:53.861 clat (usec): min=1841, max=317989, avg=70120.74, stdev=40101.57 00:22:53.861 lat (usec): min=1934, max=318020, avg=71014.87, stdev=40644.39 00:22:53.861 clat percentiles (msec): 00:22:53.861 | 1.00th=[ 12], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], 00:22:53.861 | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 80], 00:22:53.861 | 70.00th=[ 91], 80.00th=[ 107], 90.00th=[ 123], 95.00th=[ 142], 00:22:53.861 | 99.00th=[ 186], 99.50th=[ 199], 99.90th=[ 228], 99.95th=[ 262], 00:22:53.861 | 99.99th=[ 317] 00:22:53.861 bw ( KiB/s): min=105472, max=449536, per=11.51%, avg=231005.00, stdev=115832.21, samples=20 00:22:53.861 iops : min= 412, max= 1756, avg=902.30, stdev=452.50, samples=20 00:22:53.861 lat (msec) : 2=0.01%, 4=0.26%, 10=0.51%, 20=2.60%, 50=40.04% 00:22:53.861 lat (msec) : 100=33.11%, 250=23.42%, 500=0.06% 00:22:53.861 cpu : usr=0.43%, sys=2.98%, ctx=1814, majf=0, minf=4097 00:22:53.861 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:22:53.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.861 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.861 issued rwts: total=9089,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.861 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.861 job6: (groupid=0, jobs=1): err= 0: pid=3348038: Tue Nov 26 05:18:53 2024 00:22:53.861 read: IOPS=760, BW=190MiB/s (199MB/s)(1919MiB/10091msec) 00:22:53.861 slat (usec): min=10, max=109222, avg=1029.65, stdev=4416.84 00:22:53.861 clat (usec): min=1581, max=227493, avg=83052.09, stdev=45151.22 00:22:53.861 lat (usec): min=1600, max=228187, avg=84081.73, stdev=45810.10 00:22:53.861 clat percentiles (msec): 00:22:53.861 | 1.00th=[ 7], 5.00th=[ 16], 10.00th=[ 29], 20.00th=[ 39], 00:22:53.861 | 30.00th=[ 53], 40.00th=[ 63], 50.00th=[ 80], 60.00th=[ 97], 00:22:53.861 | 70.00th=[ 114], 80.00th=[ 127], 90.00th=[ 142], 95.00th=[ 157], 00:22:53.861 | 99.00th=[ 190], 99.50th=[ 199], 99.90th=[ 209], 99.95th=[ 218], 00:22:53.861 | 99.99th=[ 228] 00:22:53.861 bw ( KiB/s): min=114176, max=430080, per=9.71%, avg=194884.80, stdev=84326.66, samples=20 00:22:53.861 iops : min= 446, max= 1680, avg=761.25, stdev=329.41, samples=20 00:22:53.861 lat (msec) : 2=0.16%, 4=0.51%, 10=1.94%, 20=3.95%, 50=21.03% 00:22:53.861 lat (msec) : 100=34.29%, 250=38.12% 00:22:53.861 cpu : usr=0.40%, sys=2.45%, ctx=1588, majf=0, minf=4097 00:22:53.861 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:53.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.861 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.861 issued rwts: total=7675,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.861 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.861 job7: (groupid=0, jobs=1): err= 0: pid=3348039: Tue Nov 26 05:18:53 2024 00:22:53.862 read: IOPS=969, BW=242MiB/s (254MB/s)(2448MiB/10097msec) 00:22:53.862 slat (usec): min=12, max=80630, avg=960.49, stdev=2962.60 00:22:53.862 clat (msec): min=4, max=243, avg=64.99, stdev=35.06 00:22:53.862 lat (msec): min=4, max=269, avg=65.95, stdev=35.55 00:22:53.862 clat percentiles (msec): 00:22:53.862 | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 28], 20.00th=[ 32], 00:22:53.862 | 30.00th=[ 37], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 70], 00:22:53.862 | 70.00th=[ 84], 80.00th=[ 96], 90.00th=[ 111], 95.00th=[ 125], 00:22:53.862 | 99.00th=[ 178], 99.50th=[ 201], 99.90th=[ 226], 99.95th=[ 226], 00:22:53.862 | 99.99th=[ 245] 00:22:53.862 bw ( KiB/s): min=107008, max=548352, per=12.40%, avg=248977.35, stdev=115826.96, samples=20 00:22:53.862 iops : min= 418, max= 2142, avg=972.50, stdev=452.50, samples=20 00:22:53.862 lat (msec) : 10=0.28%, 20=0.62%, 50=41.51%, 100=40.38%, 250=17.21% 00:22:53.862 cpu : usr=0.58%, sys=3.28%, ctx=1831, majf=0, minf=3721 00:22:53.862 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:22:53.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.862 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.862 issued rwts: total=9790,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.862 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.862 job8: (groupid=0, jobs=1): err= 0: pid=3348040: Tue Nov 26 05:18:53 2024 00:22:53.862 read: IOPS=554, BW=139MiB/s (145MB/s)(1404MiB/10122msec) 00:22:53.862 slat (usec): min=10, max=99491, avg=1260.80, stdev=5915.97 00:22:53.862 clat (usec): min=1961, max=403104, avg=114024.08, stdev=65940.79 00:22:53.862 lat (usec): min=1999, max=464724, avg=115284.88, stdev=67036.70 00:22:53.862 clat percentiles (msec): 00:22:53.862 | 1.00th=[ 8], 5.00th=[ 17], 10.00th=[ 32], 20.00th=[ 53], 00:22:53.862 | 30.00th=[ 85], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 126], 00:22:53.862 | 70.00th=[ 138], 80.00th=[ 148], 90.00th=[ 186], 95.00th=[ 241], 00:22:53.862 | 99.00th=[ 342], 99.50th=[ 368], 99.90th=[ 380], 99.95th=[ 405], 00:22:53.862 | 99.99th=[ 405] 00:22:53.862 bw ( KiB/s): min=57344, max=235520, per=7.08%, avg=142090.75, stdev=49834.66, samples=20 00:22:53.862 iops : min= 224, max= 920, avg=554.95, stdev=194.67, samples=20 00:22:53.862 lat (msec) : 2=0.02%, 4=0.05%, 10=1.89%, 20=4.11%, 50=13.04% 00:22:53.862 lat (msec) : 100=18.31%, 250=58.15%, 500=4.43% 00:22:53.862 cpu : usr=0.29%, sys=1.67%, ctx=1213, majf=0, minf=4097 00:22:53.862 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:53.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.862 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.862 issued rwts: total=5615,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.862 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.862 job9: (groupid=0, jobs=1): err= 0: pid=3348041: Tue Nov 26 05:18:53 2024 00:22:53.862 read: IOPS=894, BW=224MiB/s (234MB/s)(2264MiB/10127msec) 00:22:53.862 slat (usec): min=10, max=161702, avg=854.75, stdev=4527.61 00:22:53.862 clat (usec): min=909, max=400015, avg=70630.91, stdev=61669.86 00:22:53.862 lat (usec): min=930, max=484471, avg=71485.66, stdev=62543.81 00:22:53.862 clat percentiles (msec): 00:22:53.862 | 1.00th=[ 5], 5.00th=[ 16], 10.00th=[ 25], 20.00th=[ 29], 00:22:53.862 | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 52], 60.00th=[ 61], 00:22:53.862 | 70.00th=[ 75], 80.00th=[ 111], 90.00th=[ 150], 95.00th=[ 180], 00:22:53.862 | 99.00th=[ 321], 99.50th=[ 372], 99.90th=[ 384], 99.95th=[ 388], 00:22:53.862 | 99.99th=[ 401] 00:22:53.862 bw ( KiB/s): min=42496, max=489984, per=11.47%, avg=230206.05, stdev=116278.10, samples=20 00:22:53.862 iops : min= 166, max= 1914, avg=899.20, stdev=454.19, samples=20 00:22:53.862 lat (usec) : 1000=0.01% 00:22:53.862 lat (msec) : 2=0.29%, 4=0.50%, 10=1.84%, 20=4.74%, 50=41.70% 00:22:53.862 lat (msec) : 100=28.30%, 250=19.66%, 500=2.96% 00:22:53.862 cpu : usr=0.60%, sys=2.80%, ctx=1822, majf=0, minf=4097 00:22:53.862 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:22:53.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.862 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.862 issued rwts: total=9057,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.862 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.862 job10: (groupid=0, jobs=1): err= 0: pid=3348042: Tue Nov 26 05:18:53 2024 00:22:53.862 read: IOPS=810, BW=203MiB/s (213MB/s)(2046MiB/10095msec) 00:22:53.862 slat (usec): min=13, max=115421, avg=1198.69, stdev=3731.93 00:22:53.862 clat (msec): min=6, max=289, avg=77.66, stdev=36.00 00:22:53.862 lat (msec): min=6, max=294, avg=78.85, stdev=36.49 00:22:53.862 clat percentiles (msec): 00:22:53.862 | 1.00th=[ 27], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 46], 00:22:53.862 | 30.00th=[ 54], 40.00th=[ 63], 50.00th=[ 74], 60.00th=[ 84], 00:22:53.862 | 70.00th=[ 96], 80.00th=[ 110], 90.00th=[ 125], 95.00th=[ 140], 00:22:53.862 | 99.00th=[ 182], 99.50th=[ 188], 99.90th=[ 292], 99.95th=[ 292], 00:22:53.862 | 99.99th=[ 292] 00:22:53.862 bw ( KiB/s): min=116736, max=439808, per=10.36%, avg=207851.95, stdev=85063.77, samples=20 00:22:53.862 iops : min= 456, max= 1718, avg=811.85, stdev=332.22, samples=20 00:22:53.862 lat (msec) : 10=0.09%, 20=0.27%, 50=24.57%, 100=48.01%, 250=26.85% 00:22:53.862 lat (msec) : 500=0.22% 00:22:53.862 cpu : usr=0.43%, sys=2.87%, ctx=1484, majf=0, minf=4097 00:22:53.862 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:53.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.862 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.862 issued rwts: total=8184,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.862 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.862 00:22:53.862 Run status group 0 (all jobs): 00:22:53.862 READ: bw=1960MiB/s (2055MB/s), 119MiB/s-242MiB/s (125MB/s-254MB/s), io=19.5GiB (20.9GB), run=10091-10161msec 00:22:53.862 00:22:53.862 Disk stats (read/write): 00:22:53.862 nvme0n1: ios=11765/0, merge=0/0, ticks=1233490/0, in_queue=1233490, util=97.06% 00:22:53.862 nvme10n1: ios=9457/0, merge=0/0, ticks=1223332/0, in_queue=1223332, util=97.36% 00:22:53.862 nvme1n1: ios=9690/0, merge=0/0, ticks=1228747/0, in_queue=1228747, util=97.72% 00:22:53.862 nvme2n1: ios=12028/0, merge=0/0, ticks=1238031/0, in_queue=1238031, util=97.90% 00:22:53.862 nvme3n1: ios=16479/0, merge=0/0, ticks=1231267/0, in_queue=1231267, util=97.97% 00:22:53.862 nvme4n1: ios=18001/0, merge=0/0, ticks=1230999/0, in_queue=1230999, util=98.29% 00:22:53.862 nvme5n1: ios=15078/0, merge=0/0, ticks=1229970/0, in_queue=1229970, util=98.42% 00:22:53.862 nvme6n1: ios=19390/0, merge=0/0, ticks=1228194/0, in_queue=1228194, util=98.55% 00:22:53.862 nvme7n1: ios=11024/0, merge=0/0, ticks=1235402/0, in_queue=1235402, util=98.91% 00:22:53.862 nvme8n1: ios=17865/0, merge=0/0, ticks=1229173/0, in_queue=1229173, util=99.09% 00:22:53.862 nvme9n1: ios=16192/0, merge=0/0, ticks=1224323/0, in_queue=1224323, util=99.20% 00:22:53.862 05:18:53 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:22:53.862 [global] 00:22:53.862 thread=1 00:22:53.862 invalidate=1 00:22:53.862 rw=randwrite 00:22:53.862 time_based=1 00:22:53.862 runtime=10 00:22:53.862 ioengine=libaio 00:22:53.862 direct=1 00:22:53.862 bs=262144 00:22:53.862 iodepth=64 00:22:53.862 norandommap=1 00:22:53.862 numjobs=1 00:22:53.862 00:22:53.862 [job0] 00:22:53.862 filename=/dev/nvme0n1 00:22:53.862 [job1] 00:22:53.862 filename=/dev/nvme10n1 00:22:53.862 [job2] 00:22:53.862 filename=/dev/nvme1n1 00:22:53.862 [job3] 00:22:53.862 filename=/dev/nvme2n1 00:22:53.862 [job4] 00:22:53.862 filename=/dev/nvme3n1 00:22:53.862 [job5] 00:22:53.862 filename=/dev/nvme4n1 00:22:53.862 [job6] 00:22:53.862 filename=/dev/nvme5n1 00:22:53.862 [job7] 00:22:53.862 filename=/dev/nvme6n1 00:22:53.862 [job8] 00:22:53.862 filename=/dev/nvme7n1 00:22:53.862 [job9] 00:22:53.862 filename=/dev/nvme8n1 00:22:53.862 [job10] 00:22:53.862 filename=/dev/nvme9n1 00:22:53.862 Could not set queue depth (nvme0n1) 00:22:53.862 Could not set queue depth (nvme10n1) 00:22:53.862 Could not set queue depth (nvme1n1) 00:22:53.862 Could not set queue depth (nvme2n1) 00:22:53.862 Could not set queue depth (nvme3n1) 00:22:53.862 Could not set queue depth (nvme4n1) 00:22:53.862 Could not set queue depth (nvme5n1) 00:22:53.862 Could not set queue depth (nvme6n1) 00:22:53.862 Could not set queue depth (nvme7n1) 00:22:53.862 Could not set queue depth (nvme8n1) 00:22:53.862 Could not set queue depth (nvme9n1) 00:22:53.862 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:53.862 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:53.862 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:53.862 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:53.862 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:53.862 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:53.862 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:53.862 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:53.862 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:53.862 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:53.862 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:53.862 fio-3.35 00:22:53.862 Starting 11 threads 00:23:03.851 00:23:03.851 job0: (groupid=0, jobs=1): err= 0: pid=3349087: Tue Nov 26 05:19:04 2024 00:23:03.851 write: IOPS=592, BW=148MiB/s (155MB/s)(1502MiB/10133msec); 0 zone resets 00:23:03.851 slat (usec): min=23, max=149400, avg=1254.62, stdev=3934.56 00:23:03.851 clat (msec): min=2, max=289, avg=106.66, stdev=60.32 00:23:03.851 lat (msec): min=2, max=289, avg=107.91, stdev=60.93 00:23:03.851 clat percentiles (msec): 00:23:03.851 | 1.00th=[ 10], 5.00th=[ 23], 10.00th=[ 35], 20.00th=[ 58], 00:23:03.851 | 30.00th=[ 63], 40.00th=[ 81], 50.00th=[ 97], 60.00th=[ 106], 00:23:03.851 | 70.00th=[ 140], 80.00th=[ 171], 90.00th=[ 190], 95.00th=[ 218], 00:23:03.851 | 99.00th=[ 255], 99.50th=[ 271], 99.90th=[ 284], 99.95th=[ 284], 00:23:03.851 | 99.99th=[ 288] 00:23:03.851 bw ( KiB/s): min=82432, max=317440, per=11.21%, avg=152140.80, stdev=63028.73, samples=20 00:23:03.851 iops : min= 322, max= 1240, avg=594.30, stdev=246.21, samples=20 00:23:03.851 lat (msec) : 4=0.12%, 10=1.12%, 20=3.08%, 50=11.07%, 100=39.34% 00:23:03.851 lat (msec) : 250=43.91%, 500=1.37% 00:23:03.851 cpu : usr=1.74%, sys=2.02%, ctx=2856, majf=0, minf=1 00:23:03.851 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:03.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.851 issued rwts: total=0,6006,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.851 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.851 job1: (groupid=0, jobs=1): err= 0: pid=3349100: Tue Nov 26 05:19:04 2024 00:23:03.851 write: IOPS=468, BW=117MiB/s (123MB/s)(1186MiB/10137msec); 0 zone resets 00:23:03.851 slat (usec): min=17, max=194546, avg=1199.94, stdev=5228.93 00:23:03.851 clat (usec): min=1300, max=562996, avg=135418.48, stdev=82862.74 00:23:03.851 lat (usec): min=1390, max=563064, avg=136618.41, stdev=83352.94 00:23:03.851 clat percentiles (msec): 00:23:03.851 | 1.00th=[ 4], 5.00th=[ 11], 10.00th=[ 26], 20.00th=[ 55], 00:23:03.851 | 30.00th=[ 95], 40.00th=[ 113], 50.00th=[ 136], 60.00th=[ 165], 00:23:03.851 | 70.00th=[ 178], 80.00th=[ 194], 90.00th=[ 228], 95.00th=[ 262], 00:23:03.851 | 99.00th=[ 435], 99.50th=[ 531], 99.90th=[ 558], 99.95th=[ 558], 00:23:03.851 | 99.99th=[ 567] 00:23:03.851 bw ( KiB/s): min=69632, max=273408, per=8.84%, avg=119868.75, stdev=42146.16, samples=20 00:23:03.851 iops : min= 272, max= 1068, avg=468.20, stdev=164.66, samples=20 00:23:03.851 lat (msec) : 2=0.21%, 4=1.43%, 10=3.01%, 20=3.50%, 50=10.96% 00:23:03.851 lat (msec) : 100=16.67%, 250=57.68%, 500=5.86%, 750=0.67% 00:23:03.851 cpu : usr=1.57%, sys=1.71%, ctx=2745, majf=0, minf=1 00:23:03.851 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:03.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.851 issued rwts: total=0,4745,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.851 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.851 job2: (groupid=0, jobs=1): err= 0: pid=3349107: Tue Nov 26 05:19:04 2024 00:23:03.851 write: IOPS=398, BW=99.7MiB/s (105MB/s)(1010MiB/10132msec); 0 zone resets 00:23:03.851 slat (usec): min=22, max=63843, avg=2258.80, stdev=5226.83 00:23:03.851 clat (usec): min=802, max=321523, avg=158217.20, stdev=84196.14 00:23:03.851 lat (usec): min=840, max=321623, avg=160476.01, stdev=85407.15 00:23:03.851 clat percentiles (msec): 00:23:03.851 | 1.00th=[ 6], 5.00th=[ 28], 10.00th=[ 45], 20.00th=[ 79], 00:23:03.851 | 30.00th=[ 95], 40.00th=[ 124], 50.00th=[ 165], 60.00th=[ 184], 00:23:03.851 | 70.00th=[ 222], 80.00th=[ 245], 90.00th=[ 275], 95.00th=[ 288], 00:23:03.851 | 99.00th=[ 305], 99.50th=[ 313], 99.90th=[ 321], 99.95th=[ 321], 00:23:03.851 | 99.99th=[ 321] 00:23:03.851 bw ( KiB/s): min=55296, max=214528, per=7.50%, avg=101785.60, stdev=51467.86, samples=20 00:23:03.851 iops : min= 216, max= 838, avg=397.60, stdev=201.05, samples=20 00:23:03.851 lat (usec) : 1000=0.07% 00:23:03.851 lat (msec) : 2=0.20%, 4=0.47%, 10=0.92%, 20=2.10%, 50=9.90% 00:23:03.851 lat (msec) : 100=17.97%, 250=50.98%, 500=17.38% 00:23:03.851 cpu : usr=1.20%, sys=1.45%, ctx=1473, majf=0, minf=1 00:23:03.851 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:23:03.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.851 issued rwts: total=0,4039,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.851 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.851 job3: (groupid=0, jobs=1): err= 0: pid=3349108: Tue Nov 26 05:19:04 2024 00:23:03.851 write: IOPS=588, BW=147MiB/s (154MB/s)(1506MiB/10243msec); 0 zone resets 00:23:03.851 slat (usec): min=15, max=179370, avg=1197.00, stdev=4297.25 00:23:03.851 clat (usec): min=1253, max=483933, avg=107561.46, stdev=93138.01 00:23:03.851 lat (usec): min=1429, max=483973, avg=108758.46, stdev=94127.33 00:23:03.851 clat percentiles (msec): 00:23:03.851 | 1.00th=[ 7], 5.00th=[ 21], 10.00th=[ 32], 20.00th=[ 41], 00:23:03.851 | 30.00th=[ 42], 40.00th=[ 43], 50.00th=[ 49], 60.00th=[ 85], 00:23:03.851 | 70.00th=[ 148], 80.00th=[ 207], 90.00th=[ 253], 95.00th=[ 292], 00:23:03.851 | 99.00th=[ 363], 99.50th=[ 384], 99.90th=[ 456], 99.95th=[ 468], 00:23:03.851 | 99.99th=[ 485] 00:23:03.851 bw ( KiB/s): min=50176, max=420352, per=11.25%, avg=152576.00, stdev=124377.79, samples=20 00:23:03.851 iops : min= 196, max= 1642, avg=596.00, stdev=485.85, samples=20 00:23:03.851 lat (msec) : 2=0.10%, 4=0.38%, 10=1.61%, 20=2.82%, 50=45.43% 00:23:03.851 lat (msec) : 100=11.54%, 250=27.77%, 500=10.34% 00:23:03.851 cpu : usr=1.86%, sys=2.16%, ctx=2828, majf=0, minf=1 00:23:03.851 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:03.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.851 issued rwts: total=0,6024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.851 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.851 job4: (groupid=0, jobs=1): err= 0: pid=3349109: Tue Nov 26 05:19:04 2024 00:23:03.851 write: IOPS=626, BW=157MiB/s (164MB/s)(1603MiB/10240msec); 0 zone resets 00:23:03.851 slat (usec): min=22, max=182313, avg=1306.38, stdev=5146.96 00:23:03.851 clat (usec): min=1309, max=493014, avg=100736.96, stdev=85177.78 00:23:03.851 lat (usec): min=1842, max=493046, avg=102043.34, stdev=86200.77 00:23:03.851 clat percentiles (msec): 00:23:03.851 | 1.00th=[ 10], 5.00th=[ 29], 10.00th=[ 39], 20.00th=[ 41], 00:23:03.851 | 30.00th=[ 42], 40.00th=[ 43], 50.00th=[ 61], 60.00th=[ 81], 00:23:03.851 | 70.00th=[ 105], 80.00th=[ 176], 90.00th=[ 249], 95.00th=[ 275], 00:23:03.851 | 99.00th=[ 317], 99.50th=[ 351], 99.90th=[ 456], 99.95th=[ 468], 00:23:03.851 | 99.99th=[ 493] 00:23:03.851 bw ( KiB/s): min=51200, max=400384, per=11.98%, avg=162560.00, stdev=114945.94, samples=20 00:23:03.851 iops : min= 200, max= 1564, avg=635.00, stdev=449.01, samples=20 00:23:03.851 lat (msec) : 2=0.03%, 4=0.25%, 10=0.86%, 20=2.14%, 50=43.19% 00:23:03.851 lat (msec) : 100=22.77%, 250=20.91%, 500=9.85% 00:23:03.851 cpu : usr=1.95%, sys=2.09%, ctx=2426, majf=0, minf=1 00:23:03.851 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:23:03.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.851 issued rwts: total=0,6413,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.852 job5: (groupid=0, jobs=1): err= 0: pid=3349110: Tue Nov 26 05:19:04 2024 00:23:03.852 write: IOPS=461, BW=115MiB/s (121MB/s)(1184MiB/10252msec); 0 zone resets 00:23:03.852 slat (usec): min=18, max=140555, avg=1788.67, stdev=5498.34 00:23:03.852 clat (usec): min=1675, max=584440, avg=136326.83, stdev=104015.96 00:23:03.852 lat (usec): min=1762, max=584473, avg=138115.50, stdev=105380.82 00:23:03.852 clat percentiles (msec): 00:23:03.852 | 1.00th=[ 9], 5.00th=[ 22], 10.00th=[ 41], 20.00th=[ 42], 00:23:03.852 | 30.00th=[ 44], 40.00th=[ 62], 50.00th=[ 95], 60.00th=[ 142], 00:23:03.852 | 70.00th=[ 220], 80.00th=[ 253], 90.00th=[ 284], 95.00th=[ 309], 00:23:03.852 | 99.00th=[ 355], 99.50th=[ 405], 99.90th=[ 567], 99.95th=[ 567], 00:23:03.852 | 99.99th=[ 584] 00:23:03.852 bw ( KiB/s): min=51200, max=385536, per=8.82%, avg=119584.00, stdev=90634.18, samples=20 00:23:03.852 iops : min= 200, max= 1506, avg=467.10, stdev=354.06, samples=20 00:23:03.852 lat (msec) : 2=0.02%, 4=0.32%, 10=1.37%, 20=2.81%, 50=31.11% 00:23:03.852 lat (msec) : 100=16.92%, 250=26.88%, 500=20.36%, 750=0.21% 00:23:03.852 cpu : usr=1.55%, sys=1.68%, ctx=1903, majf=0, minf=1 00:23:03.852 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:03.852 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.852 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.852 issued rwts: total=0,4735,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.852 job6: (groupid=0, jobs=1): err= 0: pid=3349111: Tue Nov 26 05:19:04 2024 00:23:03.852 write: IOPS=351, BW=88.0MiB/s (92.2MB/s)(901MiB/10236msec); 0 zone resets 00:23:03.852 slat (usec): min=19, max=69061, avg=2226.65, stdev=5518.36 00:23:03.852 clat (usec): min=1040, max=548589, avg=179008.96, stdev=90236.82 00:23:03.852 lat (usec): min=1064, max=548632, avg=181235.61, stdev=91512.04 00:23:03.852 clat percentiles (msec): 00:23:03.852 | 1.00th=[ 6], 5.00th=[ 26], 10.00th=[ 47], 20.00th=[ 73], 00:23:03.852 | 30.00th=[ 144], 40.00th=[ 169], 50.00th=[ 188], 60.00th=[ 218], 00:23:03.852 | 70.00th=[ 234], 80.00th=[ 251], 90.00th=[ 279], 95.00th=[ 305], 00:23:03.852 | 99.00th=[ 405], 99.50th=[ 468], 99.90th=[ 535], 99.95th=[ 550], 00:23:03.852 | 99.99th=[ 550] 00:23:03.852 bw ( KiB/s): min=47616, max=174080, per=6.68%, avg=90605.40, stdev=36832.02, samples=20 00:23:03.852 iops : min= 186, max= 680, avg=353.90, stdev=143.89, samples=20 00:23:03.852 lat (msec) : 2=0.19%, 4=0.33%, 10=1.69%, 20=1.39%, 50=7.13% 00:23:03.852 lat (msec) : 100=11.99%, 250=56.58%, 500=20.29%, 750=0.39% 00:23:03.852 cpu : usr=1.21%, sys=1.26%, ctx=1722, majf=0, minf=1 00:23:03.852 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:23:03.852 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.852 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.852 issued rwts: total=0,3602,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.852 job7: (groupid=0, jobs=1): err= 0: pid=3349112: Tue Nov 26 05:19:04 2024 00:23:03.852 write: IOPS=498, BW=125MiB/s (131MB/s)(1277MiB/10236msec); 0 zone resets 00:23:03.852 slat (usec): min=23, max=58853, avg=1288.14, stdev=4096.28 00:23:03.852 clat (msec): min=2, max=483, avg=126.90, stdev=89.41 00:23:03.852 lat (msec): min=2, max=483, avg=128.18, stdev=90.55 00:23:03.852 clat percentiles (msec): 00:23:03.852 | 1.00th=[ 9], 5.00th=[ 22], 10.00th=[ 37], 20.00th=[ 43], 00:23:03.852 | 30.00th=[ 65], 40.00th=[ 80], 50.00th=[ 93], 60.00th=[ 126], 00:23:03.852 | 70.00th=[ 176], 80.00th=[ 230], 90.00th=[ 264], 95.00th=[ 279], 00:23:03.852 | 99.00th=[ 321], 99.50th=[ 384], 99.90th=[ 468], 99.95th=[ 468], 00:23:03.852 | 99.99th=[ 485] 00:23:03.852 bw ( KiB/s): min=53248, max=303104, per=9.52%, avg=129126.40, stdev=74237.97, samples=20 00:23:03.852 iops : min= 208, max= 1184, avg=504.40, stdev=289.99, samples=20 00:23:03.852 lat (msec) : 4=0.22%, 10=1.39%, 20=2.94%, 50=21.13%, 100=26.40% 00:23:03.852 lat (msec) : 250=33.09%, 500=14.84% 00:23:03.852 cpu : usr=1.61%, sys=1.71%, ctx=2970, majf=0, minf=1 00:23:03.852 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:03.852 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.852 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.852 issued rwts: total=0,5107,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.852 job8: (groupid=0, jobs=1): err= 0: pid=3349113: Tue Nov 26 05:19:04 2024 00:23:03.852 write: IOPS=464, BW=116MiB/s (122MB/s)(1174MiB/10101msec); 0 zone resets 00:23:03.852 slat (usec): min=17, max=65452, avg=1880.72, stdev=4344.49 00:23:03.852 clat (usec): min=1554, max=317283, avg=135730.68, stdev=71675.99 00:23:03.852 lat (usec): min=1594, max=317312, avg=137611.40, stdev=72804.76 00:23:03.852 clat percentiles (msec): 00:23:03.852 | 1.00th=[ 7], 5.00th=[ 20], 10.00th=[ 40], 20.00th=[ 75], 00:23:03.852 | 30.00th=[ 90], 40.00th=[ 110], 50.00th=[ 140], 60.00th=[ 163], 00:23:03.852 | 70.00th=[ 178], 80.00th=[ 199], 90.00th=[ 230], 95.00th=[ 255], 00:23:03.852 | 99.00th=[ 296], 99.50th=[ 309], 99.90th=[ 317], 99.95th=[ 317], 00:23:03.852 | 99.99th=[ 317] 00:23:03.852 bw ( KiB/s): min=55296, max=240640, per=8.74%, avg=118627.80, stdev=53066.82, samples=20 00:23:03.852 iops : min= 216, max= 940, avg=463.35, stdev=207.20, samples=20 00:23:03.852 lat (msec) : 2=0.02%, 4=0.28%, 10=1.90%, 20=2.98%, 50=10.33% 00:23:03.852 lat (msec) : 100=21.61%, 250=57.07%, 500=5.81% 00:23:03.852 cpu : usr=1.50%, sys=1.71%, ctx=1974, majf=0, minf=1 00:23:03.852 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:03.852 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.852 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.852 issued rwts: total=0,4696,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.852 job9: (groupid=0, jobs=1): err= 0: pid=3349114: Tue Nov 26 05:19:04 2024 00:23:03.852 write: IOPS=421, BW=105MiB/s (110MB/s)(1077MiB/10235msec); 0 zone resets 00:23:03.852 slat (usec): min=21, max=112228, avg=1698.23, stdev=5402.54 00:23:03.852 clat (usec): min=740, max=534372, avg=150224.35, stdev=102303.35 00:23:03.852 lat (usec): min=808, max=534422, avg=151922.59, stdev=103694.51 00:23:03.852 clat percentiles (msec): 00:23:03.852 | 1.00th=[ 3], 5.00th=[ 9], 10.00th=[ 14], 20.00th=[ 41], 00:23:03.852 | 30.00th=[ 78], 40.00th=[ 101], 50.00th=[ 150], 60.00th=[ 197], 00:23:03.852 | 70.00th=[ 222], 80.00th=[ 249], 90.00th=[ 288], 95.00th=[ 305], 00:23:03.852 | 99.00th=[ 351], 99.50th=[ 456], 99.90th=[ 518], 99.95th=[ 518], 00:23:03.852 | 99.99th=[ 535] 00:23:03.852 bw ( KiB/s): min=51200, max=195072, per=8.01%, avg=108697.60, stdev=48520.89, samples=20 00:23:03.852 iops : min= 200, max= 762, avg=424.60, stdev=189.53, samples=20 00:23:03.852 lat (usec) : 750=0.02%, 1000=0.05% 00:23:03.852 lat (msec) : 2=0.49%, 4=0.79%, 10=5.36%, 20=6.24%, 50=9.91% 00:23:03.852 lat (msec) : 100=16.55%, 250=40.87%, 500=19.49%, 750=0.23% 00:23:03.852 cpu : usr=1.29%, sys=1.65%, ctx=2600, majf=0, minf=1 00:23:03.852 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:23:03.852 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.852 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.852 issued rwts: total=0,4309,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.852 job10: (groupid=0, jobs=1): err= 0: pid=3349115: Tue Nov 26 05:19:04 2024 00:23:03.852 write: IOPS=455, BW=114MiB/s (119MB/s)(1167MiB/10255msec); 0 zone resets 00:23:03.852 slat (usec): min=16, max=166452, avg=1586.80, stdev=5230.83 00:23:03.852 clat (usec): min=827, max=549098, avg=138959.63, stdev=90649.71 00:23:03.852 lat (usec): min=899, max=549133, avg=140546.43, stdev=91824.72 00:23:03.852 clat percentiles (msec): 00:23:03.852 | 1.00th=[ 3], 5.00th=[ 14], 10.00th=[ 27], 20.00th=[ 47], 00:23:03.852 | 30.00th=[ 74], 40.00th=[ 112], 50.00th=[ 146], 60.00th=[ 169], 00:23:03.852 | 70.00th=[ 180], 80.00th=[ 197], 90.00th=[ 253], 95.00th=[ 300], 00:23:03.852 | 99.00th=[ 414], 99.50th=[ 468], 99.90th=[ 535], 99.95th=[ 535], 00:23:03.852 | 99.99th=[ 550] 00:23:03.852 bw ( KiB/s): min=37376, max=267264, per=8.69%, avg=117882.00, stdev=61485.76, samples=20 00:23:03.852 iops : min= 146, max= 1044, avg=460.45, stdev=240.14, samples=20 00:23:03.852 lat (usec) : 1000=0.26% 00:23:03.852 lat (msec) : 2=0.69%, 4=0.79%, 10=2.06%, 20=3.94%, 50=13.86% 00:23:03.852 lat (msec) : 100=15.43%, 250=52.60%, 500=10.16%, 750=0.21% 00:23:03.852 cpu : usr=1.43%, sys=1.69%, ctx=2680, majf=0, minf=1 00:23:03.852 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:03.852 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.852 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.852 issued rwts: total=0,4667,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.852 00:23:03.852 Run status group 0 (all jobs): 00:23:03.852 WRITE: bw=1325MiB/s (1389MB/s), 88.0MiB/s-157MiB/s (92.2MB/s-164MB/s), io=13.3GiB (14.2GB), run=10101-10255msec 00:23:03.852 00:23:03.852 Disk stats (read/write): 00:23:03.852 nvme0n1: ios=46/11828, merge=0/0, ticks=2624/1193502, in_queue=1196126, util=99.95% 00:23:03.852 nvme10n1: ios=53/9311, merge=0/0, ticks=4784/1190730, in_queue=1195514, util=100.00% 00:23:03.852 nvme1n1: ios=40/7898, merge=0/0, ticks=1044/1209047, in_queue=1210091, util=100.00% 00:23:03.852 nvme2n1: ios=20/12013, merge=0/0, ticks=307/1243962, in_queue=1244269, util=98.70% 00:23:03.852 nvme3n1: ios=26/12793, merge=0/0, ticks=2148/1187061, in_queue=1189209, util=100.00% 00:23:03.852 nvme4n1: ios=47/9419, merge=0/0, ticks=2825/1230372, in_queue=1233197, util=100.00% 00:23:03.852 nvme5n1: ios=43/7174, merge=0/0, ticks=1105/1234462, in_queue=1235567, util=100.00% 00:23:03.852 nvme6n1: ios=0/10180, merge=0/0, ticks=0/1245842, in_queue=1245842, util=98.45% 00:23:03.852 nvme7n1: ios=0/9118, merge=0/0, ticks=0/1209700, in_queue=1209700, util=98.83% 00:23:03.852 nvme8n1: ios=0/8585, merge=0/0, ticks=0/1241666, in_queue=1241666, util=98.98% 00:23:03.852 nvme9n1: ios=0/9275, merge=0/0, ticks=0/1236353, in_queue=1236353, util=99.14% 00:23:03.852 05:19:04 -- target/multiconnection.sh@36 -- # sync 00:23:03.852 05:19:04 -- target/multiconnection.sh@37 -- # seq 1 11 00:23:03.852 05:19:04 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:03.852 05:19:04 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:03.853 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:03.853 05:19:04 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:23:03.853 05:19:04 -- common/autotest_common.sh@1208 -- # local i=0 00:23:03.853 05:19:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:03.853 05:19:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:23:03.853 05:19:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:03.853 05:19:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:23:03.853 05:19:04 -- common/autotest_common.sh@1220 -- # return 0 00:23:03.853 05:19:04 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:03.853 05:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.853 05:19:04 -- common/autotest_common.sh@10 -- # set +x 00:23:03.853 05:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.853 05:19:04 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:03.853 05:19:04 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:23:03.853 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:23:03.853 05:19:05 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:23:03.853 05:19:05 -- common/autotest_common.sh@1208 -- # local i=0 00:23:03.853 05:19:05 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:03.853 05:19:05 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:23:03.853 05:19:05 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:03.853 05:19:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:23:03.853 05:19:05 -- common/autotest_common.sh@1220 -- # return 0 00:23:03.853 05:19:05 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:03.853 05:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.853 05:19:05 -- common/autotest_common.sh@10 -- # set +x 00:23:03.853 05:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.853 05:19:05 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:03.853 05:19:05 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:23:03.853 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:23:03.853 05:19:05 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:23:03.853 05:19:05 -- common/autotest_common.sh@1208 -- # local i=0 00:23:03.853 05:19:05 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:03.853 05:19:05 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:23:03.853 05:19:05 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:03.853 05:19:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:23:03.853 05:19:05 -- common/autotest_common.sh@1220 -- # return 0 00:23:03.853 05:19:05 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:03.853 05:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.853 05:19:05 -- common/autotest_common.sh@10 -- # set +x 00:23:04.112 05:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.112 05:19:05 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:04.112 05:19:05 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:23:04.112 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:23:04.112 05:19:05 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:23:04.112 05:19:05 -- common/autotest_common.sh@1208 -- # local i=0 00:23:04.112 05:19:05 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:04.112 05:19:05 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:23:04.112 05:19:05 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:04.112 05:19:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:23:04.112 05:19:05 -- common/autotest_common.sh@1220 -- # return 0 00:23:04.112 05:19:05 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:23:04.112 05:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.112 05:19:05 -- common/autotest_common.sh@10 -- # set +x 00:23:04.112 05:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.112 05:19:05 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:04.112 05:19:05 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:23:04.371 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:23:04.371 05:19:06 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:23:04.371 05:19:06 -- common/autotest_common.sh@1208 -- # local i=0 00:23:04.371 05:19:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:04.371 05:19:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:23:04.371 05:19:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:04.371 05:19:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:23:04.371 05:19:06 -- common/autotest_common.sh@1220 -- # return 0 00:23:04.371 05:19:06 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:23:04.371 05:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.371 05:19:06 -- common/autotest_common.sh@10 -- # set +x 00:23:04.371 05:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.371 05:19:06 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:04.371 05:19:06 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:23:04.629 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:23:04.629 05:19:06 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:23:04.629 05:19:06 -- common/autotest_common.sh@1208 -- # local i=0 00:23:04.629 05:19:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:04.629 05:19:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:23:04.629 05:19:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:04.629 05:19:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:23:04.629 05:19:06 -- common/autotest_common.sh@1220 -- # return 0 00:23:04.629 05:19:06 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:23:04.629 05:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.629 05:19:06 -- common/autotest_common.sh@10 -- # set +x 00:23:04.629 05:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.629 05:19:06 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:04.629 05:19:06 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:23:04.888 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:23:04.888 05:19:06 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:23:04.888 05:19:06 -- common/autotest_common.sh@1208 -- # local i=0 00:23:04.888 05:19:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:04.888 05:19:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:23:04.888 05:19:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:04.888 05:19:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:23:04.888 05:19:06 -- common/autotest_common.sh@1220 -- # return 0 00:23:04.888 05:19:06 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:23:04.888 05:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.888 05:19:06 -- common/autotest_common.sh@10 -- # set +x 00:23:04.888 05:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.888 05:19:06 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:04.888 05:19:06 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:23:04.888 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:23:04.888 05:19:06 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:23:04.888 05:19:06 -- common/autotest_common.sh@1208 -- # local i=0 00:23:04.888 05:19:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:04.888 05:19:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:23:04.888 05:19:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:04.888 05:19:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:23:04.888 05:19:06 -- common/autotest_common.sh@1220 -- # return 0 00:23:04.888 05:19:06 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:23:04.888 05:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.888 05:19:06 -- common/autotest_common.sh@10 -- # set +x 00:23:04.888 05:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.888 05:19:06 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:04.888 05:19:06 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:23:05.146 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:23:05.146 05:19:06 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:23:05.146 05:19:06 -- common/autotest_common.sh@1208 -- # local i=0 00:23:05.146 05:19:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:05.146 05:19:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:23:05.146 05:19:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:05.146 05:19:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:23:05.146 05:19:06 -- common/autotest_common.sh@1220 -- # return 0 00:23:05.146 05:19:06 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:23:05.146 05:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.146 05:19:06 -- common/autotest_common.sh@10 -- # set +x 00:23:05.146 05:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.146 05:19:06 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:05.146 05:19:06 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:23:05.146 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:23:05.146 05:19:06 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:23:05.146 05:19:06 -- common/autotest_common.sh@1208 -- # local i=0 00:23:05.146 05:19:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:05.146 05:19:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:23:05.146 05:19:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:05.146 05:19:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:23:05.146 05:19:06 -- common/autotest_common.sh@1220 -- # return 0 00:23:05.146 05:19:06 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:23:05.146 05:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.146 05:19:06 -- common/autotest_common.sh@10 -- # set +x 00:23:05.146 05:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.146 05:19:06 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:05.146 05:19:06 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:23:05.405 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:23:05.405 05:19:06 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:23:05.406 05:19:06 -- common/autotest_common.sh@1208 -- # local i=0 00:23:05.406 05:19:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:05.406 05:19:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:23:05.406 05:19:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:05.406 05:19:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:23:05.406 05:19:06 -- common/autotest_common.sh@1220 -- # return 0 00:23:05.406 05:19:06 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:23:05.406 05:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.406 05:19:06 -- common/autotest_common.sh@10 -- # set +x 00:23:05.406 05:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.406 05:19:06 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:23:05.406 05:19:06 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:23:05.406 05:19:06 -- target/multiconnection.sh@47 -- # nvmftestfini 00:23:05.406 05:19:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:05.406 05:19:06 -- nvmf/common.sh@116 -- # sync 00:23:05.406 05:19:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:05.406 05:19:06 -- nvmf/common.sh@119 -- # set +e 00:23:05.406 05:19:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:05.406 05:19:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:05.406 rmmod nvme_tcp 00:23:05.406 rmmod nvme_fabrics 00:23:05.406 rmmod nvme_keyring 00:23:05.406 05:19:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:05.406 05:19:07 -- nvmf/common.sh@123 -- # set -e 00:23:05.406 05:19:07 -- nvmf/common.sh@124 -- # return 0 00:23:05.406 05:19:07 -- nvmf/common.sh@477 -- # '[' -n 3343501 ']' 00:23:05.406 05:19:07 -- nvmf/common.sh@478 -- # killprocess 3343501 00:23:05.406 05:19:07 -- common/autotest_common.sh@936 -- # '[' -z 3343501 ']' 00:23:05.406 05:19:07 -- common/autotest_common.sh@940 -- # kill -0 3343501 00:23:05.406 05:19:07 -- common/autotest_common.sh@941 -- # uname 00:23:05.406 05:19:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:05.406 05:19:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3343501 00:23:05.406 05:19:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:05.406 05:19:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:05.406 05:19:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3343501' 00:23:05.406 killing process with pid 3343501 00:23:05.406 05:19:07 -- common/autotest_common.sh@955 -- # kill 3343501 00:23:05.406 05:19:07 -- common/autotest_common.sh@960 -- # wait 3343501 00:23:05.973 05:19:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:05.973 05:19:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:05.973 05:19:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:05.974 05:19:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:05.974 05:19:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:05.974 05:19:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:05.974 05:19:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:05.974 05:19:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:07.881 05:19:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:07.881 00:23:07.881 real 1m1.529s 00:23:07.881 user 3m24.043s 00:23:07.881 sys 0m26.538s 00:23:07.881 05:19:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:07.881 05:19:09 -- common/autotest_common.sh@10 -- # set +x 00:23:07.881 ************************************ 00:23:07.881 END TEST nvmf_multiconnection 00:23:07.881 ************************************ 00:23:07.881 05:19:09 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:07.881 05:19:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:07.881 05:19:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:07.881 05:19:09 -- common/autotest_common.sh@10 -- # set +x 00:23:07.881 ************************************ 00:23:07.881 START TEST nvmf_initiator_timeout 00:23:07.881 ************************************ 00:23:07.881 05:19:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:08.140 * Looking for test storage... 00:23:08.140 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:08.140 05:19:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:08.140 05:19:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:08.140 05:19:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:08.140 05:19:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:08.140 05:19:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:08.140 05:19:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:08.140 05:19:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:08.140 05:19:09 -- scripts/common.sh@335 -- # IFS=.-: 00:23:08.140 05:19:09 -- scripts/common.sh@335 -- # read -ra ver1 00:23:08.140 05:19:09 -- scripts/common.sh@336 -- # IFS=.-: 00:23:08.140 05:19:09 -- scripts/common.sh@336 -- # read -ra ver2 00:23:08.140 05:19:09 -- scripts/common.sh@337 -- # local 'op=<' 00:23:08.140 05:19:09 -- scripts/common.sh@339 -- # ver1_l=2 00:23:08.140 05:19:09 -- scripts/common.sh@340 -- # ver2_l=1 00:23:08.140 05:19:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:08.140 05:19:09 -- scripts/common.sh@343 -- # case "$op" in 00:23:08.140 05:19:09 -- scripts/common.sh@344 -- # : 1 00:23:08.140 05:19:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:08.140 05:19:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:08.140 05:19:09 -- scripts/common.sh@364 -- # decimal 1 00:23:08.140 05:19:09 -- scripts/common.sh@352 -- # local d=1 00:23:08.140 05:19:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:08.140 05:19:09 -- scripts/common.sh@354 -- # echo 1 00:23:08.140 05:19:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:08.140 05:19:09 -- scripts/common.sh@365 -- # decimal 2 00:23:08.140 05:19:09 -- scripts/common.sh@352 -- # local d=2 00:23:08.140 05:19:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:08.140 05:19:09 -- scripts/common.sh@354 -- # echo 2 00:23:08.140 05:19:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:08.140 05:19:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:08.140 05:19:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:08.140 05:19:09 -- scripts/common.sh@367 -- # return 0 00:23:08.140 05:19:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:08.140 05:19:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:08.140 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.140 --rc genhtml_branch_coverage=1 00:23:08.140 --rc genhtml_function_coverage=1 00:23:08.140 --rc genhtml_legend=1 00:23:08.140 --rc geninfo_all_blocks=1 00:23:08.140 --rc geninfo_unexecuted_blocks=1 00:23:08.140 00:23:08.140 ' 00:23:08.140 05:19:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:08.140 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.140 --rc genhtml_branch_coverage=1 00:23:08.140 --rc genhtml_function_coverage=1 00:23:08.140 --rc genhtml_legend=1 00:23:08.140 --rc geninfo_all_blocks=1 00:23:08.140 --rc geninfo_unexecuted_blocks=1 00:23:08.140 00:23:08.140 ' 00:23:08.140 05:19:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:08.140 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.140 --rc genhtml_branch_coverage=1 00:23:08.140 --rc genhtml_function_coverage=1 00:23:08.140 --rc genhtml_legend=1 00:23:08.140 --rc geninfo_all_blocks=1 00:23:08.140 --rc geninfo_unexecuted_blocks=1 00:23:08.140 00:23:08.140 ' 00:23:08.140 05:19:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:08.140 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.140 --rc genhtml_branch_coverage=1 00:23:08.140 --rc genhtml_function_coverage=1 00:23:08.140 --rc genhtml_legend=1 00:23:08.140 --rc geninfo_all_blocks=1 00:23:08.140 --rc geninfo_unexecuted_blocks=1 00:23:08.140 00:23:08.140 ' 00:23:08.140 05:19:09 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:08.140 05:19:09 -- nvmf/common.sh@7 -- # uname -s 00:23:08.140 05:19:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:08.140 05:19:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:08.140 05:19:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:08.140 05:19:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:08.140 05:19:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:08.140 05:19:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:08.140 05:19:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:08.140 05:19:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:08.140 05:19:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:08.140 05:19:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:08.140 05:19:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.140 05:19:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.140 05:19:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:08.140 05:19:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:08.140 05:19:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:08.140 05:19:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:08.140 05:19:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:08.140 05:19:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:08.140 05:19:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:08.140 05:19:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.141 05:19:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.141 05:19:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.141 05:19:09 -- paths/export.sh@5 -- # export PATH 00:23:08.141 05:19:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.141 05:19:09 -- nvmf/common.sh@46 -- # : 0 00:23:08.141 05:19:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:08.141 05:19:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:08.141 05:19:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:08.141 05:19:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:08.141 05:19:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:08.141 05:19:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:08.141 05:19:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:08.141 05:19:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:08.141 05:19:09 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:08.141 05:19:09 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:08.141 05:19:09 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:23:08.141 05:19:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:08.141 05:19:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:08.141 05:19:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:08.141 05:19:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:08.141 05:19:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:08.141 05:19:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:08.141 05:19:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:08.141 05:19:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:08.141 05:19:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:08.141 05:19:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:08.141 05:19:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:08.141 05:19:09 -- common/autotest_common.sh@10 -- # set +x 00:23:10.674 05:19:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:10.674 05:19:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:10.674 05:19:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:10.674 05:19:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:10.674 05:19:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:10.674 05:19:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:10.674 05:19:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:10.674 05:19:11 -- nvmf/common.sh@294 -- # net_devs=() 00:23:10.674 05:19:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:10.674 05:19:11 -- nvmf/common.sh@295 -- # e810=() 00:23:10.674 05:19:11 -- nvmf/common.sh@295 -- # local -ga e810 00:23:10.674 05:19:11 -- nvmf/common.sh@296 -- # x722=() 00:23:10.674 05:19:11 -- nvmf/common.sh@296 -- # local -ga x722 00:23:10.674 05:19:11 -- nvmf/common.sh@297 -- # mlx=() 00:23:10.674 05:19:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:10.674 05:19:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:10.674 05:19:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:10.674 05:19:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:10.674 05:19:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:10.674 05:19:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:10.674 05:19:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:10.674 05:19:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:10.674 05:19:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:10.674 05:19:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:10.674 05:19:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:10.674 05:19:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:10.674 05:19:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:10.674 05:19:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:10.674 05:19:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:10.674 05:19:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:10.674 05:19:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:10.674 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:10.674 05:19:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:10.674 05:19:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:10.674 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:10.674 05:19:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:10.674 05:19:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:10.674 05:19:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:10.674 05:19:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:10.674 05:19:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:10.674 05:19:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:10.674 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:10.674 05:19:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:10.674 05:19:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:10.674 05:19:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:10.674 05:19:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:10.674 05:19:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:10.674 05:19:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:10.674 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:10.674 05:19:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:10.674 05:19:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:10.674 05:19:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:10.674 05:19:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:10.674 05:19:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:10.674 05:19:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:10.674 05:19:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:10.674 05:19:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:10.674 05:19:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:10.674 05:19:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:10.674 05:19:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:10.674 05:19:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:10.674 05:19:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:10.674 05:19:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:10.674 05:19:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:10.674 05:19:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:10.674 05:19:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:10.674 05:19:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:10.674 05:19:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:10.674 05:19:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:10.674 05:19:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:10.674 05:19:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:10.674 05:19:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:10.674 05:19:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:10.674 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:10.674 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:23:10.674 00:23:10.674 --- 10.0.0.2 ping statistics --- 00:23:10.674 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:10.674 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:23:10.674 05:19:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:10.674 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:10.674 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:23:10.674 00:23:10.674 --- 10.0.0.1 ping statistics --- 00:23:10.674 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:10.674 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:23:10.674 05:19:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:10.674 05:19:11 -- nvmf/common.sh@410 -- # return 0 00:23:10.674 05:19:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:10.674 05:19:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:10.674 05:19:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:10.674 05:19:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:10.674 05:19:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:10.674 05:19:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:10.674 05:19:11 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:23:10.674 05:19:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:10.675 05:19:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:10.675 05:19:11 -- common/autotest_common.sh@10 -- # set +x 00:23:10.675 05:19:11 -- nvmf/common.sh@469 -- # nvmfpid=3352506 00:23:10.675 05:19:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:10.675 05:19:11 -- nvmf/common.sh@470 -- # waitforlisten 3352506 00:23:10.675 05:19:11 -- common/autotest_common.sh@829 -- # '[' -z 3352506 ']' 00:23:10.675 05:19:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:10.675 05:19:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:10.675 05:19:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:10.675 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:10.675 05:19:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:10.675 05:19:11 -- common/autotest_common.sh@10 -- # set +x 00:23:10.675 [2024-11-26 05:19:12.031743] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:10.675 [2024-11-26 05:19:12.031813] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:10.675 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.675 [2024-11-26 05:19:12.104309] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:10.675 [2024-11-26 05:19:12.197844] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:10.675 [2024-11-26 05:19:12.198035] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:10.675 [2024-11-26 05:19:12.198067] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:10.675 [2024-11-26 05:19:12.198090] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:10.675 [2024-11-26 05:19:12.198159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:10.675 [2024-11-26 05:19:12.198223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:10.675 [2024-11-26 05:19:12.198291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:10.675 [2024-11-26 05:19:12.198282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:11.609 05:19:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:11.609 05:19:13 -- common/autotest_common.sh@862 -- # return 0 00:23:11.609 05:19:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:11.609 05:19:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:11.609 05:19:13 -- common/autotest_common.sh@10 -- # set +x 00:23:11.609 05:19:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:11.609 05:19:13 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:23:11.609 05:19:13 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:11.609 05:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.609 05:19:13 -- common/autotest_common.sh@10 -- # set +x 00:23:11.609 Malloc0 00:23:11.609 05:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.609 05:19:13 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:23:11.609 05:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.609 05:19:13 -- common/autotest_common.sh@10 -- # set +x 00:23:11.609 Delay0 00:23:11.609 05:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.609 05:19:13 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:11.609 05:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.609 05:19:13 -- common/autotest_common.sh@10 -- # set +x 00:23:11.609 [2024-11-26 05:19:13.183106] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:11.609 05:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.609 05:19:13 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:23:11.609 05:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.609 05:19:13 -- common/autotest_common.sh@10 -- # set +x 00:23:11.609 05:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.609 05:19:13 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:23:11.609 05:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.609 05:19:13 -- common/autotest_common.sh@10 -- # set +x 00:23:11.609 05:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.609 05:19:13 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:11.609 05:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.609 05:19:13 -- common/autotest_common.sh@10 -- # set +x 00:23:11.609 [2024-11-26 05:19:13.211484] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:11.609 05:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.609 05:19:13 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:12.175 05:19:13 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:23:12.175 05:19:13 -- common/autotest_common.sh@1187 -- # local i=0 00:23:12.175 05:19:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:12.175 05:19:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:12.175 05:19:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:14.701 05:19:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:14.701 05:19:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:14.701 05:19:15 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:23:14.701 05:19:15 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:14.701 05:19:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:14.701 05:19:15 -- common/autotest_common.sh@1197 -- # return 0 00:23:14.701 05:19:15 -- target/initiator_timeout.sh@35 -- # fio_pid=3353074 00:23:14.701 05:19:15 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:14.701 05:19:15 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:14.701 [global] 00:23:14.701 thread=1 00:23:14.701 invalidate=1 00:23:14.701 rw=write 00:23:14.701 time_based=1 00:23:14.701 runtime=60 00:23:14.701 ioengine=libaio 00:23:14.701 direct=1 00:23:14.701 bs=4096 00:23:14.701 iodepth=1 00:23:14.701 norandommap=0 00:23:14.701 numjobs=1 00:23:14.701 00:23:14.701 verify_dump=1 00:23:14.701 verify_backlog=512 00:23:14.701 verify_state_save=0 00:23:14.701 do_verify=1 00:23:14.701 verify=crc32c-intel 00:23:14.701 [job0] 00:23:14.701 filename=/dev/nvme0n1 00:23:14.701 Could not set queue depth (nvme0n1) 00:23:14.701 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:14.701 fio-3.35 00:23:14.701 Starting 1 thread 00:23:17.227 05:19:18 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:17.227 05:19:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.227 05:19:18 -- common/autotest_common.sh@10 -- # set +x 00:23:17.227 true 00:23:17.227 05:19:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.227 05:19:18 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:17.227 05:19:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.227 05:19:18 -- common/autotest_common.sh@10 -- # set +x 00:23:17.227 true 00:23:17.227 05:19:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.227 05:19:18 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:17.227 05:19:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.227 05:19:18 -- common/autotest_common.sh@10 -- # set +x 00:23:17.227 true 00:23:17.227 05:19:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.227 05:19:18 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:17.227 05:19:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.227 05:19:18 -- common/autotest_common.sh@10 -- # set +x 00:23:17.227 true 00:23:17.227 05:19:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.227 05:19:18 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:20.506 05:19:21 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:20.506 05:19:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.506 05:19:21 -- common/autotest_common.sh@10 -- # set +x 00:23:20.506 true 00:23:20.506 05:19:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.506 05:19:21 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:20.506 05:19:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.506 05:19:21 -- common/autotest_common.sh@10 -- # set +x 00:23:20.506 true 00:23:20.506 05:19:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.506 05:19:21 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:20.506 05:19:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.506 05:19:21 -- common/autotest_common.sh@10 -- # set +x 00:23:20.506 true 00:23:20.506 05:19:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.506 05:19:21 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:20.506 05:19:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.506 05:19:21 -- common/autotest_common.sh@10 -- # set +x 00:23:20.506 true 00:23:20.506 05:19:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.506 05:19:21 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:20.506 05:19:21 -- target/initiator_timeout.sh@54 -- # wait 3353074 00:24:16.753 00:24:16.753 job0: (groupid=0, jobs=1): err= 0: pid=3353146: Tue Nov 26 05:20:16 2024 00:24:16.753 read: IOPS=133, BW=535KiB/s (548kB/s)(31.4MiB/60009msec) 00:24:16.753 slat (usec): min=4, max=7555, avg=16.62, stdev=113.93 00:24:16.753 clat (usec): min=242, max=43017, avg=2080.41, stdev=8304.93 00:24:16.753 lat (usec): min=250, max=43052, avg=2097.03, stdev=8307.22 00:24:16.753 clat percentiles (usec): 00:24:16.753 | 1.00th=[ 258], 5.00th=[ 269], 10.00th=[ 273], 20.00th=[ 281], 00:24:16.753 | 30.00th=[ 293], 40.00th=[ 302], 50.00th=[ 310], 60.00th=[ 314], 00:24:16.753 | 70.00th=[ 322], 80.00th=[ 330], 90.00th=[ 347], 95.00th=[ 465], 00:24:16.753 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:24:16.753 | 99.99th=[43254] 00:24:16.753 write: IOPS=136, BW=546KiB/s (559kB/s)(32.0MiB/60009msec); 0 zone resets 00:24:16.753 slat (usec): min=5, max=31980, avg=19.70, stdev=353.25 00:24:16.753 clat (usec): min=175, max=41065k, avg=5241.18, stdev=453704.22 00:24:16.753 lat (usec): min=183, max=41065k, avg=5260.88, stdev=453704.22 00:24:16.753 clat percentiles (usec): 00:24:16.753 | 1.00th=[ 186], 5.00th=[ 192], 10.00th=[ 196], 00:24:16.753 | 20.00th=[ 202], 30.00th=[ 206], 40.00th=[ 212], 00:24:16.753 | 50.00th=[ 221], 60.00th=[ 229], 70.00th=[ 235], 00:24:16.753 | 80.00th=[ 245], 90.00th=[ 273], 95.00th=[ 289], 00:24:16.753 | 99.00th=[ 355], 99.50th=[ 388], 99.90th=[ 424], 00:24:16.753 | 99.95th=[ 441], 99.99th=[17112761] 00:24:16.753 bw ( KiB/s): min= 2096, max= 8192, per=100.00%, avg=5957.82, stdev=2226.46, samples=11 00:24:16.753 iops : min= 524, max= 2048, avg=1489.45, stdev=556.61, samples=11 00:24:16.753 lat (usec) : 250=41.95%, 500=55.75%, 750=0.11%, 1000=0.01% 00:24:16.753 lat (msec) : 2=0.02%, 10=0.01%, 50=2.16%, >=2000=0.01% 00:24:16.753 cpu : usr=0.31%, sys=0.48%, ctx=16229, majf=0, minf=1 00:24:16.753 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:16.753 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:16.753 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:16.753 issued rwts: total=8030,8192,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:16.753 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:16.753 00:24:16.753 Run status group 0 (all jobs): 00:24:16.753 READ: bw=535KiB/s (548kB/s), 535KiB/s-535KiB/s (548kB/s-548kB/s), io=31.4MiB (32.9MB), run=60009-60009msec 00:24:16.753 WRITE: bw=546KiB/s (559kB/s), 546KiB/s-546KiB/s (559kB/s-559kB/s), io=32.0MiB (33.6MB), run=60009-60009msec 00:24:16.753 00:24:16.753 Disk stats (read/write): 00:24:16.753 nvme0n1: ios=8079/8192, merge=0/0, ticks=17827/1778, in_queue=19605, util=99.83% 00:24:16.753 05:20:16 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:16.753 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:16.753 05:20:16 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:16.753 05:20:16 -- common/autotest_common.sh@1208 -- # local i=0 00:24:16.753 05:20:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:16.753 05:20:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:16.753 05:20:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:16.753 05:20:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:16.753 05:20:16 -- common/autotest_common.sh@1220 -- # return 0 00:24:16.753 05:20:16 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:16.753 05:20:16 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:16.753 nvmf hotplug test: fio successful as expected 00:24:16.753 05:20:16 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:16.753 05:20:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:16.753 05:20:16 -- common/autotest_common.sh@10 -- # set +x 00:24:16.753 05:20:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:16.753 05:20:16 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:16.753 05:20:16 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:16.753 05:20:16 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:16.753 05:20:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:16.753 05:20:16 -- nvmf/common.sh@116 -- # sync 00:24:16.753 05:20:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:16.753 05:20:16 -- nvmf/common.sh@119 -- # set +e 00:24:16.753 05:20:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:16.753 05:20:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:16.753 rmmod nvme_tcp 00:24:16.753 rmmod nvme_fabrics 00:24:16.753 rmmod nvme_keyring 00:24:16.753 05:20:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:16.753 05:20:16 -- nvmf/common.sh@123 -- # set -e 00:24:16.753 05:20:16 -- nvmf/common.sh@124 -- # return 0 00:24:16.753 05:20:16 -- nvmf/common.sh@477 -- # '[' -n 3352506 ']' 00:24:16.753 05:20:16 -- nvmf/common.sh@478 -- # killprocess 3352506 00:24:16.753 05:20:16 -- common/autotest_common.sh@936 -- # '[' -z 3352506 ']' 00:24:16.753 05:20:16 -- common/autotest_common.sh@940 -- # kill -0 3352506 00:24:16.753 05:20:16 -- common/autotest_common.sh@941 -- # uname 00:24:16.753 05:20:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:16.753 05:20:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3352506 00:24:16.753 05:20:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:16.753 05:20:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:16.753 05:20:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3352506' 00:24:16.753 killing process with pid 3352506 00:24:16.753 05:20:16 -- common/autotest_common.sh@955 -- # kill 3352506 00:24:16.753 05:20:16 -- common/autotest_common.sh@960 -- # wait 3352506 00:24:16.753 05:20:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:16.753 05:20:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:16.753 05:20:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:16.753 05:20:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:16.753 05:20:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:16.753 05:20:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:16.753 05:20:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:16.753 05:20:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:17.322 05:20:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:17.322 00:24:17.322 real 1m9.173s 00:24:17.322 user 4m14.882s 00:24:17.322 sys 0m6.719s 00:24:17.322 05:20:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:17.322 05:20:18 -- common/autotest_common.sh@10 -- # set +x 00:24:17.322 ************************************ 00:24:17.322 END TEST nvmf_initiator_timeout 00:24:17.322 ************************************ 00:24:17.322 05:20:18 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:17.322 05:20:18 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:17.322 05:20:18 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:17.322 05:20:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:17.322 05:20:18 -- common/autotest_common.sh@10 -- # set +x 00:24:19.228 05:20:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:19.228 05:20:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:19.228 05:20:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:19.228 05:20:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:19.228 05:20:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:19.228 05:20:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:19.228 05:20:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:19.228 05:20:20 -- nvmf/common.sh@294 -- # net_devs=() 00:24:19.228 05:20:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:19.228 05:20:20 -- nvmf/common.sh@295 -- # e810=() 00:24:19.228 05:20:20 -- nvmf/common.sh@295 -- # local -ga e810 00:24:19.228 05:20:20 -- nvmf/common.sh@296 -- # x722=() 00:24:19.228 05:20:20 -- nvmf/common.sh@296 -- # local -ga x722 00:24:19.228 05:20:20 -- nvmf/common.sh@297 -- # mlx=() 00:24:19.228 05:20:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:19.228 05:20:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:19.228 05:20:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:19.228 05:20:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:19.228 05:20:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:19.228 05:20:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:19.228 05:20:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:19.228 05:20:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:19.228 05:20:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:19.228 05:20:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:19.228 05:20:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:19.228 05:20:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:19.228 05:20:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:19.228 05:20:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:19.228 05:20:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:19.229 05:20:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:19.229 05:20:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:19.229 05:20:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:19.229 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:19.229 05:20:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:19.229 05:20:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:19.229 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:19.229 05:20:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:19.229 05:20:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:19.229 05:20:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:19.229 05:20:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:19.229 05:20:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:19.229 05:20:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:19.229 05:20:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:19.229 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:19.229 05:20:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:19.229 05:20:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:19.229 05:20:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:19.229 05:20:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:19.229 05:20:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:19.229 05:20:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:19.229 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:19.229 05:20:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:19.229 05:20:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:19.229 05:20:20 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:19.229 05:20:20 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:19.229 05:20:20 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:19.229 05:20:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:19.229 05:20:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:19.229 05:20:20 -- common/autotest_common.sh@10 -- # set +x 00:24:19.229 ************************************ 00:24:19.229 START TEST nvmf_perf_adq 00:24:19.229 ************************************ 00:24:19.229 05:20:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:19.229 * Looking for test storage... 00:24:19.229 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:19.229 05:20:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:19.229 05:20:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:19.229 05:20:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:19.488 05:20:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:19.488 05:20:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:19.488 05:20:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:19.488 05:20:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:19.488 05:20:21 -- scripts/common.sh@335 -- # IFS=.-: 00:24:19.488 05:20:21 -- scripts/common.sh@335 -- # read -ra ver1 00:24:19.488 05:20:21 -- scripts/common.sh@336 -- # IFS=.-: 00:24:19.488 05:20:21 -- scripts/common.sh@336 -- # read -ra ver2 00:24:19.488 05:20:21 -- scripts/common.sh@337 -- # local 'op=<' 00:24:19.488 05:20:21 -- scripts/common.sh@339 -- # ver1_l=2 00:24:19.488 05:20:21 -- scripts/common.sh@340 -- # ver2_l=1 00:24:19.488 05:20:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:19.488 05:20:21 -- scripts/common.sh@343 -- # case "$op" in 00:24:19.488 05:20:21 -- scripts/common.sh@344 -- # : 1 00:24:19.488 05:20:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:19.488 05:20:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:19.488 05:20:21 -- scripts/common.sh@364 -- # decimal 1 00:24:19.488 05:20:21 -- scripts/common.sh@352 -- # local d=1 00:24:19.488 05:20:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:19.488 05:20:21 -- scripts/common.sh@354 -- # echo 1 00:24:19.488 05:20:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:19.488 05:20:21 -- scripts/common.sh@365 -- # decimal 2 00:24:19.488 05:20:21 -- scripts/common.sh@352 -- # local d=2 00:24:19.488 05:20:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:19.488 05:20:21 -- scripts/common.sh@354 -- # echo 2 00:24:19.488 05:20:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:19.488 05:20:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:19.488 05:20:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:19.488 05:20:21 -- scripts/common.sh@367 -- # return 0 00:24:19.488 05:20:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:19.488 05:20:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:19.488 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:19.488 --rc genhtml_branch_coverage=1 00:24:19.488 --rc genhtml_function_coverage=1 00:24:19.488 --rc genhtml_legend=1 00:24:19.488 --rc geninfo_all_blocks=1 00:24:19.488 --rc geninfo_unexecuted_blocks=1 00:24:19.488 00:24:19.488 ' 00:24:19.488 05:20:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:19.488 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:19.488 --rc genhtml_branch_coverage=1 00:24:19.488 --rc genhtml_function_coverage=1 00:24:19.488 --rc genhtml_legend=1 00:24:19.488 --rc geninfo_all_blocks=1 00:24:19.488 --rc geninfo_unexecuted_blocks=1 00:24:19.488 00:24:19.488 ' 00:24:19.488 05:20:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:19.488 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:19.488 --rc genhtml_branch_coverage=1 00:24:19.488 --rc genhtml_function_coverage=1 00:24:19.488 --rc genhtml_legend=1 00:24:19.488 --rc geninfo_all_blocks=1 00:24:19.488 --rc geninfo_unexecuted_blocks=1 00:24:19.488 00:24:19.488 ' 00:24:19.488 05:20:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:19.488 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:19.488 --rc genhtml_branch_coverage=1 00:24:19.488 --rc genhtml_function_coverage=1 00:24:19.488 --rc genhtml_legend=1 00:24:19.488 --rc geninfo_all_blocks=1 00:24:19.488 --rc geninfo_unexecuted_blocks=1 00:24:19.488 00:24:19.488 ' 00:24:19.488 05:20:21 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:19.488 05:20:21 -- nvmf/common.sh@7 -- # uname -s 00:24:19.488 05:20:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:19.488 05:20:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:19.488 05:20:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:19.488 05:20:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:19.488 05:20:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:19.488 05:20:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:19.488 05:20:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:19.488 05:20:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:19.488 05:20:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:19.488 05:20:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:19.488 05:20:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:19.488 05:20:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:19.488 05:20:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:19.488 05:20:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:19.488 05:20:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:19.488 05:20:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:19.488 05:20:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:19.488 05:20:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:19.488 05:20:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:19.488 05:20:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:19.488 05:20:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:19.488 05:20:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:19.488 05:20:21 -- paths/export.sh@5 -- # export PATH 00:24:19.488 05:20:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:19.488 05:20:21 -- nvmf/common.sh@46 -- # : 0 00:24:19.488 05:20:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:19.488 05:20:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:19.488 05:20:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:19.488 05:20:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:19.488 05:20:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:19.488 05:20:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:19.488 05:20:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:19.488 05:20:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:19.488 05:20:21 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:19.488 05:20:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:19.488 05:20:21 -- common/autotest_common.sh@10 -- # set +x 00:24:21.392 05:20:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:21.392 05:20:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:21.392 05:20:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:21.392 05:20:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:21.392 05:20:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:21.392 05:20:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:21.392 05:20:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:21.392 05:20:22 -- nvmf/common.sh@294 -- # net_devs=() 00:24:21.392 05:20:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:21.392 05:20:22 -- nvmf/common.sh@295 -- # e810=() 00:24:21.392 05:20:22 -- nvmf/common.sh@295 -- # local -ga e810 00:24:21.392 05:20:22 -- nvmf/common.sh@296 -- # x722=() 00:24:21.392 05:20:22 -- nvmf/common.sh@296 -- # local -ga x722 00:24:21.392 05:20:22 -- nvmf/common.sh@297 -- # mlx=() 00:24:21.392 05:20:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:21.392 05:20:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:21.392 05:20:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:21.392 05:20:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:21.392 05:20:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:21.392 05:20:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:21.392 05:20:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:21.392 05:20:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:21.392 05:20:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:21.392 05:20:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:21.392 05:20:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:21.392 05:20:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:21.392 05:20:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:21.392 05:20:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:21.392 05:20:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:21.392 05:20:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:21.392 05:20:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:21.392 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:21.392 05:20:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:21.392 05:20:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:21.392 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:21.392 05:20:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:21.392 05:20:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:21.392 05:20:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:21.392 05:20:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:21.392 05:20:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:21.392 05:20:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:21.392 05:20:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:21.392 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:21.392 05:20:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:21.392 05:20:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:21.392 05:20:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:21.392 05:20:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:21.392 05:20:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:21.392 05:20:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:21.392 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:21.392 05:20:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:21.392 05:20:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:21.392 05:20:22 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:21.392 05:20:22 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:21.392 05:20:22 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:21.392 05:20:22 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:21.392 05:20:22 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:21.960 05:20:23 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:24.557 05:20:25 -- target/perf_adq.sh@54 -- # sleep 5 00:24:29.839 05:20:30 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:29.839 05:20:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:29.839 05:20:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:29.839 05:20:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:29.839 05:20:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:29.839 05:20:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:29.839 05:20:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:29.839 05:20:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:29.839 05:20:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:29.839 05:20:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:29.839 05:20:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:29.839 05:20:30 -- common/autotest_common.sh@10 -- # set +x 00:24:29.839 05:20:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:29.839 05:20:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:29.839 05:20:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:29.839 05:20:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:29.839 05:20:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:29.839 05:20:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:29.839 05:20:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:29.839 05:20:30 -- nvmf/common.sh@294 -- # net_devs=() 00:24:29.839 05:20:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:29.839 05:20:30 -- nvmf/common.sh@295 -- # e810=() 00:24:29.839 05:20:30 -- nvmf/common.sh@295 -- # local -ga e810 00:24:29.839 05:20:30 -- nvmf/common.sh@296 -- # x722=() 00:24:29.839 05:20:30 -- nvmf/common.sh@296 -- # local -ga x722 00:24:29.839 05:20:30 -- nvmf/common.sh@297 -- # mlx=() 00:24:29.839 05:20:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:29.839 05:20:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:29.839 05:20:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:29.839 05:20:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:29.839 05:20:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:29.839 05:20:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:29.839 05:20:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:29.839 05:20:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:29.839 05:20:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:29.839 05:20:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:29.839 05:20:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:29.839 05:20:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:29.839 05:20:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:29.839 05:20:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:29.839 05:20:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:29.839 05:20:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:29.839 05:20:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:29.839 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:29.839 05:20:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:29.839 05:20:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:29.839 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:29.839 05:20:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:29.839 05:20:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:29.839 05:20:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:29.839 05:20:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:29.839 05:20:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:29.839 05:20:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:29.839 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:29.839 05:20:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:29.839 05:20:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:29.839 05:20:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:29.839 05:20:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:29.839 05:20:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:29.839 05:20:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:29.839 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:29.839 05:20:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:29.839 05:20:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:29.839 05:20:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:29.839 05:20:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:29.839 05:20:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:29.839 05:20:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:29.839 05:20:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:29.839 05:20:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:29.839 05:20:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:29.839 05:20:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:29.839 05:20:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:29.839 05:20:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:29.839 05:20:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:29.839 05:20:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:29.839 05:20:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:29.839 05:20:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:29.839 05:20:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:29.839 05:20:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:29.839 05:20:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:29.839 05:20:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:29.839 05:20:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:29.839 05:20:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:29.839 05:20:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:29.839 05:20:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:29.839 05:20:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:29.839 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:29.839 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:24:29.839 00:24:29.839 --- 10.0.0.2 ping statistics --- 00:24:29.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:29.839 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:24:29.839 05:20:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:29.839 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:29.839 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:24:29.839 00:24:29.839 --- 10.0.0.1 ping statistics --- 00:24:29.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:29.839 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:24:29.839 05:20:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:29.839 05:20:31 -- nvmf/common.sh@410 -- # return 0 00:24:29.840 05:20:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:29.840 05:20:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:29.840 05:20:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:29.840 05:20:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:29.840 05:20:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:29.840 05:20:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:29.840 05:20:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:29.840 05:20:31 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:29.840 05:20:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:29.840 05:20:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:29.840 05:20:31 -- common/autotest_common.sh@10 -- # set +x 00:24:29.840 05:20:31 -- nvmf/common.sh@469 -- # nvmfpid=3364948 00:24:29.840 05:20:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:29.840 05:20:31 -- nvmf/common.sh@470 -- # waitforlisten 3364948 00:24:29.840 05:20:31 -- common/autotest_common.sh@829 -- # '[' -z 3364948 ']' 00:24:29.840 05:20:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:29.840 05:20:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:29.840 05:20:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:29.840 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:29.840 05:20:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:29.840 05:20:31 -- common/autotest_common.sh@10 -- # set +x 00:24:29.840 [2024-11-26 05:20:31.097410] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:29.840 [2024-11-26 05:20:31.097497] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:29.840 EAL: No free 2048 kB hugepages reported on node 1 00:24:29.840 [2024-11-26 05:20:31.168008] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:29.840 [2024-11-26 05:20:31.260161] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:29.840 [2024-11-26 05:20:31.260339] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:29.840 [2024-11-26 05:20:31.260361] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:29.840 [2024-11-26 05:20:31.260376] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:29.840 [2024-11-26 05:20:31.260461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:29.840 [2024-11-26 05:20:31.260518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:29.840 [2024-11-26 05:20:31.260575] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:29.840 [2024-11-26 05:20:31.260577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:29.840 05:20:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:29.840 05:20:31 -- common/autotest_common.sh@862 -- # return 0 00:24:29.840 05:20:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:29.840 05:20:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:29.840 05:20:31 -- common/autotest_common.sh@10 -- # set +x 00:24:29.840 05:20:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:29.840 05:20:31 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:29.840 05:20:31 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:29.840 05:20:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:29.840 05:20:31 -- common/autotest_common.sh@10 -- # set +x 00:24:29.840 05:20:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:29.840 05:20:31 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:29.840 05:20:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:29.840 05:20:31 -- common/autotest_common.sh@10 -- # set +x 00:24:29.840 05:20:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:29.840 05:20:31 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:29.840 05:20:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:29.840 05:20:31 -- common/autotest_common.sh@10 -- # set +x 00:24:29.840 [2024-11-26 05:20:31.440589] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:29.840 05:20:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:29.840 05:20:31 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:29.840 05:20:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:29.840 05:20:31 -- common/autotest_common.sh@10 -- # set +x 00:24:29.840 Malloc1 00:24:29.840 05:20:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:29.840 05:20:31 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:29.840 05:20:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:29.840 05:20:31 -- common/autotest_common.sh@10 -- # set +x 00:24:29.840 05:20:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:29.840 05:20:31 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:29.840 05:20:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:29.840 05:20:31 -- common/autotest_common.sh@10 -- # set +x 00:24:29.840 05:20:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:29.840 05:20:31 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:29.840 05:20:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:29.840 05:20:31 -- common/autotest_common.sh@10 -- # set +x 00:24:29.840 [2024-11-26 05:20:31.493978] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:29.840 05:20:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:29.840 05:20:31 -- target/perf_adq.sh@73 -- # perfpid=3365097 00:24:29.840 05:20:31 -- target/perf_adq.sh@74 -- # sleep 2 00:24:29.840 05:20:31 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:29.840 EAL: No free 2048 kB hugepages reported on node 1 00:24:31.743 05:20:33 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:31.743 05:20:33 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:31.743 05:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:31.743 05:20:33 -- common/autotest_common.sh@10 -- # set +x 00:24:31.743 05:20:33 -- target/perf_adq.sh@76 -- # wc -l 00:24:32.001 05:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.001 05:20:33 -- target/perf_adq.sh@76 -- # count=4 00:24:32.001 05:20:33 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:32.001 05:20:33 -- target/perf_adq.sh@81 -- # wait 3365097 00:24:40.120 Initializing NVMe Controllers 00:24:40.120 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:40.120 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:40.120 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:40.120 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:40.120 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:40.120 Initialization complete. Launching workers. 00:24:40.120 ======================================================== 00:24:40.120 Latency(us) 00:24:40.120 Device Information : IOPS MiB/s Average min max 00:24:40.120 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11159.32 43.59 5735.62 1414.10 9635.37 00:24:40.120 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11530.81 45.04 5552.43 1415.02 8826.04 00:24:40.120 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 10528.32 41.13 6079.97 1507.90 10148.90 00:24:40.120 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10713.72 41.85 5976.00 1998.61 9518.29 00:24:40.120 ======================================================== 00:24:40.120 Total : 43932.17 171.61 5828.68 1414.10 10148.90 00:24:40.120 00:24:40.120 05:20:41 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:40.120 05:20:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:40.120 05:20:41 -- nvmf/common.sh@116 -- # sync 00:24:40.120 05:20:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:40.120 05:20:41 -- nvmf/common.sh@119 -- # set +e 00:24:40.120 05:20:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:40.120 05:20:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:40.120 rmmod nvme_tcp 00:24:40.120 rmmod nvme_fabrics 00:24:40.120 rmmod nvme_keyring 00:24:40.120 05:20:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:40.120 05:20:41 -- nvmf/common.sh@123 -- # set -e 00:24:40.120 05:20:41 -- nvmf/common.sh@124 -- # return 0 00:24:40.120 05:20:41 -- nvmf/common.sh@477 -- # '[' -n 3364948 ']' 00:24:40.120 05:20:41 -- nvmf/common.sh@478 -- # killprocess 3364948 00:24:40.120 05:20:41 -- common/autotest_common.sh@936 -- # '[' -z 3364948 ']' 00:24:40.120 05:20:41 -- common/autotest_common.sh@940 -- # kill -0 3364948 00:24:40.120 05:20:41 -- common/autotest_common.sh@941 -- # uname 00:24:40.120 05:20:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:40.120 05:20:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3364948 00:24:40.120 05:20:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:40.120 05:20:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:40.120 05:20:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3364948' 00:24:40.120 killing process with pid 3364948 00:24:40.120 05:20:41 -- common/autotest_common.sh@955 -- # kill 3364948 00:24:40.120 05:20:41 -- common/autotest_common.sh@960 -- # wait 3364948 00:24:40.379 05:20:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:40.379 05:20:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:40.379 05:20:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:40.379 05:20:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:40.379 05:20:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:40.379 05:20:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:40.379 05:20:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:40.379 05:20:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:42.283 05:20:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:42.283 05:20:44 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:42.283 05:20:44 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:43.222 05:20:44 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:45.752 05:20:47 -- target/perf_adq.sh@54 -- # sleep 5 00:24:51.020 05:20:52 -- target/perf_adq.sh@87 -- # nvmftestinit 00:24:51.020 05:20:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:51.020 05:20:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:51.020 05:20:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:51.020 05:20:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:51.020 05:20:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:51.020 05:20:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:51.020 05:20:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:51.020 05:20:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:51.020 05:20:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:51.020 05:20:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:51.020 05:20:52 -- common/autotest_common.sh@10 -- # set +x 00:24:51.020 05:20:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:51.020 05:20:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:51.020 05:20:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:51.020 05:20:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:51.020 05:20:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:51.020 05:20:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:51.020 05:20:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:51.020 05:20:52 -- nvmf/common.sh@294 -- # net_devs=() 00:24:51.020 05:20:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:51.020 05:20:52 -- nvmf/common.sh@295 -- # e810=() 00:24:51.020 05:20:52 -- nvmf/common.sh@295 -- # local -ga e810 00:24:51.020 05:20:52 -- nvmf/common.sh@296 -- # x722=() 00:24:51.020 05:20:52 -- nvmf/common.sh@296 -- # local -ga x722 00:24:51.020 05:20:52 -- nvmf/common.sh@297 -- # mlx=() 00:24:51.020 05:20:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:51.020 05:20:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:51.020 05:20:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:51.020 05:20:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:51.020 05:20:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:51.020 05:20:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:51.020 05:20:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:51.020 05:20:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:51.020 05:20:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:51.020 05:20:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:51.020 05:20:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:51.020 05:20:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:51.020 05:20:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:51.020 05:20:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:51.020 05:20:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:51.020 05:20:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:51.020 05:20:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:51.020 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:51.020 05:20:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:51.020 05:20:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:51.020 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:51.020 05:20:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:51.020 05:20:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:51.020 05:20:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:51.021 05:20:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:51.021 05:20:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:51.021 05:20:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:51.021 05:20:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:51.021 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:51.021 05:20:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:51.021 05:20:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:51.021 05:20:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:51.021 05:20:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:51.021 05:20:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:51.021 05:20:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:51.021 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:51.021 05:20:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:51.021 05:20:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:51.021 05:20:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:51.021 05:20:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:51.021 05:20:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:51.021 05:20:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:51.021 05:20:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:51.021 05:20:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:51.021 05:20:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:51.021 05:20:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:51.021 05:20:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:51.021 05:20:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:51.021 05:20:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:51.021 05:20:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:51.021 05:20:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:51.021 05:20:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:51.021 05:20:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:51.021 05:20:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:51.021 05:20:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:51.021 05:20:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:51.021 05:20:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:51.021 05:20:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:51.021 05:20:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:51.021 05:20:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:51.021 05:20:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:51.021 05:20:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:51.021 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:51.021 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.259 ms 00:24:51.021 00:24:51.021 --- 10.0.0.2 ping statistics --- 00:24:51.021 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:51.021 rtt min/avg/max/mdev = 0.259/0.259/0.259/0.000 ms 00:24:51.021 05:20:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:51.021 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:51.021 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.178 ms 00:24:51.021 00:24:51.021 --- 10.0.0.1 ping statistics --- 00:24:51.021 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:51.021 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:24:51.021 05:20:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:51.021 05:20:52 -- nvmf/common.sh@410 -- # return 0 00:24:51.021 05:20:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:51.021 05:20:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:51.021 05:20:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:51.021 05:20:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:51.021 05:20:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:51.021 05:20:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:51.021 05:20:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:51.021 05:20:52 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:24:51.021 05:20:52 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:24:51.021 05:20:52 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:24:51.021 05:20:52 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:24:51.021 net.core.busy_poll = 1 00:24:51.021 05:20:52 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:24:51.021 net.core.busy_read = 1 00:24:51.021 05:20:52 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:24:51.021 05:20:52 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:24:51.021 05:20:52 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:24:51.021 05:20:52 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:24:51.021 05:20:52 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:24:51.021 05:20:52 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:51.021 05:20:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:51.021 05:20:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:51.021 05:20:52 -- common/autotest_common.sh@10 -- # set +x 00:24:51.021 05:20:52 -- nvmf/common.sh@469 -- # nvmfpid=3367790 00:24:51.021 05:20:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:51.021 05:20:52 -- nvmf/common.sh@470 -- # waitforlisten 3367790 00:24:51.021 05:20:52 -- common/autotest_common.sh@829 -- # '[' -z 3367790 ']' 00:24:51.021 05:20:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:51.021 05:20:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:51.021 05:20:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:51.021 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:51.021 05:20:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:51.021 05:20:52 -- common/autotest_common.sh@10 -- # set +x 00:24:51.021 [2024-11-26 05:20:52.520592] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:51.021 [2024-11-26 05:20:52.520673] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:51.021 EAL: No free 2048 kB hugepages reported on node 1 00:24:51.021 [2024-11-26 05:20:52.586624] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:51.021 [2024-11-26 05:20:52.669472] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:51.021 [2024-11-26 05:20:52.669624] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:51.021 [2024-11-26 05:20:52.669641] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:51.021 [2024-11-26 05:20:52.669653] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:51.021 [2024-11-26 05:20:52.670062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:51.021 [2024-11-26 05:20:52.670127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:51.021 [2024-11-26 05:20:52.670193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:51.021 [2024-11-26 05:20:52.670196] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:51.021 05:20:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:51.021 05:20:52 -- common/autotest_common.sh@862 -- # return 0 00:24:51.021 05:20:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:51.021 05:20:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:51.021 05:20:52 -- common/autotest_common.sh@10 -- # set +x 00:24:51.021 05:20:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:51.021 05:20:52 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:24:51.021 05:20:52 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:24:51.021 05:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:51.021 05:20:52 -- common/autotest_common.sh@10 -- # set +x 00:24:51.021 05:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:51.021 05:20:52 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:51.021 05:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:51.021 05:20:52 -- common/autotest_common.sh@10 -- # set +x 00:24:51.279 05:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:51.279 05:20:52 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:24:51.279 05:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:51.279 05:20:52 -- common/autotest_common.sh@10 -- # set +x 00:24:51.279 [2024-11-26 05:20:52.877191] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:51.279 05:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:51.279 05:20:52 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:51.279 05:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:51.279 05:20:52 -- common/autotest_common.sh@10 -- # set +x 00:24:51.279 Malloc1 00:24:51.279 05:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:51.280 05:20:52 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:51.280 05:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:51.280 05:20:52 -- common/autotest_common.sh@10 -- # set +x 00:24:51.280 05:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:51.280 05:20:52 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:51.280 05:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:51.280 05:20:52 -- common/autotest_common.sh@10 -- # set +x 00:24:51.280 05:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:51.280 05:20:52 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:51.280 05:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:51.280 05:20:52 -- common/autotest_common.sh@10 -- # set +x 00:24:51.280 [2024-11-26 05:20:52.928740] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:51.280 05:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:51.280 05:20:52 -- target/perf_adq.sh@94 -- # perfpid=3367876 00:24:51.280 05:20:52 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:51.280 05:20:52 -- target/perf_adq.sh@95 -- # sleep 2 00:24:51.280 EAL: No free 2048 kB hugepages reported on node 1 00:24:53.181 05:20:54 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:24:53.181 05:20:54 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:24:53.181 05:20:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:53.181 05:20:54 -- target/perf_adq.sh@97 -- # wc -l 00:24:53.181 05:20:54 -- common/autotest_common.sh@10 -- # set +x 00:24:53.439 05:20:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:53.439 05:20:54 -- target/perf_adq.sh@97 -- # count=3 00:24:53.439 05:20:54 -- target/perf_adq.sh@98 -- # [[ 3 -lt 2 ]] 00:24:53.439 05:20:54 -- target/perf_adq.sh@103 -- # wait 3367876 00:25:01.551 Initializing NVMe Controllers 00:25:01.551 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:01.551 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:01.551 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:01.551 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:01.551 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:01.551 Initialization complete. Launching workers. 00:25:01.551 ======================================================== 00:25:01.551 Latency(us) 00:25:01.551 Device Information : IOPS MiB/s Average min max 00:25:01.551 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5310.10 20.74 12054.35 1384.77 58609.16 00:25:01.551 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4592.50 17.94 13937.57 1778.28 62928.83 00:25:01.551 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 4959.30 19.37 12949.87 1412.48 59067.57 00:25:01.551 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4586.30 17.92 14012.67 1450.37 62698.71 00:25:01.551 ======================================================== 00:25:01.551 Total : 19448.20 75.97 13189.23 1384.77 62928.83 00:25:01.551 00:25:01.551 05:21:03 -- target/perf_adq.sh@104 -- # nvmftestfini 00:25:01.551 05:21:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:01.551 05:21:03 -- nvmf/common.sh@116 -- # sync 00:25:01.551 05:21:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:01.551 05:21:03 -- nvmf/common.sh@119 -- # set +e 00:25:01.551 05:21:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:01.551 05:21:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:01.551 rmmod nvme_tcp 00:25:01.551 rmmod nvme_fabrics 00:25:01.551 rmmod nvme_keyring 00:25:01.551 05:21:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:01.551 05:21:03 -- nvmf/common.sh@123 -- # set -e 00:25:01.551 05:21:03 -- nvmf/common.sh@124 -- # return 0 00:25:01.551 05:21:03 -- nvmf/common.sh@477 -- # '[' -n 3367790 ']' 00:25:01.551 05:21:03 -- nvmf/common.sh@478 -- # killprocess 3367790 00:25:01.551 05:21:03 -- common/autotest_common.sh@936 -- # '[' -z 3367790 ']' 00:25:01.551 05:21:03 -- common/autotest_common.sh@940 -- # kill -0 3367790 00:25:01.551 05:21:03 -- common/autotest_common.sh@941 -- # uname 00:25:01.551 05:21:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:01.551 05:21:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3367790 00:25:01.551 05:21:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:01.551 05:21:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:01.551 05:21:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3367790' 00:25:01.551 killing process with pid 3367790 00:25:01.551 05:21:03 -- common/autotest_common.sh@955 -- # kill 3367790 00:25:01.551 05:21:03 -- common/autotest_common.sh@960 -- # wait 3367790 00:25:01.811 05:21:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:01.811 05:21:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:01.811 05:21:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:01.811 05:21:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:01.811 05:21:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:01.811 05:21:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:01.811 05:21:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:01.811 05:21:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:03.716 05:21:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:03.716 05:21:05 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:25:03.975 00:25:03.975 real 0m44.564s 00:25:03.975 user 2m35.067s 00:25:03.975 sys 0m11.598s 00:25:03.975 05:21:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:03.975 05:21:05 -- common/autotest_common.sh@10 -- # set +x 00:25:03.975 ************************************ 00:25:03.975 END TEST nvmf_perf_adq 00:25:03.975 ************************************ 00:25:03.975 05:21:05 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:03.975 05:21:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:03.975 05:21:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:03.975 05:21:05 -- common/autotest_common.sh@10 -- # set +x 00:25:03.975 ************************************ 00:25:03.975 START TEST nvmf_shutdown 00:25:03.975 ************************************ 00:25:03.975 05:21:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:03.975 * Looking for test storage... 00:25:03.975 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:03.975 05:21:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:03.975 05:21:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:03.975 05:21:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:03.975 05:21:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:03.975 05:21:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:03.975 05:21:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:03.975 05:21:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:03.975 05:21:05 -- scripts/common.sh@335 -- # IFS=.-: 00:25:03.975 05:21:05 -- scripts/common.sh@335 -- # read -ra ver1 00:25:03.975 05:21:05 -- scripts/common.sh@336 -- # IFS=.-: 00:25:03.975 05:21:05 -- scripts/common.sh@336 -- # read -ra ver2 00:25:03.975 05:21:05 -- scripts/common.sh@337 -- # local 'op=<' 00:25:03.975 05:21:05 -- scripts/common.sh@339 -- # ver1_l=2 00:25:03.975 05:21:05 -- scripts/common.sh@340 -- # ver2_l=1 00:25:03.975 05:21:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:03.975 05:21:05 -- scripts/common.sh@343 -- # case "$op" in 00:25:03.975 05:21:05 -- scripts/common.sh@344 -- # : 1 00:25:03.975 05:21:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:03.975 05:21:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:03.975 05:21:05 -- scripts/common.sh@364 -- # decimal 1 00:25:03.975 05:21:05 -- scripts/common.sh@352 -- # local d=1 00:25:03.975 05:21:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:03.975 05:21:05 -- scripts/common.sh@354 -- # echo 1 00:25:03.975 05:21:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:03.975 05:21:05 -- scripts/common.sh@365 -- # decimal 2 00:25:03.975 05:21:05 -- scripts/common.sh@352 -- # local d=2 00:25:03.975 05:21:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:03.975 05:21:05 -- scripts/common.sh@354 -- # echo 2 00:25:03.975 05:21:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:03.975 05:21:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:03.975 05:21:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:03.975 05:21:05 -- scripts/common.sh@367 -- # return 0 00:25:03.975 05:21:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:03.975 05:21:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:03.975 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:03.975 --rc genhtml_branch_coverage=1 00:25:03.975 --rc genhtml_function_coverage=1 00:25:03.975 --rc genhtml_legend=1 00:25:03.975 --rc geninfo_all_blocks=1 00:25:03.975 --rc geninfo_unexecuted_blocks=1 00:25:03.975 00:25:03.975 ' 00:25:03.975 05:21:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:03.975 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:03.975 --rc genhtml_branch_coverage=1 00:25:03.975 --rc genhtml_function_coverage=1 00:25:03.975 --rc genhtml_legend=1 00:25:03.975 --rc geninfo_all_blocks=1 00:25:03.975 --rc geninfo_unexecuted_blocks=1 00:25:03.975 00:25:03.975 ' 00:25:03.975 05:21:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:03.975 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:03.975 --rc genhtml_branch_coverage=1 00:25:03.975 --rc genhtml_function_coverage=1 00:25:03.975 --rc genhtml_legend=1 00:25:03.975 --rc geninfo_all_blocks=1 00:25:03.975 --rc geninfo_unexecuted_blocks=1 00:25:03.975 00:25:03.975 ' 00:25:03.975 05:21:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:03.975 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:03.975 --rc genhtml_branch_coverage=1 00:25:03.975 --rc genhtml_function_coverage=1 00:25:03.975 --rc genhtml_legend=1 00:25:03.975 --rc geninfo_all_blocks=1 00:25:03.975 --rc geninfo_unexecuted_blocks=1 00:25:03.975 00:25:03.975 ' 00:25:03.975 05:21:05 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:03.975 05:21:05 -- nvmf/common.sh@7 -- # uname -s 00:25:03.975 05:21:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:03.975 05:21:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:03.975 05:21:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:03.975 05:21:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:03.975 05:21:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:03.975 05:21:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:03.975 05:21:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:03.975 05:21:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:03.975 05:21:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:03.976 05:21:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:03.976 05:21:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:03.976 05:21:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:03.976 05:21:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:03.976 05:21:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:03.976 05:21:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:03.976 05:21:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:03.976 05:21:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:03.976 05:21:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:03.976 05:21:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:03.976 05:21:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:03.976 05:21:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:03.976 05:21:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:03.976 05:21:05 -- paths/export.sh@5 -- # export PATH 00:25:03.976 05:21:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:03.976 05:21:05 -- nvmf/common.sh@46 -- # : 0 00:25:03.976 05:21:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:03.976 05:21:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:03.976 05:21:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:03.976 05:21:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:03.976 05:21:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:03.976 05:21:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:03.976 05:21:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:03.976 05:21:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:03.976 05:21:05 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:03.976 05:21:05 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:03.976 05:21:05 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:25:03.976 05:21:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:03.976 05:21:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:03.976 05:21:05 -- common/autotest_common.sh@10 -- # set +x 00:25:03.976 ************************************ 00:25:03.976 START TEST nvmf_shutdown_tc1 00:25:03.976 ************************************ 00:25:03.976 05:21:05 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:25:03.976 05:21:05 -- target/shutdown.sh@74 -- # starttarget 00:25:03.976 05:21:05 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:03.976 05:21:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:03.976 05:21:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:03.976 05:21:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:03.976 05:21:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:03.976 05:21:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:03.976 05:21:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:03.976 05:21:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:03.976 05:21:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:03.976 05:21:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:03.976 05:21:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:03.976 05:21:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:03.976 05:21:05 -- common/autotest_common.sh@10 -- # set +x 00:25:05.880 05:21:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:05.880 05:21:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:05.880 05:21:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:05.880 05:21:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:05.880 05:21:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:05.880 05:21:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:05.880 05:21:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:05.880 05:21:07 -- nvmf/common.sh@294 -- # net_devs=() 00:25:05.880 05:21:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:05.880 05:21:07 -- nvmf/common.sh@295 -- # e810=() 00:25:05.880 05:21:07 -- nvmf/common.sh@295 -- # local -ga e810 00:25:05.880 05:21:07 -- nvmf/common.sh@296 -- # x722=() 00:25:05.880 05:21:07 -- nvmf/common.sh@296 -- # local -ga x722 00:25:05.880 05:21:07 -- nvmf/common.sh@297 -- # mlx=() 00:25:05.880 05:21:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:05.880 05:21:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:05.880 05:21:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:05.880 05:21:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:05.880 05:21:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:05.880 05:21:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:05.880 05:21:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:05.880 05:21:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:05.881 05:21:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:05.881 05:21:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:06.194 05:21:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:06.194 05:21:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:06.194 05:21:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:06.194 05:21:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:06.194 05:21:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:06.194 05:21:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:06.194 05:21:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:06.194 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:06.194 05:21:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:06.194 05:21:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:06.194 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:06.194 05:21:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:06.194 05:21:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:06.194 05:21:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:06.194 05:21:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:06.194 05:21:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:06.194 05:21:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:06.194 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:06.194 05:21:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:06.194 05:21:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:06.194 05:21:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:06.194 05:21:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:06.194 05:21:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:06.194 05:21:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:06.194 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:06.194 05:21:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:06.194 05:21:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:06.194 05:21:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:06.194 05:21:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:06.194 05:21:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:06.194 05:21:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:06.194 05:21:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:06.194 05:21:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:06.194 05:21:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:06.194 05:21:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:06.194 05:21:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:06.194 05:21:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:06.194 05:21:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:06.194 05:21:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:06.194 05:21:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:06.194 05:21:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:06.194 05:21:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:06.194 05:21:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:06.194 05:21:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:06.194 05:21:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:06.194 05:21:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:06.194 05:21:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:06.194 05:21:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:06.194 05:21:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:06.195 05:21:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:06.195 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:06.195 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.169 ms 00:25:06.195 00:25:06.195 --- 10.0.0.2 ping statistics --- 00:25:06.195 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:06.195 rtt min/avg/max/mdev = 0.169/0.169/0.169/0.000 ms 00:25:06.195 05:21:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:06.195 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:06.195 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.175 ms 00:25:06.195 00:25:06.195 --- 10.0.0.1 ping statistics --- 00:25:06.195 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:06.195 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:25:06.195 05:21:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:06.195 05:21:07 -- nvmf/common.sh@410 -- # return 0 00:25:06.195 05:21:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:06.195 05:21:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:06.195 05:21:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:06.195 05:21:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:06.195 05:21:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:06.195 05:21:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:06.195 05:21:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:06.195 05:21:07 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:06.195 05:21:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:06.195 05:21:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:06.195 05:21:07 -- common/autotest_common.sh@10 -- # set +x 00:25:06.195 05:21:07 -- nvmf/common.sh@469 -- # nvmfpid=3371495 00:25:06.195 05:21:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:06.195 05:21:07 -- nvmf/common.sh@470 -- # waitforlisten 3371495 00:25:06.195 05:21:07 -- common/autotest_common.sh@829 -- # '[' -z 3371495 ']' 00:25:06.195 05:21:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:06.195 05:21:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:06.195 05:21:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:06.195 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:06.195 05:21:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:06.195 05:21:07 -- common/autotest_common.sh@10 -- # set +x 00:25:06.195 [2024-11-26 05:21:07.855612] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:06.195 [2024-11-26 05:21:07.855712] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:06.195 EAL: No free 2048 kB hugepages reported on node 1 00:25:06.195 [2024-11-26 05:21:07.921425] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:06.479 [2024-11-26 05:21:08.009682] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:06.479 [2024-11-26 05:21:08.009830] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:06.479 [2024-11-26 05:21:08.009846] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:06.479 [2024-11-26 05:21:08.009858] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:06.479 [2024-11-26 05:21:08.009912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:06.479 [2024-11-26 05:21:08.009986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:06.479 [2024-11-26 05:21:08.010106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:06.479 [2024-11-26 05:21:08.010109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:07.412 05:21:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:07.412 05:21:08 -- common/autotest_common.sh@862 -- # return 0 00:25:07.412 05:21:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:07.412 05:21:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:07.412 05:21:08 -- common/autotest_common.sh@10 -- # set +x 00:25:07.412 05:21:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:07.412 05:21:08 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:07.412 05:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.412 05:21:08 -- common/autotest_common.sh@10 -- # set +x 00:25:07.412 [2024-11-26 05:21:08.879469] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:07.412 05:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.412 05:21:08 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:07.412 05:21:08 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:07.412 05:21:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:07.412 05:21:08 -- common/autotest_common.sh@10 -- # set +x 00:25:07.412 05:21:08 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:07.412 05:21:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.412 05:21:08 -- target/shutdown.sh@28 -- # cat 00:25:07.412 05:21:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.412 05:21:08 -- target/shutdown.sh@28 -- # cat 00:25:07.412 05:21:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.412 05:21:08 -- target/shutdown.sh@28 -- # cat 00:25:07.412 05:21:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.412 05:21:08 -- target/shutdown.sh@28 -- # cat 00:25:07.412 05:21:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.412 05:21:08 -- target/shutdown.sh@28 -- # cat 00:25:07.412 05:21:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.412 05:21:08 -- target/shutdown.sh@28 -- # cat 00:25:07.412 05:21:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.412 05:21:08 -- target/shutdown.sh@28 -- # cat 00:25:07.412 05:21:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.412 05:21:08 -- target/shutdown.sh@28 -- # cat 00:25:07.412 05:21:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.412 05:21:08 -- target/shutdown.sh@28 -- # cat 00:25:07.412 05:21:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.412 05:21:08 -- target/shutdown.sh@28 -- # cat 00:25:07.412 05:21:08 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:07.412 05:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.412 05:21:08 -- common/autotest_common.sh@10 -- # set +x 00:25:07.412 Malloc1 00:25:07.412 [2024-11-26 05:21:08.960263] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:07.412 Malloc2 00:25:07.412 Malloc3 00:25:07.412 Malloc4 00:25:07.412 Malloc5 00:25:07.412 Malloc6 00:25:07.674 Malloc7 00:25:07.674 Malloc8 00:25:07.674 Malloc9 00:25:07.674 Malloc10 00:25:07.674 05:21:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.674 05:21:09 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:07.674 05:21:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:07.674 05:21:09 -- common/autotest_common.sh@10 -- # set +x 00:25:07.674 05:21:09 -- target/shutdown.sh@78 -- # perfpid=3371959 00:25:07.674 05:21:09 -- target/shutdown.sh@79 -- # waitforlisten 3371959 /var/tmp/bdevperf.sock 00:25:07.674 05:21:09 -- common/autotest_common.sh@829 -- # '[' -z 3371959 ']' 00:25:07.674 05:21:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:07.674 05:21:09 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:25:07.674 05:21:09 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:07.674 05:21:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:07.674 05:21:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:07.674 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:07.674 05:21:09 -- nvmf/common.sh@520 -- # config=() 00:25:07.674 05:21:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:07.674 05:21:09 -- nvmf/common.sh@520 -- # local subsystem config 00:25:07.674 05:21:09 -- common/autotest_common.sh@10 -- # set +x 00:25:07.674 05:21:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.674 { 00:25:07.674 "params": { 00:25:07.674 "name": "Nvme$subsystem", 00:25:07.674 "trtype": "$TEST_TRANSPORT", 00:25:07.674 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.674 "adrfam": "ipv4", 00:25:07.674 "trsvcid": "$NVMF_PORT", 00:25:07.674 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.674 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.674 "hdgst": ${hdgst:-false}, 00:25:07.674 "ddgst": ${ddgst:-false} 00:25:07.674 }, 00:25:07.674 "method": "bdev_nvme_attach_controller" 00:25:07.674 } 00:25:07.674 EOF 00:25:07.674 )") 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # cat 00:25:07.674 05:21:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.674 { 00:25:07.674 "params": { 00:25:07.674 "name": "Nvme$subsystem", 00:25:07.674 "trtype": "$TEST_TRANSPORT", 00:25:07.674 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.674 "adrfam": "ipv4", 00:25:07.674 "trsvcid": "$NVMF_PORT", 00:25:07.674 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.674 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.674 "hdgst": ${hdgst:-false}, 00:25:07.674 "ddgst": ${ddgst:-false} 00:25:07.674 }, 00:25:07.674 "method": "bdev_nvme_attach_controller" 00:25:07.674 } 00:25:07.674 EOF 00:25:07.674 )") 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # cat 00:25:07.674 05:21:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.674 { 00:25:07.674 "params": { 00:25:07.674 "name": "Nvme$subsystem", 00:25:07.674 "trtype": "$TEST_TRANSPORT", 00:25:07.674 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.674 "adrfam": "ipv4", 00:25:07.674 "trsvcid": "$NVMF_PORT", 00:25:07.674 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.674 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.674 "hdgst": ${hdgst:-false}, 00:25:07.674 "ddgst": ${ddgst:-false} 00:25:07.674 }, 00:25:07.674 "method": "bdev_nvme_attach_controller" 00:25:07.674 } 00:25:07.674 EOF 00:25:07.674 )") 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # cat 00:25:07.674 05:21:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.674 { 00:25:07.674 "params": { 00:25:07.674 "name": "Nvme$subsystem", 00:25:07.674 "trtype": "$TEST_TRANSPORT", 00:25:07.674 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.674 "adrfam": "ipv4", 00:25:07.674 "trsvcid": "$NVMF_PORT", 00:25:07.674 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.674 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.674 "hdgst": ${hdgst:-false}, 00:25:07.674 "ddgst": ${ddgst:-false} 00:25:07.674 }, 00:25:07.674 "method": "bdev_nvme_attach_controller" 00:25:07.674 } 00:25:07.674 EOF 00:25:07.674 )") 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # cat 00:25:07.674 05:21:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.674 { 00:25:07.674 "params": { 00:25:07.674 "name": "Nvme$subsystem", 00:25:07.674 "trtype": "$TEST_TRANSPORT", 00:25:07.674 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.674 "adrfam": "ipv4", 00:25:07.674 "trsvcid": "$NVMF_PORT", 00:25:07.674 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.674 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.674 "hdgst": ${hdgst:-false}, 00:25:07.674 "ddgst": ${ddgst:-false} 00:25:07.674 }, 00:25:07.674 "method": "bdev_nvme_attach_controller" 00:25:07.674 } 00:25:07.674 EOF 00:25:07.674 )") 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # cat 00:25:07.674 05:21:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.674 { 00:25:07.674 "params": { 00:25:07.674 "name": "Nvme$subsystem", 00:25:07.674 "trtype": "$TEST_TRANSPORT", 00:25:07.674 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.674 "adrfam": "ipv4", 00:25:07.674 "trsvcid": "$NVMF_PORT", 00:25:07.674 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.674 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.674 "hdgst": ${hdgst:-false}, 00:25:07.674 "ddgst": ${ddgst:-false} 00:25:07.674 }, 00:25:07.674 "method": "bdev_nvme_attach_controller" 00:25:07.674 } 00:25:07.674 EOF 00:25:07.674 )") 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # cat 00:25:07.674 05:21:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.674 { 00:25:07.674 "params": { 00:25:07.674 "name": "Nvme$subsystem", 00:25:07.674 "trtype": "$TEST_TRANSPORT", 00:25:07.674 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.674 "adrfam": "ipv4", 00:25:07.674 "trsvcid": "$NVMF_PORT", 00:25:07.674 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.674 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.674 "hdgst": ${hdgst:-false}, 00:25:07.674 "ddgst": ${ddgst:-false} 00:25:07.674 }, 00:25:07.674 "method": "bdev_nvme_attach_controller" 00:25:07.674 } 00:25:07.674 EOF 00:25:07.674 )") 00:25:07.674 05:21:09 -- nvmf/common.sh@542 -- # cat 00:25:07.932 05:21:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.932 05:21:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.932 { 00:25:07.932 "params": { 00:25:07.932 "name": "Nvme$subsystem", 00:25:07.932 "trtype": "$TEST_TRANSPORT", 00:25:07.932 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.932 "adrfam": "ipv4", 00:25:07.932 "trsvcid": "$NVMF_PORT", 00:25:07.932 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.932 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.932 "hdgst": ${hdgst:-false}, 00:25:07.932 "ddgst": ${ddgst:-false} 00:25:07.932 }, 00:25:07.932 "method": "bdev_nvme_attach_controller" 00:25:07.932 } 00:25:07.932 EOF 00:25:07.932 )") 00:25:07.932 05:21:09 -- nvmf/common.sh@542 -- # cat 00:25:07.932 05:21:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.932 05:21:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.932 { 00:25:07.932 "params": { 00:25:07.932 "name": "Nvme$subsystem", 00:25:07.932 "trtype": "$TEST_TRANSPORT", 00:25:07.932 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.932 "adrfam": "ipv4", 00:25:07.932 "trsvcid": "$NVMF_PORT", 00:25:07.932 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.932 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.932 "hdgst": ${hdgst:-false}, 00:25:07.932 "ddgst": ${ddgst:-false} 00:25:07.932 }, 00:25:07.932 "method": "bdev_nvme_attach_controller" 00:25:07.932 } 00:25:07.932 EOF 00:25:07.932 )") 00:25:07.932 05:21:09 -- nvmf/common.sh@542 -- # cat 00:25:07.932 05:21:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.932 05:21:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.932 { 00:25:07.932 "params": { 00:25:07.932 "name": "Nvme$subsystem", 00:25:07.932 "trtype": "$TEST_TRANSPORT", 00:25:07.932 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.932 "adrfam": "ipv4", 00:25:07.932 "trsvcid": "$NVMF_PORT", 00:25:07.932 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.932 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.932 "hdgst": ${hdgst:-false}, 00:25:07.932 "ddgst": ${ddgst:-false} 00:25:07.932 }, 00:25:07.932 "method": "bdev_nvme_attach_controller" 00:25:07.932 } 00:25:07.932 EOF 00:25:07.932 )") 00:25:07.932 05:21:09 -- nvmf/common.sh@542 -- # cat 00:25:07.932 05:21:09 -- nvmf/common.sh@544 -- # jq . 00:25:07.932 05:21:09 -- nvmf/common.sh@545 -- # IFS=, 00:25:07.932 05:21:09 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:07.932 "params": { 00:25:07.932 "name": "Nvme1", 00:25:07.932 "trtype": "tcp", 00:25:07.932 "traddr": "10.0.0.2", 00:25:07.932 "adrfam": "ipv4", 00:25:07.932 "trsvcid": "4420", 00:25:07.932 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:07.932 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:07.932 "hdgst": false, 00:25:07.932 "ddgst": false 00:25:07.932 }, 00:25:07.932 "method": "bdev_nvme_attach_controller" 00:25:07.932 },{ 00:25:07.932 "params": { 00:25:07.932 "name": "Nvme2", 00:25:07.932 "trtype": "tcp", 00:25:07.932 "traddr": "10.0.0.2", 00:25:07.932 "adrfam": "ipv4", 00:25:07.932 "trsvcid": "4420", 00:25:07.932 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:07.932 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:07.932 "hdgst": false, 00:25:07.932 "ddgst": false 00:25:07.932 }, 00:25:07.932 "method": "bdev_nvme_attach_controller" 00:25:07.932 },{ 00:25:07.932 "params": { 00:25:07.932 "name": "Nvme3", 00:25:07.932 "trtype": "tcp", 00:25:07.932 "traddr": "10.0.0.2", 00:25:07.932 "adrfam": "ipv4", 00:25:07.932 "trsvcid": "4420", 00:25:07.932 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:07.932 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:07.932 "hdgst": false, 00:25:07.932 "ddgst": false 00:25:07.932 }, 00:25:07.932 "method": "bdev_nvme_attach_controller" 00:25:07.932 },{ 00:25:07.932 "params": { 00:25:07.932 "name": "Nvme4", 00:25:07.932 "trtype": "tcp", 00:25:07.932 "traddr": "10.0.0.2", 00:25:07.932 "adrfam": "ipv4", 00:25:07.932 "trsvcid": "4420", 00:25:07.932 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:07.932 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:07.932 "hdgst": false, 00:25:07.932 "ddgst": false 00:25:07.932 }, 00:25:07.932 "method": "bdev_nvme_attach_controller" 00:25:07.932 },{ 00:25:07.932 "params": { 00:25:07.932 "name": "Nvme5", 00:25:07.932 "trtype": "tcp", 00:25:07.932 "traddr": "10.0.0.2", 00:25:07.932 "adrfam": "ipv4", 00:25:07.932 "trsvcid": "4420", 00:25:07.932 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:07.932 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:07.932 "hdgst": false, 00:25:07.932 "ddgst": false 00:25:07.932 }, 00:25:07.932 "method": "bdev_nvme_attach_controller" 00:25:07.932 },{ 00:25:07.932 "params": { 00:25:07.932 "name": "Nvme6", 00:25:07.932 "trtype": "tcp", 00:25:07.932 "traddr": "10.0.0.2", 00:25:07.932 "adrfam": "ipv4", 00:25:07.932 "trsvcid": "4420", 00:25:07.932 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:07.932 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:07.932 "hdgst": false, 00:25:07.932 "ddgst": false 00:25:07.932 }, 00:25:07.932 "method": "bdev_nvme_attach_controller" 00:25:07.932 },{ 00:25:07.932 "params": { 00:25:07.932 "name": "Nvme7", 00:25:07.932 "trtype": "tcp", 00:25:07.932 "traddr": "10.0.0.2", 00:25:07.932 "adrfam": "ipv4", 00:25:07.932 "trsvcid": "4420", 00:25:07.932 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:07.932 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:07.932 "hdgst": false, 00:25:07.932 "ddgst": false 00:25:07.932 }, 00:25:07.932 "method": "bdev_nvme_attach_controller" 00:25:07.932 },{ 00:25:07.932 "params": { 00:25:07.932 "name": "Nvme8", 00:25:07.932 "trtype": "tcp", 00:25:07.932 "traddr": "10.0.0.2", 00:25:07.932 "adrfam": "ipv4", 00:25:07.932 "trsvcid": "4420", 00:25:07.932 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:07.932 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:07.932 "hdgst": false, 00:25:07.932 "ddgst": false 00:25:07.932 }, 00:25:07.932 "method": "bdev_nvme_attach_controller" 00:25:07.932 },{ 00:25:07.932 "params": { 00:25:07.932 "name": "Nvme9", 00:25:07.932 "trtype": "tcp", 00:25:07.932 "traddr": "10.0.0.2", 00:25:07.932 "adrfam": "ipv4", 00:25:07.932 "trsvcid": "4420", 00:25:07.932 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:07.932 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:07.932 "hdgst": false, 00:25:07.932 "ddgst": false 00:25:07.932 }, 00:25:07.932 "method": "bdev_nvme_attach_controller" 00:25:07.932 },{ 00:25:07.932 "params": { 00:25:07.932 "name": "Nvme10", 00:25:07.932 "trtype": "tcp", 00:25:07.932 "traddr": "10.0.0.2", 00:25:07.932 "adrfam": "ipv4", 00:25:07.932 "trsvcid": "4420", 00:25:07.932 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:07.932 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:07.932 "hdgst": false, 00:25:07.932 "ddgst": false 00:25:07.932 }, 00:25:07.932 "method": "bdev_nvme_attach_controller" 00:25:07.932 }' 00:25:07.932 [2024-11-26 05:21:09.454876] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:07.932 [2024-11-26 05:21:09.454952] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:25:07.932 EAL: No free 2048 kB hugepages reported on node 1 00:25:07.933 [2024-11-26 05:21:09.519508] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:07.933 [2024-11-26 05:21:09.604537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:09.835 05:21:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:09.835 05:21:11 -- common/autotest_common.sh@862 -- # return 0 00:25:09.835 05:21:11 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:09.835 05:21:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:09.835 05:21:11 -- common/autotest_common.sh@10 -- # set +x 00:25:09.835 05:21:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:09.835 05:21:11 -- target/shutdown.sh@83 -- # kill -9 3371959 00:25:09.835 05:21:11 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:25:09.835 05:21:11 -- target/shutdown.sh@87 -- # sleep 1 00:25:10.773 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3371959 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:25:10.773 05:21:12 -- target/shutdown.sh@88 -- # kill -0 3371495 00:25:10.773 05:21:12 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:25:10.773 05:21:12 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:10.773 05:21:12 -- nvmf/common.sh@520 -- # config=() 00:25:10.773 05:21:12 -- nvmf/common.sh@520 -- # local subsystem config 00:25:10.773 05:21:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.773 { 00:25:10.773 "params": { 00:25:10.773 "name": "Nvme$subsystem", 00:25:10.773 "trtype": "$TEST_TRANSPORT", 00:25:10.773 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.773 "adrfam": "ipv4", 00:25:10.773 "trsvcid": "$NVMF_PORT", 00:25:10.773 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.773 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.773 "hdgst": ${hdgst:-false}, 00:25:10.773 "ddgst": ${ddgst:-false} 00:25:10.773 }, 00:25:10.773 "method": "bdev_nvme_attach_controller" 00:25:10.773 } 00:25:10.773 EOF 00:25:10.773 )") 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # cat 00:25:10.773 05:21:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.773 { 00:25:10.773 "params": { 00:25:10.773 "name": "Nvme$subsystem", 00:25:10.773 "trtype": "$TEST_TRANSPORT", 00:25:10.773 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.773 "adrfam": "ipv4", 00:25:10.773 "trsvcid": "$NVMF_PORT", 00:25:10.773 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.773 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.773 "hdgst": ${hdgst:-false}, 00:25:10.773 "ddgst": ${ddgst:-false} 00:25:10.773 }, 00:25:10.773 "method": "bdev_nvme_attach_controller" 00:25:10.773 } 00:25:10.773 EOF 00:25:10.773 )") 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # cat 00:25:10.773 05:21:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.773 { 00:25:10.773 "params": { 00:25:10.773 "name": "Nvme$subsystem", 00:25:10.773 "trtype": "$TEST_TRANSPORT", 00:25:10.773 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.773 "adrfam": "ipv4", 00:25:10.773 "trsvcid": "$NVMF_PORT", 00:25:10.773 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.773 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.773 "hdgst": ${hdgst:-false}, 00:25:10.773 "ddgst": ${ddgst:-false} 00:25:10.773 }, 00:25:10.773 "method": "bdev_nvme_attach_controller" 00:25:10.773 } 00:25:10.773 EOF 00:25:10.773 )") 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # cat 00:25:10.773 05:21:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.773 { 00:25:10.773 "params": { 00:25:10.773 "name": "Nvme$subsystem", 00:25:10.773 "trtype": "$TEST_TRANSPORT", 00:25:10.773 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.773 "adrfam": "ipv4", 00:25:10.773 "trsvcid": "$NVMF_PORT", 00:25:10.773 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.773 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.773 "hdgst": ${hdgst:-false}, 00:25:10.773 "ddgst": ${ddgst:-false} 00:25:10.773 }, 00:25:10.773 "method": "bdev_nvme_attach_controller" 00:25:10.773 } 00:25:10.773 EOF 00:25:10.773 )") 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # cat 00:25:10.773 05:21:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.773 { 00:25:10.773 "params": { 00:25:10.773 "name": "Nvme$subsystem", 00:25:10.773 "trtype": "$TEST_TRANSPORT", 00:25:10.773 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.773 "adrfam": "ipv4", 00:25:10.773 "trsvcid": "$NVMF_PORT", 00:25:10.773 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.773 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.773 "hdgst": ${hdgst:-false}, 00:25:10.773 "ddgst": ${ddgst:-false} 00:25:10.773 }, 00:25:10.773 "method": "bdev_nvme_attach_controller" 00:25:10.773 } 00:25:10.773 EOF 00:25:10.773 )") 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # cat 00:25:10.773 05:21:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.773 { 00:25:10.773 "params": { 00:25:10.773 "name": "Nvme$subsystem", 00:25:10.773 "trtype": "$TEST_TRANSPORT", 00:25:10.773 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.773 "adrfam": "ipv4", 00:25:10.773 "trsvcid": "$NVMF_PORT", 00:25:10.773 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.773 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.773 "hdgst": ${hdgst:-false}, 00:25:10.773 "ddgst": ${ddgst:-false} 00:25:10.773 }, 00:25:10.773 "method": "bdev_nvme_attach_controller" 00:25:10.773 } 00:25:10.773 EOF 00:25:10.773 )") 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # cat 00:25:10.773 05:21:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.773 { 00:25:10.773 "params": { 00:25:10.773 "name": "Nvme$subsystem", 00:25:10.773 "trtype": "$TEST_TRANSPORT", 00:25:10.773 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.773 "adrfam": "ipv4", 00:25:10.773 "trsvcid": "$NVMF_PORT", 00:25:10.773 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.773 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.773 "hdgst": ${hdgst:-false}, 00:25:10.773 "ddgst": ${ddgst:-false} 00:25:10.773 }, 00:25:10.773 "method": "bdev_nvme_attach_controller" 00:25:10.773 } 00:25:10.773 EOF 00:25:10.773 )") 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # cat 00:25:10.773 05:21:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.773 { 00:25:10.773 "params": { 00:25:10.773 "name": "Nvme$subsystem", 00:25:10.773 "trtype": "$TEST_TRANSPORT", 00:25:10.773 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.773 "adrfam": "ipv4", 00:25:10.773 "trsvcid": "$NVMF_PORT", 00:25:10.773 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.773 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.773 "hdgst": ${hdgst:-false}, 00:25:10.773 "ddgst": ${ddgst:-false} 00:25:10.773 }, 00:25:10.773 "method": "bdev_nvme_attach_controller" 00:25:10.773 } 00:25:10.773 EOF 00:25:10.773 )") 00:25:10.773 05:21:12 -- nvmf/common.sh@542 -- # cat 00:25:10.773 05:21:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.774 05:21:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.774 { 00:25:10.774 "params": { 00:25:10.774 "name": "Nvme$subsystem", 00:25:10.774 "trtype": "$TEST_TRANSPORT", 00:25:10.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.774 "adrfam": "ipv4", 00:25:10.774 "trsvcid": "$NVMF_PORT", 00:25:10.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.774 "hdgst": ${hdgst:-false}, 00:25:10.774 "ddgst": ${ddgst:-false} 00:25:10.774 }, 00:25:10.774 "method": "bdev_nvme_attach_controller" 00:25:10.774 } 00:25:10.774 EOF 00:25:10.774 )") 00:25:10.774 05:21:12 -- nvmf/common.sh@542 -- # cat 00:25:10.774 05:21:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.774 05:21:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.774 { 00:25:10.774 "params": { 00:25:10.774 "name": "Nvme$subsystem", 00:25:10.774 "trtype": "$TEST_TRANSPORT", 00:25:10.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.774 "adrfam": "ipv4", 00:25:10.774 "trsvcid": "$NVMF_PORT", 00:25:10.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.774 "hdgst": ${hdgst:-false}, 00:25:10.774 "ddgst": ${ddgst:-false} 00:25:10.774 }, 00:25:10.774 "method": "bdev_nvme_attach_controller" 00:25:10.774 } 00:25:10.774 EOF 00:25:10.774 )") 00:25:10.774 05:21:12 -- nvmf/common.sh@542 -- # cat 00:25:10.774 05:21:12 -- nvmf/common.sh@544 -- # jq . 00:25:10.774 05:21:12 -- nvmf/common.sh@545 -- # IFS=, 00:25:10.774 05:21:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:10.774 "params": { 00:25:10.774 "name": "Nvme1", 00:25:10.774 "trtype": "tcp", 00:25:10.774 "traddr": "10.0.0.2", 00:25:10.774 "adrfam": "ipv4", 00:25:10.774 "trsvcid": "4420", 00:25:10.774 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:10.774 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:10.774 "hdgst": false, 00:25:10.774 "ddgst": false 00:25:10.774 }, 00:25:10.774 "method": "bdev_nvme_attach_controller" 00:25:10.774 },{ 00:25:10.774 "params": { 00:25:10.774 "name": "Nvme2", 00:25:10.774 "trtype": "tcp", 00:25:10.774 "traddr": "10.0.0.2", 00:25:10.774 "adrfam": "ipv4", 00:25:10.774 "trsvcid": "4420", 00:25:10.774 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:10.774 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:10.774 "hdgst": false, 00:25:10.774 "ddgst": false 00:25:10.774 }, 00:25:10.774 "method": "bdev_nvme_attach_controller" 00:25:10.774 },{ 00:25:10.774 "params": { 00:25:10.774 "name": "Nvme3", 00:25:10.774 "trtype": "tcp", 00:25:10.774 "traddr": "10.0.0.2", 00:25:10.774 "adrfam": "ipv4", 00:25:10.774 "trsvcid": "4420", 00:25:10.774 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:10.774 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:10.774 "hdgst": false, 00:25:10.774 "ddgst": false 00:25:10.774 }, 00:25:10.774 "method": "bdev_nvme_attach_controller" 00:25:10.774 },{ 00:25:10.774 "params": { 00:25:10.774 "name": "Nvme4", 00:25:10.774 "trtype": "tcp", 00:25:10.774 "traddr": "10.0.0.2", 00:25:10.774 "adrfam": "ipv4", 00:25:10.774 "trsvcid": "4420", 00:25:10.774 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:10.774 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:10.774 "hdgst": false, 00:25:10.774 "ddgst": false 00:25:10.774 }, 00:25:10.774 "method": "bdev_nvme_attach_controller" 00:25:10.774 },{ 00:25:10.774 "params": { 00:25:10.774 "name": "Nvme5", 00:25:10.774 "trtype": "tcp", 00:25:10.774 "traddr": "10.0.0.2", 00:25:10.774 "adrfam": "ipv4", 00:25:10.774 "trsvcid": "4420", 00:25:10.774 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:10.774 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:10.774 "hdgst": false, 00:25:10.774 "ddgst": false 00:25:10.774 }, 00:25:10.774 "method": "bdev_nvme_attach_controller" 00:25:10.774 },{ 00:25:10.774 "params": { 00:25:10.774 "name": "Nvme6", 00:25:10.774 "trtype": "tcp", 00:25:10.774 "traddr": "10.0.0.2", 00:25:10.774 "adrfam": "ipv4", 00:25:10.774 "trsvcid": "4420", 00:25:10.774 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:10.774 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:10.774 "hdgst": false, 00:25:10.774 "ddgst": false 00:25:10.774 }, 00:25:10.774 "method": "bdev_nvme_attach_controller" 00:25:10.774 },{ 00:25:10.774 "params": { 00:25:10.774 "name": "Nvme7", 00:25:10.774 "trtype": "tcp", 00:25:10.774 "traddr": "10.0.0.2", 00:25:10.774 "adrfam": "ipv4", 00:25:10.774 "trsvcid": "4420", 00:25:10.774 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:10.774 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:10.774 "hdgst": false, 00:25:10.774 "ddgst": false 00:25:10.774 }, 00:25:10.774 "method": "bdev_nvme_attach_controller" 00:25:10.774 },{ 00:25:10.774 "params": { 00:25:10.774 "name": "Nvme8", 00:25:10.774 "trtype": "tcp", 00:25:10.774 "traddr": "10.0.0.2", 00:25:10.774 "adrfam": "ipv4", 00:25:10.774 "trsvcid": "4420", 00:25:10.774 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:10.774 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:10.774 "hdgst": false, 00:25:10.774 "ddgst": false 00:25:10.774 }, 00:25:10.774 "method": "bdev_nvme_attach_controller" 00:25:10.774 },{ 00:25:10.774 "params": { 00:25:10.774 "name": "Nvme9", 00:25:10.774 "trtype": "tcp", 00:25:10.774 "traddr": "10.0.0.2", 00:25:10.774 "adrfam": "ipv4", 00:25:10.774 "trsvcid": "4420", 00:25:10.774 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:10.774 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:10.774 "hdgst": false, 00:25:10.774 "ddgst": false 00:25:10.774 }, 00:25:10.774 "method": "bdev_nvme_attach_controller" 00:25:10.774 },{ 00:25:10.774 "params": { 00:25:10.774 "name": "Nvme10", 00:25:10.774 "trtype": "tcp", 00:25:10.774 "traddr": "10.0.0.2", 00:25:10.774 "adrfam": "ipv4", 00:25:10.774 "trsvcid": "4420", 00:25:10.774 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:10.774 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:10.774 "hdgst": false, 00:25:10.774 "ddgst": false 00:25:10.774 }, 00:25:10.774 "method": "bdev_nvme_attach_controller" 00:25:10.774 }' 00:25:10.774 [2024-11-26 05:21:12.225070] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:10.774 [2024-11-26 05:21:12.225157] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3372383 ] 00:25:10.774 EAL: No free 2048 kB hugepages reported on node 1 00:25:10.774 [2024-11-26 05:21:12.291236] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:10.774 [2024-11-26 05:21:12.378962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:12.681 Running I/O for 1 seconds... 00:25:13.617 00:25:13.617 Latency(us) 00:25:13.617 [2024-11-26T04:21:15.385Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:13.617 [2024-11-26T04:21:15.385Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:13.617 Verification LBA range: start 0x0 length 0x400 00:25:13.617 Nvme1n1 : 1.11 358.93 22.43 0.00 0.00 173483.42 44079.03 173985.94 00:25:13.617 [2024-11-26T04:21:15.385Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:13.617 Verification LBA range: start 0x0 length 0x400 00:25:13.617 Nvme2n1 : 1.10 395.35 24.71 0.00 0.00 157576.44 21554.06 121945.51 00:25:13.617 [2024-11-26T04:21:15.385Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:13.617 Verification LBA range: start 0x0 length 0x400 00:25:13.617 Nvme3n1 : 1.10 393.30 24.58 0.00 0.00 157173.09 23107.51 120392.06 00:25:13.617 [2024-11-26T04:21:15.385Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:13.617 Verification LBA range: start 0x0 length 0x400 00:25:13.617 Nvme4n1 : 1.11 392.16 24.51 0.00 0.00 156598.38 22524.97 119615.34 00:25:13.617 [2024-11-26T04:21:15.385Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:13.617 Verification LBA range: start 0x0 length 0x400 00:25:13.617 Nvme5n1 : 1.10 363.08 22.69 0.00 0.00 167075.45 38641.97 138256.69 00:25:13.617 [2024-11-26T04:21:15.385Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:13.617 Verification LBA range: start 0x0 length 0x400 00:25:13.617 Nvme6n1 : 1.11 390.72 24.42 0.00 0.00 154893.93 23010.42 120392.06 00:25:13.617 [2024-11-26T04:21:15.385Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:13.617 Verification LBA range: start 0x0 length 0x400 00:25:13.617 Nvme7n1 : 1.11 389.92 24.37 0.00 0.00 154164.63 22816.24 121945.51 00:25:13.617 [2024-11-26T04:21:15.385Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:13.617 Verification LBA range: start 0x0 length 0x400 00:25:13.617 Nvme8n1 : 1.11 389.50 24.34 0.00 0.00 153308.94 22427.88 123498.95 00:25:13.618 [2024-11-26T04:21:15.386Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:13.618 Verification LBA range: start 0x0 length 0x400 00:25:13.618 Nvme9n1 : 1.16 379.15 23.70 0.00 0.00 151476.64 16699.54 138256.69 00:25:13.618 [2024-11-26T04:21:15.386Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:13.618 Verification LBA range: start 0x0 length 0x400 00:25:13.618 Nvme10n1 : 1.12 388.97 24.31 0.00 0.00 151595.09 20680.25 124275.67 00:25:13.618 [2024-11-26T04:21:15.386Z] =================================================================================================================== 00:25:13.618 [2024-11-26T04:21:15.386Z] Total : 3841.09 240.07 0.00 0.00 157514.49 16699.54 173985.94 00:25:13.618 05:21:15 -- target/shutdown.sh@93 -- # stoptarget 00:25:13.618 05:21:15 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:13.618 05:21:15 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:13.618 05:21:15 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:13.618 05:21:15 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:13.618 05:21:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:13.618 05:21:15 -- nvmf/common.sh@116 -- # sync 00:25:13.618 05:21:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:13.618 05:21:15 -- nvmf/common.sh@119 -- # set +e 00:25:13.618 05:21:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:13.618 05:21:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:13.618 rmmod nvme_tcp 00:25:13.618 rmmod nvme_fabrics 00:25:13.618 rmmod nvme_keyring 00:25:13.877 05:21:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:13.877 05:21:15 -- nvmf/common.sh@123 -- # set -e 00:25:13.877 05:21:15 -- nvmf/common.sh@124 -- # return 0 00:25:13.877 05:21:15 -- nvmf/common.sh@477 -- # '[' -n 3371495 ']' 00:25:13.877 05:21:15 -- nvmf/common.sh@478 -- # killprocess 3371495 00:25:13.877 05:21:15 -- common/autotest_common.sh@936 -- # '[' -z 3371495 ']' 00:25:13.877 05:21:15 -- common/autotest_common.sh@940 -- # kill -0 3371495 00:25:13.877 05:21:15 -- common/autotest_common.sh@941 -- # uname 00:25:13.877 05:21:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:13.877 05:21:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3371495 00:25:13.877 05:21:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:13.877 05:21:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:13.877 05:21:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3371495' 00:25:13.877 killing process with pid 3371495 00:25:13.877 05:21:15 -- common/autotest_common.sh@955 -- # kill 3371495 00:25:13.877 05:21:15 -- common/autotest_common.sh@960 -- # wait 3371495 00:25:14.445 05:21:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:14.445 05:21:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:14.446 05:21:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:14.446 05:21:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:14.446 05:21:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:14.446 05:21:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:14.446 05:21:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:14.446 05:21:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:16.352 05:21:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:16.352 00:25:16.352 real 0m12.288s 00:25:16.352 user 0m36.264s 00:25:16.352 sys 0m3.315s 00:25:16.352 05:21:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:16.352 05:21:17 -- common/autotest_common.sh@10 -- # set +x 00:25:16.352 ************************************ 00:25:16.352 END TEST nvmf_shutdown_tc1 00:25:16.352 ************************************ 00:25:16.352 05:21:17 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:16.352 05:21:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:16.352 05:21:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:16.352 05:21:17 -- common/autotest_common.sh@10 -- # set +x 00:25:16.352 ************************************ 00:25:16.352 START TEST nvmf_shutdown_tc2 00:25:16.352 ************************************ 00:25:16.352 05:21:17 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:25:16.352 05:21:17 -- target/shutdown.sh@98 -- # starttarget 00:25:16.352 05:21:17 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:16.352 05:21:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:16.352 05:21:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:16.352 05:21:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:16.352 05:21:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:16.352 05:21:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:16.352 05:21:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:16.352 05:21:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:16.352 05:21:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:16.352 05:21:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:16.352 05:21:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:16.352 05:21:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:16.352 05:21:17 -- common/autotest_common.sh@10 -- # set +x 00:25:16.352 05:21:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:16.352 05:21:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:16.352 05:21:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:16.352 05:21:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:16.352 05:21:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:16.352 05:21:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:16.352 05:21:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:16.352 05:21:17 -- nvmf/common.sh@294 -- # net_devs=() 00:25:16.352 05:21:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:16.352 05:21:17 -- nvmf/common.sh@295 -- # e810=() 00:25:16.352 05:21:17 -- nvmf/common.sh@295 -- # local -ga e810 00:25:16.352 05:21:17 -- nvmf/common.sh@296 -- # x722=() 00:25:16.352 05:21:17 -- nvmf/common.sh@296 -- # local -ga x722 00:25:16.352 05:21:18 -- nvmf/common.sh@297 -- # mlx=() 00:25:16.352 05:21:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:16.352 05:21:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:16.352 05:21:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:16.352 05:21:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:16.352 05:21:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:16.352 05:21:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:16.352 05:21:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:16.352 05:21:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:16.352 05:21:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:16.352 05:21:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:16.352 05:21:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:16.352 05:21:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:16.352 05:21:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:16.352 05:21:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:16.352 05:21:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:16.352 05:21:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:16.352 05:21:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:16.352 05:21:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:16.352 05:21:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:16.352 05:21:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:16.352 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:16.352 05:21:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:16.352 05:21:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:16.352 05:21:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:16.353 05:21:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:16.353 05:21:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:16.353 05:21:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:16.353 05:21:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:16.353 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:16.353 05:21:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:16.353 05:21:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:16.353 05:21:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:16.353 05:21:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:16.353 05:21:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:16.353 05:21:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:16.353 05:21:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:16.353 05:21:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:16.353 05:21:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:16.353 05:21:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:16.353 05:21:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:16.353 05:21:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:16.353 05:21:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:16.353 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:16.353 05:21:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:16.353 05:21:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:16.353 05:21:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:16.353 05:21:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:16.353 05:21:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:16.353 05:21:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:16.353 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:16.353 05:21:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:16.353 05:21:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:16.353 05:21:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:16.353 05:21:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:16.353 05:21:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:16.353 05:21:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:16.353 05:21:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:16.353 05:21:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:16.353 05:21:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:16.353 05:21:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:16.353 05:21:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:16.353 05:21:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:16.353 05:21:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:16.353 05:21:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:16.353 05:21:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:16.353 05:21:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:16.353 05:21:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:16.353 05:21:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:16.353 05:21:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:16.611 05:21:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:16.611 05:21:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:16.611 05:21:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:16.611 05:21:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:16.611 05:21:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:16.611 05:21:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:16.611 05:21:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:16.611 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:16.611 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.243 ms 00:25:16.611 00:25:16.611 --- 10.0.0.2 ping statistics --- 00:25:16.611 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:16.611 rtt min/avg/max/mdev = 0.243/0.243/0.243/0.000 ms 00:25:16.611 05:21:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:16.611 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:16.611 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.178 ms 00:25:16.611 00:25:16.611 --- 10.0.0.1 ping statistics --- 00:25:16.611 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:16.612 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:25:16.612 05:21:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:16.612 05:21:18 -- nvmf/common.sh@410 -- # return 0 00:25:16.612 05:21:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:16.612 05:21:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:16.612 05:21:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:16.612 05:21:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:16.612 05:21:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:16.612 05:21:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:16.612 05:21:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:16.612 05:21:18 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:16.612 05:21:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:16.612 05:21:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:16.612 05:21:18 -- common/autotest_common.sh@10 -- # set +x 00:25:16.612 05:21:18 -- nvmf/common.sh@469 -- # nvmfpid=3373178 00:25:16.612 05:21:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:16.612 05:21:18 -- nvmf/common.sh@470 -- # waitforlisten 3373178 00:25:16.612 05:21:18 -- common/autotest_common.sh@829 -- # '[' -z 3373178 ']' 00:25:16.612 05:21:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:16.612 05:21:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:16.612 05:21:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:16.612 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:16.612 05:21:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:16.612 05:21:18 -- common/autotest_common.sh@10 -- # set +x 00:25:16.612 [2024-11-26 05:21:18.332492] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:16.612 [2024-11-26 05:21:18.332560] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:16.612 EAL: No free 2048 kB hugepages reported on node 1 00:25:16.870 [2024-11-26 05:21:18.399071] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:16.870 [2024-11-26 05:21:18.487911] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:16.870 [2024-11-26 05:21:18.488085] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:16.870 [2024-11-26 05:21:18.488114] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:16.870 [2024-11-26 05:21:18.488130] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:16.870 [2024-11-26 05:21:18.488214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:16.870 [2024-11-26 05:21:18.488272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:16.870 [2024-11-26 05:21:18.488335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:16.870 [2024-11-26 05:21:18.488337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:17.807 05:21:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:17.807 05:21:19 -- common/autotest_common.sh@862 -- # return 0 00:25:17.807 05:21:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:17.807 05:21:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:17.807 05:21:19 -- common/autotest_common.sh@10 -- # set +x 00:25:17.807 05:21:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:17.807 05:21:19 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:17.807 05:21:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:17.807 05:21:19 -- common/autotest_common.sh@10 -- # set +x 00:25:17.807 [2024-11-26 05:21:19.319385] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:17.807 05:21:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:17.807 05:21:19 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:17.807 05:21:19 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:17.807 05:21:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:17.807 05:21:19 -- common/autotest_common.sh@10 -- # set +x 00:25:17.807 05:21:19 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:17.807 05:21:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.807 05:21:19 -- target/shutdown.sh@28 -- # cat 00:25:17.807 05:21:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.807 05:21:19 -- target/shutdown.sh@28 -- # cat 00:25:17.807 05:21:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.807 05:21:19 -- target/shutdown.sh@28 -- # cat 00:25:17.807 05:21:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.807 05:21:19 -- target/shutdown.sh@28 -- # cat 00:25:17.807 05:21:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.807 05:21:19 -- target/shutdown.sh@28 -- # cat 00:25:17.807 05:21:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.807 05:21:19 -- target/shutdown.sh@28 -- # cat 00:25:17.807 05:21:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.807 05:21:19 -- target/shutdown.sh@28 -- # cat 00:25:17.807 05:21:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.807 05:21:19 -- target/shutdown.sh@28 -- # cat 00:25:17.807 05:21:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.807 05:21:19 -- target/shutdown.sh@28 -- # cat 00:25:17.807 05:21:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.807 05:21:19 -- target/shutdown.sh@28 -- # cat 00:25:17.807 05:21:19 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:17.807 05:21:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:17.807 05:21:19 -- common/autotest_common.sh@10 -- # set +x 00:25:17.807 Malloc1 00:25:17.807 [2024-11-26 05:21:19.408784] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:17.807 Malloc2 00:25:17.807 Malloc3 00:25:17.807 Malloc4 00:25:18.067 Malloc5 00:25:18.067 Malloc6 00:25:18.067 Malloc7 00:25:18.067 Malloc8 00:25:18.067 Malloc9 00:25:18.326 Malloc10 00:25:18.326 05:21:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.326 05:21:19 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:18.326 05:21:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:18.326 05:21:19 -- common/autotest_common.sh@10 -- # set +x 00:25:18.326 05:21:19 -- target/shutdown.sh@102 -- # perfpid=3373365 00:25:18.326 05:21:19 -- target/shutdown.sh@103 -- # waitforlisten 3373365 /var/tmp/bdevperf.sock 00:25:18.326 05:21:19 -- common/autotest_common.sh@829 -- # '[' -z 3373365 ']' 00:25:18.326 05:21:19 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:18.326 05:21:19 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:18.326 05:21:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:18.326 05:21:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:18.326 05:21:19 -- nvmf/common.sh@520 -- # config=() 00:25:18.326 05:21:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:18.326 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:18.326 05:21:19 -- nvmf/common.sh@520 -- # local subsystem config 00:25:18.326 05:21:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:18.326 05:21:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.326 05:21:19 -- common/autotest_common.sh@10 -- # set +x 00:25:18.326 05:21:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.326 { 00:25:18.326 "params": { 00:25:18.326 "name": "Nvme$subsystem", 00:25:18.326 "trtype": "$TEST_TRANSPORT", 00:25:18.326 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.326 "adrfam": "ipv4", 00:25:18.326 "trsvcid": "$NVMF_PORT", 00:25:18.326 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.326 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.326 "hdgst": ${hdgst:-false}, 00:25:18.326 "ddgst": ${ddgst:-false} 00:25:18.326 }, 00:25:18.326 "method": "bdev_nvme_attach_controller" 00:25:18.326 } 00:25:18.326 EOF 00:25:18.326 )") 00:25:18.326 05:21:19 -- nvmf/common.sh@542 -- # cat 00:25:18.326 05:21:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.326 05:21:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.326 { 00:25:18.326 "params": { 00:25:18.326 "name": "Nvme$subsystem", 00:25:18.326 "trtype": "$TEST_TRANSPORT", 00:25:18.326 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.326 "adrfam": "ipv4", 00:25:18.326 "trsvcid": "$NVMF_PORT", 00:25:18.326 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.326 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.326 "hdgst": ${hdgst:-false}, 00:25:18.326 "ddgst": ${ddgst:-false} 00:25:18.326 }, 00:25:18.326 "method": "bdev_nvme_attach_controller" 00:25:18.326 } 00:25:18.326 EOF 00:25:18.326 )") 00:25:18.326 05:21:19 -- nvmf/common.sh@542 -- # cat 00:25:18.326 05:21:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.326 05:21:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.326 { 00:25:18.326 "params": { 00:25:18.326 "name": "Nvme$subsystem", 00:25:18.326 "trtype": "$TEST_TRANSPORT", 00:25:18.326 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "$NVMF_PORT", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.327 "hdgst": ${hdgst:-false}, 00:25:18.327 "ddgst": ${ddgst:-false} 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 } 00:25:18.327 EOF 00:25:18.327 )") 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # cat 00:25:18.327 05:21:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.327 { 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme$subsystem", 00:25:18.327 "trtype": "$TEST_TRANSPORT", 00:25:18.327 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "$NVMF_PORT", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.327 "hdgst": ${hdgst:-false}, 00:25:18.327 "ddgst": ${ddgst:-false} 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 } 00:25:18.327 EOF 00:25:18.327 )") 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # cat 00:25:18.327 05:21:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.327 { 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme$subsystem", 00:25:18.327 "trtype": "$TEST_TRANSPORT", 00:25:18.327 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "$NVMF_PORT", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.327 "hdgst": ${hdgst:-false}, 00:25:18.327 "ddgst": ${ddgst:-false} 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 } 00:25:18.327 EOF 00:25:18.327 )") 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # cat 00:25:18.327 05:21:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.327 { 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme$subsystem", 00:25:18.327 "trtype": "$TEST_TRANSPORT", 00:25:18.327 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "$NVMF_PORT", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.327 "hdgst": ${hdgst:-false}, 00:25:18.327 "ddgst": ${ddgst:-false} 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 } 00:25:18.327 EOF 00:25:18.327 )") 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # cat 00:25:18.327 05:21:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.327 { 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme$subsystem", 00:25:18.327 "trtype": "$TEST_TRANSPORT", 00:25:18.327 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "$NVMF_PORT", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.327 "hdgst": ${hdgst:-false}, 00:25:18.327 "ddgst": ${ddgst:-false} 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 } 00:25:18.327 EOF 00:25:18.327 )") 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # cat 00:25:18.327 05:21:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.327 { 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme$subsystem", 00:25:18.327 "trtype": "$TEST_TRANSPORT", 00:25:18.327 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "$NVMF_PORT", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.327 "hdgst": ${hdgst:-false}, 00:25:18.327 "ddgst": ${ddgst:-false} 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 } 00:25:18.327 EOF 00:25:18.327 )") 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # cat 00:25:18.327 05:21:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.327 { 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme$subsystem", 00:25:18.327 "trtype": "$TEST_TRANSPORT", 00:25:18.327 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "$NVMF_PORT", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.327 "hdgst": ${hdgst:-false}, 00:25:18.327 "ddgst": ${ddgst:-false} 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 } 00:25:18.327 EOF 00:25:18.327 )") 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # cat 00:25:18.327 05:21:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.327 { 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme$subsystem", 00:25:18.327 "trtype": "$TEST_TRANSPORT", 00:25:18.327 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "$NVMF_PORT", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.327 "hdgst": ${hdgst:-false}, 00:25:18.327 "ddgst": ${ddgst:-false} 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 } 00:25:18.327 EOF 00:25:18.327 )") 00:25:18.327 05:21:19 -- nvmf/common.sh@542 -- # cat 00:25:18.327 05:21:19 -- nvmf/common.sh@544 -- # jq . 00:25:18.327 05:21:19 -- nvmf/common.sh@545 -- # IFS=, 00:25:18.327 05:21:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme1", 00:25:18.327 "trtype": "tcp", 00:25:18.327 "traddr": "10.0.0.2", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "4420", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:18.327 "hdgst": false, 00:25:18.327 "ddgst": false 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 },{ 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme2", 00:25:18.327 "trtype": "tcp", 00:25:18.327 "traddr": "10.0.0.2", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "4420", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:18.327 "hdgst": false, 00:25:18.327 "ddgst": false 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 },{ 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme3", 00:25:18.327 "trtype": "tcp", 00:25:18.327 "traddr": "10.0.0.2", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "4420", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:18.327 "hdgst": false, 00:25:18.327 "ddgst": false 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 },{ 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme4", 00:25:18.327 "trtype": "tcp", 00:25:18.327 "traddr": "10.0.0.2", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "4420", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:18.327 "hdgst": false, 00:25:18.327 "ddgst": false 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 },{ 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme5", 00:25:18.327 "trtype": "tcp", 00:25:18.327 "traddr": "10.0.0.2", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "4420", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:18.327 "hdgst": false, 00:25:18.327 "ddgst": false 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 },{ 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme6", 00:25:18.327 "trtype": "tcp", 00:25:18.327 "traddr": "10.0.0.2", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "4420", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:18.327 "hdgst": false, 00:25:18.327 "ddgst": false 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 },{ 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme7", 00:25:18.327 "trtype": "tcp", 00:25:18.327 "traddr": "10.0.0.2", 00:25:18.327 "adrfam": "ipv4", 00:25:18.327 "trsvcid": "4420", 00:25:18.327 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:18.327 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:18.327 "hdgst": false, 00:25:18.327 "ddgst": false 00:25:18.327 }, 00:25:18.327 "method": "bdev_nvme_attach_controller" 00:25:18.327 },{ 00:25:18.327 "params": { 00:25:18.327 "name": "Nvme8", 00:25:18.327 "trtype": "tcp", 00:25:18.327 "traddr": "10.0.0.2", 00:25:18.328 "adrfam": "ipv4", 00:25:18.328 "trsvcid": "4420", 00:25:18.328 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:18.328 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:18.328 "hdgst": false, 00:25:18.328 "ddgst": false 00:25:18.328 }, 00:25:18.328 "method": "bdev_nvme_attach_controller" 00:25:18.328 },{ 00:25:18.328 "params": { 00:25:18.328 "name": "Nvme9", 00:25:18.328 "trtype": "tcp", 00:25:18.328 "traddr": "10.0.0.2", 00:25:18.328 "adrfam": "ipv4", 00:25:18.328 "trsvcid": "4420", 00:25:18.328 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:18.328 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:18.328 "hdgst": false, 00:25:18.328 "ddgst": false 00:25:18.328 }, 00:25:18.328 "method": "bdev_nvme_attach_controller" 00:25:18.328 },{ 00:25:18.328 "params": { 00:25:18.328 "name": "Nvme10", 00:25:18.328 "trtype": "tcp", 00:25:18.328 "traddr": "10.0.0.2", 00:25:18.328 "adrfam": "ipv4", 00:25:18.328 "trsvcid": "4420", 00:25:18.328 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:18.328 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:18.328 "hdgst": false, 00:25:18.328 "ddgst": false 00:25:18.328 }, 00:25:18.328 "method": "bdev_nvme_attach_controller" 00:25:18.328 }' 00:25:18.328 [2024-11-26 05:21:19.932092] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:18.328 [2024-11-26 05:21:19.932162] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3373365 ] 00:25:18.328 EAL: No free 2048 kB hugepages reported on node 1 00:25:18.328 [2024-11-26 05:21:19.996542] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:18.328 [2024-11-26 05:21:20.087882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:20.230 Running I/O for 10 seconds... 00:25:20.230 05:21:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:20.230 05:21:21 -- common/autotest_common.sh@862 -- # return 0 00:25:20.230 05:21:21 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:20.230 05:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:20.230 05:21:21 -- common/autotest_common.sh@10 -- # set +x 00:25:20.230 05:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:20.230 05:21:21 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:20.230 05:21:21 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:20.230 05:21:21 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:20.230 05:21:21 -- target/shutdown.sh@57 -- # local ret=1 00:25:20.230 05:21:21 -- target/shutdown.sh@58 -- # local i 00:25:20.230 05:21:21 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:20.230 05:21:21 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:20.230 05:21:21 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:20.230 05:21:21 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:20.230 05:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:20.230 05:21:21 -- common/autotest_common.sh@10 -- # set +x 00:25:20.230 05:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:20.230 05:21:21 -- target/shutdown.sh@60 -- # read_io_count=42 00:25:20.230 05:21:21 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:25:20.230 05:21:21 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:20.489 05:21:22 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:20.489 05:21:22 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:20.489 05:21:22 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:20.489 05:21:22 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:20.489 05:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:20.489 05:21:22 -- common/autotest_common.sh@10 -- # set +x 00:25:20.489 05:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:20.489 05:21:22 -- target/shutdown.sh@60 -- # read_io_count=167 00:25:20.489 05:21:22 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:25:20.489 05:21:22 -- target/shutdown.sh@64 -- # ret=0 00:25:20.489 05:21:22 -- target/shutdown.sh@65 -- # break 00:25:20.489 05:21:22 -- target/shutdown.sh@69 -- # return 0 00:25:20.489 05:21:22 -- target/shutdown.sh@109 -- # killprocess 3373365 00:25:20.489 05:21:22 -- common/autotest_common.sh@936 -- # '[' -z 3373365 ']' 00:25:20.489 05:21:22 -- common/autotest_common.sh@940 -- # kill -0 3373365 00:25:20.489 05:21:22 -- common/autotest_common.sh@941 -- # uname 00:25:20.489 05:21:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:20.489 05:21:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3373365 00:25:20.489 05:21:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:20.489 05:21:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:20.489 05:21:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3373365' 00:25:20.489 killing process with pid 3373365 00:25:20.489 05:21:22 -- common/autotest_common.sh@955 -- # kill 3373365 00:25:20.489 05:21:22 -- common/autotest_common.sh@960 -- # wait 3373365 00:25:20.489 Received shutdown signal, test time was about 0.630434 seconds 00:25:20.489 00:25:20.489 Latency(us) 00:25:20.489 [2024-11-26T04:21:22.257Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:20.489 [2024-11-26T04:21:22.257Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:20.489 Verification LBA range: start 0x0 length 0x400 00:25:20.489 Nvme1n1 : 0.61 371.61 23.23 0.00 0.00 165300.61 29321.29 128159.29 00:25:20.489 [2024-11-26T04:21:22.257Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:20.489 Verification LBA range: start 0x0 length 0x400 00:25:20.489 Nvme2n1 : 0.61 370.82 23.18 0.00 0.00 163530.84 28350.39 125052.40 00:25:20.489 [2024-11-26T04:21:22.257Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:20.489 Verification LBA range: start 0x0 length 0x400 00:25:20.489 Nvme3n1 : 0.62 370.01 23.13 0.00 0.00 161870.94 29127.11 124275.67 00:25:20.489 [2024-11-26T04:21:22.257Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:20.490 Verification LBA range: start 0x0 length 0x400 00:25:20.490 Nvme4n1 : 0.62 369.22 23.08 0.00 0.00 160125.87 29127.11 125829.12 00:25:20.490 [2024-11-26T04:21:22.258Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:20.490 Verification LBA range: start 0x0 length 0x400 00:25:20.490 Nvme5n1 : 0.62 368.43 23.03 0.00 0.00 158289.67 28932.93 126605.84 00:25:20.490 [2024-11-26T04:21:22.258Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:20.490 Verification LBA range: start 0x0 length 0x400 00:25:20.490 Nvme6n1 : 0.62 367.64 22.98 0.00 0.00 156475.61 28544.57 126605.84 00:25:20.490 [2024-11-26T04:21:22.258Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:20.490 Verification LBA range: start 0x0 length 0x400 00:25:20.490 Nvme7n1 : 0.62 366.85 22.93 0.00 0.00 154915.35 28156.21 127382.57 00:25:20.490 [2024-11-26T04:21:22.258Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:20.490 Verification LBA range: start 0x0 length 0x400 00:25:20.490 Nvme8n1 : 0.62 365.87 22.87 0.00 0.00 153384.05 24855.13 128159.29 00:25:20.490 [2024-11-26T04:21:22.258Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:20.490 Verification LBA range: start 0x0 length 0x400 00:25:20.490 Nvme9n1 : 0.62 365.09 22.82 0.00 0.00 151701.15 27573.67 132042.90 00:25:20.490 [2024-11-26T04:21:22.258Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:20.490 Verification LBA range: start 0x0 length 0x400 00:25:20.490 Nvme10n1 : 0.63 362.16 22.64 0.00 0.00 150432.16 30292.20 132819.63 00:25:20.490 [2024-11-26T04:21:22.258Z] =================================================================================================================== 00:25:20.490 [2024-11-26T04:21:22.258Z] Total : 3677.72 229.86 0.00 0.00 157602.63 24855.13 132819.63 00:25:20.750 05:21:22 -- target/shutdown.sh@112 -- # sleep 1 00:25:22.128 05:21:23 -- target/shutdown.sh@113 -- # kill -0 3373178 00:25:22.128 05:21:23 -- target/shutdown.sh@115 -- # stoptarget 00:25:22.128 05:21:23 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:22.128 05:21:23 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:22.128 05:21:23 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:22.128 05:21:23 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:22.128 05:21:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:22.128 05:21:23 -- nvmf/common.sh@116 -- # sync 00:25:22.128 05:21:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:22.128 05:21:23 -- nvmf/common.sh@119 -- # set +e 00:25:22.128 05:21:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:22.128 05:21:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:22.128 rmmod nvme_tcp 00:25:22.128 rmmod nvme_fabrics 00:25:22.128 rmmod nvme_keyring 00:25:22.128 05:21:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:22.128 05:21:23 -- nvmf/common.sh@123 -- # set -e 00:25:22.128 05:21:23 -- nvmf/common.sh@124 -- # return 0 00:25:22.128 05:21:23 -- nvmf/common.sh@477 -- # '[' -n 3373178 ']' 00:25:22.128 05:21:23 -- nvmf/common.sh@478 -- # killprocess 3373178 00:25:22.128 05:21:23 -- common/autotest_common.sh@936 -- # '[' -z 3373178 ']' 00:25:22.128 05:21:23 -- common/autotest_common.sh@940 -- # kill -0 3373178 00:25:22.128 05:21:23 -- common/autotest_common.sh@941 -- # uname 00:25:22.128 05:21:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:22.128 05:21:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3373178 00:25:22.128 05:21:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:22.128 05:21:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:22.128 05:21:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3373178' 00:25:22.128 killing process with pid 3373178 00:25:22.128 05:21:23 -- common/autotest_common.sh@955 -- # kill 3373178 00:25:22.128 05:21:23 -- common/autotest_common.sh@960 -- # wait 3373178 00:25:22.389 05:21:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:22.389 05:21:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:22.389 05:21:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:22.389 05:21:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:22.389 05:21:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:22.389 05:21:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:22.389 05:21:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:22.389 05:21:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:24.928 05:21:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:24.928 00:25:24.928 real 0m8.084s 00:25:24.928 user 0m24.669s 00:25:24.928 sys 0m1.438s 00:25:24.928 05:21:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:24.928 05:21:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.928 ************************************ 00:25:24.928 END TEST nvmf_shutdown_tc2 00:25:24.928 ************************************ 00:25:24.928 05:21:26 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:24.928 05:21:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:24.928 05:21:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:24.928 05:21:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.928 ************************************ 00:25:24.928 START TEST nvmf_shutdown_tc3 00:25:24.928 ************************************ 00:25:24.928 05:21:26 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:24.928 05:21:26 -- target/shutdown.sh@120 -- # starttarget 00:25:24.928 05:21:26 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:24.928 05:21:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:24.928 05:21:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:24.928 05:21:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:24.928 05:21:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:24.928 05:21:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:24.928 05:21:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:24.928 05:21:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:24.928 05:21:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:24.928 05:21:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:24.928 05:21:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:24.928 05:21:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.928 05:21:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:24.928 05:21:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:24.928 05:21:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:24.928 05:21:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:24.928 05:21:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:24.928 05:21:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:24.928 05:21:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:24.928 05:21:26 -- nvmf/common.sh@294 -- # net_devs=() 00:25:24.928 05:21:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:24.928 05:21:26 -- nvmf/common.sh@295 -- # e810=() 00:25:24.928 05:21:26 -- nvmf/common.sh@295 -- # local -ga e810 00:25:24.928 05:21:26 -- nvmf/common.sh@296 -- # x722=() 00:25:24.928 05:21:26 -- nvmf/common.sh@296 -- # local -ga x722 00:25:24.928 05:21:26 -- nvmf/common.sh@297 -- # mlx=() 00:25:24.928 05:21:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:24.928 05:21:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:24.928 05:21:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:24.928 05:21:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:24.928 05:21:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:24.928 05:21:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:24.928 05:21:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:24.928 05:21:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:24.928 05:21:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:24.928 05:21:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:24.928 05:21:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:24.928 05:21:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:24.928 05:21:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:24.928 05:21:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:24.928 05:21:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:24.928 05:21:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:24.928 05:21:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:24.928 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:24.928 05:21:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:24.928 05:21:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:24.928 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:24.928 05:21:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:24.928 05:21:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:24.928 05:21:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:24.928 05:21:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:24.928 05:21:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:24.928 05:21:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:24.928 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:24.928 05:21:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:24.928 05:21:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:24.928 05:21:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:24.928 05:21:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:24.928 05:21:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:24.928 05:21:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:24.928 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:24.928 05:21:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:24.928 05:21:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:24.928 05:21:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:24.928 05:21:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:24.928 05:21:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:24.928 05:21:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:24.928 05:21:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:24.928 05:21:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:24.928 05:21:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:24.928 05:21:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:24.928 05:21:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:24.928 05:21:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:24.928 05:21:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:24.928 05:21:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:24.928 05:21:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:24.928 05:21:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:24.928 05:21:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:24.928 05:21:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:24.928 05:21:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:24.928 05:21:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:24.928 05:21:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:24.928 05:21:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:24.928 05:21:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:24.928 05:21:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:24.928 05:21:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:24.928 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:24.928 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:25:24.928 00:25:24.928 --- 10.0.0.2 ping statistics --- 00:25:24.928 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:24.928 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:25:24.928 05:21:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:24.928 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:24.928 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:25:24.928 00:25:24.928 --- 10.0.0.1 ping statistics --- 00:25:24.929 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:24.929 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:25:24.929 05:21:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:24.929 05:21:26 -- nvmf/common.sh@410 -- # return 0 00:25:24.929 05:21:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:24.929 05:21:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:24.929 05:21:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:24.929 05:21:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:24.929 05:21:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:24.929 05:21:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:24.929 05:21:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:24.929 05:21:26 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:24.929 05:21:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:24.929 05:21:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:24.929 05:21:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.929 05:21:26 -- nvmf/common.sh@469 -- # nvmfpid=3374299 00:25:24.929 05:21:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:24.929 05:21:26 -- nvmf/common.sh@470 -- # waitforlisten 3374299 00:25:24.929 05:21:26 -- common/autotest_common.sh@829 -- # '[' -z 3374299 ']' 00:25:24.929 05:21:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:24.929 05:21:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:24.929 05:21:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:24.929 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:24.929 05:21:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:24.929 05:21:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.929 [2024-11-26 05:21:26.333616] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:24.929 [2024-11-26 05:21:26.333710] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:24.929 EAL: No free 2048 kB hugepages reported on node 1 00:25:24.929 [2024-11-26 05:21:26.403802] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:24.929 [2024-11-26 05:21:26.492511] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:24.929 [2024-11-26 05:21:26.492701] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:24.929 [2024-11-26 05:21:26.492726] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:24.929 [2024-11-26 05:21:26.492751] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:24.929 [2024-11-26 05:21:26.492849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:24.929 [2024-11-26 05:21:26.492946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:24.929 [2024-11-26 05:21:26.493013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:24.929 [2024-11-26 05:21:26.493016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:25.865 05:21:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:25.865 05:21:27 -- common/autotest_common.sh@862 -- # return 0 00:25:25.865 05:21:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:25.865 05:21:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:25.865 05:21:27 -- common/autotest_common.sh@10 -- # set +x 00:25:25.865 05:21:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:25.865 05:21:27 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:25.865 05:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.865 05:21:27 -- common/autotest_common.sh@10 -- # set +x 00:25:25.865 [2024-11-26 05:21:27.305271] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:25.865 05:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.865 05:21:27 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:25.865 05:21:27 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:25.865 05:21:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:25.865 05:21:27 -- common/autotest_common.sh@10 -- # set +x 00:25:25.865 05:21:27 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:25.865 05:21:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.865 05:21:27 -- target/shutdown.sh@28 -- # cat 00:25:25.865 05:21:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.865 05:21:27 -- target/shutdown.sh@28 -- # cat 00:25:25.865 05:21:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.865 05:21:27 -- target/shutdown.sh@28 -- # cat 00:25:25.865 05:21:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.865 05:21:27 -- target/shutdown.sh@28 -- # cat 00:25:25.865 05:21:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.865 05:21:27 -- target/shutdown.sh@28 -- # cat 00:25:25.865 05:21:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.865 05:21:27 -- target/shutdown.sh@28 -- # cat 00:25:25.865 05:21:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.865 05:21:27 -- target/shutdown.sh@28 -- # cat 00:25:25.865 05:21:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.865 05:21:27 -- target/shutdown.sh@28 -- # cat 00:25:25.865 05:21:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.865 05:21:27 -- target/shutdown.sh@28 -- # cat 00:25:25.865 05:21:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.865 05:21:27 -- target/shutdown.sh@28 -- # cat 00:25:25.865 05:21:27 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:25.865 05:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.865 05:21:27 -- common/autotest_common.sh@10 -- # set +x 00:25:25.865 Malloc1 00:25:25.865 [2024-11-26 05:21:27.380198] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:25.865 Malloc2 00:25:25.865 Malloc3 00:25:25.865 Malloc4 00:25:25.865 Malloc5 00:25:25.865 Malloc6 00:25:26.123 Malloc7 00:25:26.123 Malloc8 00:25:26.123 Malloc9 00:25:26.123 Malloc10 00:25:26.123 05:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.123 05:21:27 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:26.123 05:21:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:26.123 05:21:27 -- common/autotest_common.sh@10 -- # set +x 00:25:26.123 05:21:27 -- target/shutdown.sh@124 -- # perfpid=3374489 00:25:26.123 05:21:27 -- target/shutdown.sh@125 -- # waitforlisten 3374489 /var/tmp/bdevperf.sock 00:25:26.123 05:21:27 -- common/autotest_common.sh@829 -- # '[' -z 3374489 ']' 00:25:26.123 05:21:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:26.123 05:21:27 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:26.123 05:21:27 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:26.123 05:21:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:26.123 05:21:27 -- nvmf/common.sh@520 -- # config=() 00:25:26.123 05:21:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:26.123 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:26.123 05:21:27 -- nvmf/common.sh@520 -- # local subsystem config 00:25:26.123 05:21:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:26.123 05:21:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.123 05:21:27 -- common/autotest_common.sh@10 -- # set +x 00:25:26.123 05:21:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.123 { 00:25:26.123 "params": { 00:25:26.123 "name": "Nvme$subsystem", 00:25:26.123 "trtype": "$TEST_TRANSPORT", 00:25:26.123 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.123 "adrfam": "ipv4", 00:25:26.123 "trsvcid": "$NVMF_PORT", 00:25:26.123 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.123 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.123 "hdgst": ${hdgst:-false}, 00:25:26.123 "ddgst": ${ddgst:-false} 00:25:26.123 }, 00:25:26.123 "method": "bdev_nvme_attach_controller" 00:25:26.123 } 00:25:26.123 EOF 00:25:26.123 )") 00:25:26.123 05:21:27 -- nvmf/common.sh@542 -- # cat 00:25:26.123 05:21:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.123 05:21:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.123 { 00:25:26.123 "params": { 00:25:26.123 "name": "Nvme$subsystem", 00:25:26.123 "trtype": "$TEST_TRANSPORT", 00:25:26.123 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.123 "adrfam": "ipv4", 00:25:26.123 "trsvcid": "$NVMF_PORT", 00:25:26.123 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.123 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.123 "hdgst": ${hdgst:-false}, 00:25:26.123 "ddgst": ${ddgst:-false} 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 } 00:25:26.124 EOF 00:25:26.124 )") 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # cat 00:25:26.124 05:21:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.124 { 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme$subsystem", 00:25:26.124 "trtype": "$TEST_TRANSPORT", 00:25:26.124 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "$NVMF_PORT", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.124 "hdgst": ${hdgst:-false}, 00:25:26.124 "ddgst": ${ddgst:-false} 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 } 00:25:26.124 EOF 00:25:26.124 )") 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # cat 00:25:26.124 05:21:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.124 { 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme$subsystem", 00:25:26.124 "trtype": "$TEST_TRANSPORT", 00:25:26.124 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "$NVMF_PORT", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.124 "hdgst": ${hdgst:-false}, 00:25:26.124 "ddgst": ${ddgst:-false} 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 } 00:25:26.124 EOF 00:25:26.124 )") 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # cat 00:25:26.124 05:21:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.124 { 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme$subsystem", 00:25:26.124 "trtype": "$TEST_TRANSPORT", 00:25:26.124 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "$NVMF_PORT", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.124 "hdgst": ${hdgst:-false}, 00:25:26.124 "ddgst": ${ddgst:-false} 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 } 00:25:26.124 EOF 00:25:26.124 )") 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # cat 00:25:26.124 05:21:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.124 { 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme$subsystem", 00:25:26.124 "trtype": "$TEST_TRANSPORT", 00:25:26.124 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "$NVMF_PORT", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.124 "hdgst": ${hdgst:-false}, 00:25:26.124 "ddgst": ${ddgst:-false} 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 } 00:25:26.124 EOF 00:25:26.124 )") 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # cat 00:25:26.124 05:21:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.124 { 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme$subsystem", 00:25:26.124 "trtype": "$TEST_TRANSPORT", 00:25:26.124 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "$NVMF_PORT", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.124 "hdgst": ${hdgst:-false}, 00:25:26.124 "ddgst": ${ddgst:-false} 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 } 00:25:26.124 EOF 00:25:26.124 )") 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # cat 00:25:26.124 05:21:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.124 { 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme$subsystem", 00:25:26.124 "trtype": "$TEST_TRANSPORT", 00:25:26.124 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "$NVMF_PORT", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.124 "hdgst": ${hdgst:-false}, 00:25:26.124 "ddgst": ${ddgst:-false} 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 } 00:25:26.124 EOF 00:25:26.124 )") 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # cat 00:25:26.124 05:21:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.124 { 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme$subsystem", 00:25:26.124 "trtype": "$TEST_TRANSPORT", 00:25:26.124 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "$NVMF_PORT", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.124 "hdgst": ${hdgst:-false}, 00:25:26.124 "ddgst": ${ddgst:-false} 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 } 00:25:26.124 EOF 00:25:26.124 )") 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # cat 00:25:26.124 05:21:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.124 { 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme$subsystem", 00:25:26.124 "trtype": "$TEST_TRANSPORT", 00:25:26.124 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "$NVMF_PORT", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.124 "hdgst": ${hdgst:-false}, 00:25:26.124 "ddgst": ${ddgst:-false} 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 } 00:25:26.124 EOF 00:25:26.124 )") 00:25:26.124 05:21:27 -- nvmf/common.sh@542 -- # cat 00:25:26.124 05:21:27 -- nvmf/common.sh@544 -- # jq . 00:25:26.124 05:21:27 -- nvmf/common.sh@545 -- # IFS=, 00:25:26.124 05:21:27 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme1", 00:25:26.124 "trtype": "tcp", 00:25:26.124 "traddr": "10.0.0.2", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "4420", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:26.124 "hdgst": false, 00:25:26.124 "ddgst": false 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 },{ 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme2", 00:25:26.124 "trtype": "tcp", 00:25:26.124 "traddr": "10.0.0.2", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "4420", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:26.124 "hdgst": false, 00:25:26.124 "ddgst": false 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 },{ 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme3", 00:25:26.124 "trtype": "tcp", 00:25:26.124 "traddr": "10.0.0.2", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "4420", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:26.124 "hdgst": false, 00:25:26.124 "ddgst": false 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 },{ 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme4", 00:25:26.124 "trtype": "tcp", 00:25:26.124 "traddr": "10.0.0.2", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "4420", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:26.124 "hdgst": false, 00:25:26.124 "ddgst": false 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 },{ 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme5", 00:25:26.124 "trtype": "tcp", 00:25:26.124 "traddr": "10.0.0.2", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "4420", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:26.124 "hdgst": false, 00:25:26.124 "ddgst": false 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 },{ 00:25:26.124 "params": { 00:25:26.124 "name": "Nvme6", 00:25:26.124 "trtype": "tcp", 00:25:26.124 "traddr": "10.0.0.2", 00:25:26.124 "adrfam": "ipv4", 00:25:26.124 "trsvcid": "4420", 00:25:26.124 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:26.124 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:26.124 "hdgst": false, 00:25:26.124 "ddgst": false 00:25:26.124 }, 00:25:26.124 "method": "bdev_nvme_attach_controller" 00:25:26.124 },{ 00:25:26.125 "params": { 00:25:26.125 "name": "Nvme7", 00:25:26.125 "trtype": "tcp", 00:25:26.125 "traddr": "10.0.0.2", 00:25:26.125 "adrfam": "ipv4", 00:25:26.125 "trsvcid": "4420", 00:25:26.125 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:26.125 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:26.125 "hdgst": false, 00:25:26.125 "ddgst": false 00:25:26.125 }, 00:25:26.125 "method": "bdev_nvme_attach_controller" 00:25:26.125 },{ 00:25:26.125 "params": { 00:25:26.125 "name": "Nvme8", 00:25:26.125 "trtype": "tcp", 00:25:26.125 "traddr": "10.0.0.2", 00:25:26.125 "adrfam": "ipv4", 00:25:26.125 "trsvcid": "4420", 00:25:26.125 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:26.125 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:26.125 "hdgst": false, 00:25:26.125 "ddgst": false 00:25:26.125 }, 00:25:26.125 "method": "bdev_nvme_attach_controller" 00:25:26.125 },{ 00:25:26.125 "params": { 00:25:26.125 "name": "Nvme9", 00:25:26.125 "trtype": "tcp", 00:25:26.125 "traddr": "10.0.0.2", 00:25:26.125 "adrfam": "ipv4", 00:25:26.125 "trsvcid": "4420", 00:25:26.125 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:26.125 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:26.125 "hdgst": false, 00:25:26.125 "ddgst": false 00:25:26.125 }, 00:25:26.125 "method": "bdev_nvme_attach_controller" 00:25:26.125 },{ 00:25:26.125 "params": { 00:25:26.125 "name": "Nvme10", 00:25:26.125 "trtype": "tcp", 00:25:26.125 "traddr": "10.0.0.2", 00:25:26.125 "adrfam": "ipv4", 00:25:26.125 "trsvcid": "4420", 00:25:26.125 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:26.125 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:26.125 "hdgst": false, 00:25:26.125 "ddgst": false 00:25:26.125 }, 00:25:26.125 "method": "bdev_nvme_attach_controller" 00:25:26.125 }' 00:25:26.125 [2024-11-26 05:21:27.884625] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:26.125 [2024-11-26 05:21:27.884733] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3374489 ] 00:25:26.384 EAL: No free 2048 kB hugepages reported on node 1 00:25:26.384 [2024-11-26 05:21:27.950536] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:26.384 [2024-11-26 05:21:28.037004] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:28.287 Running I/O for 10 seconds... 00:25:28.287 05:21:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:28.287 05:21:29 -- common/autotest_common.sh@862 -- # return 0 00:25:28.287 05:21:29 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:28.287 05:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.287 05:21:29 -- common/autotest_common.sh@10 -- # set +x 00:25:28.287 05:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.287 05:21:29 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:28.287 05:21:29 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:28.287 05:21:29 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:28.287 05:21:29 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:28.287 05:21:29 -- target/shutdown.sh@57 -- # local ret=1 00:25:28.287 05:21:29 -- target/shutdown.sh@58 -- # local i 00:25:28.287 05:21:29 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:28.287 05:21:29 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:28.287 05:21:29 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:28.287 05:21:29 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:28.287 05:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.287 05:21:29 -- common/autotest_common.sh@10 -- # set +x 00:25:28.287 05:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.287 05:21:29 -- target/shutdown.sh@60 -- # read_io_count=42 00:25:28.287 05:21:29 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:25:28.287 05:21:29 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:28.287 05:21:29 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:28.287 05:21:29 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:28.287 05:21:29 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:28.287 05:21:29 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:28.287 05:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.287 05:21:29 -- common/autotest_common.sh@10 -- # set +x 00:25:28.287 05:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.287 05:21:30 -- target/shutdown.sh@60 -- # read_io_count=167 00:25:28.287 05:21:30 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:25:28.287 05:21:30 -- target/shutdown.sh@64 -- # ret=0 00:25:28.287 05:21:30 -- target/shutdown.sh@65 -- # break 00:25:28.287 05:21:30 -- target/shutdown.sh@69 -- # return 0 00:25:28.287 05:21:30 -- target/shutdown.sh@134 -- # killprocess 3374299 00:25:28.287 05:21:30 -- common/autotest_common.sh@936 -- # '[' -z 3374299 ']' 00:25:28.287 05:21:30 -- common/autotest_common.sh@940 -- # kill -0 3374299 00:25:28.287 05:21:30 -- common/autotest_common.sh@941 -- # uname 00:25:28.287 05:21:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:28.287 05:21:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3374299 00:25:28.562 05:21:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:28.562 05:21:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:28.562 05:21:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3374299' 00:25:28.562 killing process with pid 3374299 00:25:28.562 05:21:30 -- common/autotest_common.sh@955 -- # kill 3374299 00:25:28.562 05:21:30 -- common/autotest_common.sh@960 -- # wait 3374299 00:25:28.562 [2024-11-26 05:21:30.070459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.070990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.071002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.562 [2024-11-26 05:21:30.071013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071095] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.071384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfe90 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.072995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.563 [2024-11-26 05:21:30.073297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.564 [2024-11-26 05:21:30.073309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.564 [2024-11-26 05:21:30.073322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.564 [2024-11-26 05:21:30.073333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.564 [2024-11-26 05:21:30.073345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.564 [2024-11-26 05:21:30.073356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.564 [2024-11-26 05:21:30.073368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.564 [2024-11-26 05:21:30.073380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.564 [2024-11-26 05:21:30.073391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c2750 is same with the state(5) to be set 00:25:28.564 [2024-11-26 05:21:30.075370] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.564 [2024-11-26 05:21:30.075419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.075438] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.564 [2024-11-26 05:21:30.075453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.075468] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.564 [2024-11-26 05:21:30.075489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.075512] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.564 [2024-11-26 05:21:30.075527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.075542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15d66b0 is same with the state(5) to be set 00:25:28.564 [2024-11-26 05:21:30.075625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.075649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.075679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.075713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.075752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.075770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.075786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.075800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.075815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.075829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.075844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.075857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.075874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.075888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.075903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.075918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.075934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.075948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.075965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.075988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.564 [2024-11-26 05:21:30.076610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.564 [2024-11-26 05:21:30.076623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.076639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.076653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.076667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.076681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.076705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.076731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.076747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.076761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.076776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.076789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.076809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.076824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.076840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.076854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.076869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.076883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.076898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.076913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.076928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.076941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.076956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.076980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.076995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.565 [2024-11-26 05:21:30.077683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.565 [2024-11-26 05:21:30.077803] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1647f90 was disconnected and freed. reset controller. 00:25:28.565 [2024-11-26 05:21:30.080120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.565 [2024-11-26 05:21:30.080148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.565 [2024-11-26 05:21:30.080162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.565 [2024-11-26 05:21:30.080175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.565 [2024-11-26 05:21:30.080187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.565 [2024-11-26 05:21:30.080199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.565 [2024-11-26 05:21:30.080211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.565 [2024-11-26 05:21:30.080223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.565 [2024-11-26 05:21:30.080235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.565 [2024-11-26 05:21:30.080262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.565 [2024-11-26 05:21:30.080275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.565 [2024-11-26 05:21:30.080287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.565 [2024-11-26 05:21:30.080299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.080988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.081000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c0340 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082950] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.082986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.083000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.083012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.083024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.083035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.083047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.566 [2024-11-26 05:21:30.083059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083095] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.083487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c07f0 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.084903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.084933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.084954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.084979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.084992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085236] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.567 [2024-11-26 05:21:30.085444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.085708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1130 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086149] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086211] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086244] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086271] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x179bc50 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086354] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086392] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086419] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086446] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x179d100 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086516] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086558] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086585] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086612] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15f8a30 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086691] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086731] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086757] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086785] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1777c80 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15d66b0 (9): Bad file descriptor 00:25:28.568 [2024-11-26 05:21:30.086864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with [2024-11-26 05:21:30.086897] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsthe state(5) to be set 00:25:28.568 id:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086940] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.086962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086979] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.086990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.086993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.568 [2024-11-26 05:21:30.087003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.087008] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.568 [2024-11-26 05:21:30.087015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.568 [2024-11-26 05:21:30.087022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.087027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15e3d30 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.087597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c15e0 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.088497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.088544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.088576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.088606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.088635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.088664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.088704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.088735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.088773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.088804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.088835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.088846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.088865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.088879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.088889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.088894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.088908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.569 [2024-11-26 05:21:30.088915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.088924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.569 [2024-11-26 05:21:30.088928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.569 [2024-11-26 05:21:30.088939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 05:21:30.088940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.088954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.088956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.088966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.088970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.088978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.088986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.088990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with [2024-11-26 05:21:30.089169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:29952 len:1the state(5) to be set 00:25:28.570 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:28288 len:12[2024-11-26 05:21:30.089238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 05:21:30.089266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with [2024-11-26 05:21:30.089389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:28928 len:12the state(5) to be set 00:25:28.570 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with [2024-11-26 05:21:30.089455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30336 len:12the state(5) to be set 00:25:28.570 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with [2024-11-26 05:21:30.089517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:30592 len:1the state(5) to be set 00:25:28.570 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.570 [2024-11-26 05:21:30.089531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with [2024-11-26 05:21:30.089532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:28.570 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.570 [2024-11-26 05:21:30.089545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.570 [2024-11-26 05:21:30.089549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.089557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.571 [2024-11-26 05:21:30.089563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.089570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.571 [2024-11-26 05:21:30.089580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:30848 len:12[2024-11-26 05:21:30.089582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 the state(5) to be set 00:25:28.571 [2024-11-26 05:21:30.089603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with [2024-11-26 05:21:30.089603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:28.571 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.089616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.571 [2024-11-26 05:21:30.089621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.089629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.571 [2024-11-26 05:21:30.089635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.089642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.571 [2024-11-26 05:21:30.089651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.089654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.571 [2024-11-26 05:21:30.089664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 05:21:30.089666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 the state(5) to be set 00:25:28.571 [2024-11-26 05:21:30.089679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.571 [2024-11-26 05:21:30.089682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.089700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.571 [2024-11-26 05:21:30.089704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.089713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1a90 is same with the state(5) to be set 00:25:28.571 [2024-11-26 05:21:30.089720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.089734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.089749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.089764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.089779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.089793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.089808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.089821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.089836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.089854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.089870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.089884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.089899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.089912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.089928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.089941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.089958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.089986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.571 [2024-11-26 05:21:30.090433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.571 [2024-11-26 05:21:30.090448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.572 [2024-11-26 05:21:30.090462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.572 [2024-11-26 05:21:30.090477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.572 [2024-11-26 05:21:30.090491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.572 [2024-11-26 05:21:30.090506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.572 [2024-11-26 05:21:30.090520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.572 [2024-11-26 05:21:30.090534] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1755cd0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090607] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1755cd0 was disconnected and freed. reset controller. 00:25:28.572 [2024-11-26 05:21:30.090697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.090984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:28.572 [2024-11-26 05:21:30.090999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.572 [2024-11-26 05:21:30.091169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 05:21:30.091181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.572 the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.572 [2024-11-26 05:21:30.091205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with [2024-11-26 05:21:30.091217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:28.572 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.572 [2024-11-26 05:21:30.091231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.572 [2024-11-26 05:21:30.091244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.572 [2024-11-26 05:21:30.091256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with [2024-11-26 05:21:30.091267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128the state(5) to be set 00:25:28.572 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.572 [2024-11-26 05:21:30.091281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.572 [2024-11-26 05:21:30.091293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.572 [2024-11-26 05:21:30.091306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 05:21:30.091318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.572 the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.572 [2024-11-26 05:21:30.091347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.572 [2024-11-26 05:21:30.091359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128[2024-11-26 05:21:30.091371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.572 the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with [2024-11-26 05:21:30.091386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:28.572 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.572 [2024-11-26 05:21:30.091400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.572 [2024-11-26 05:21:30.091412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.572 [2024-11-26 05:21:30.091425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:12[2024-11-26 05:21:30.091437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.572 the state(5) to be set 00:25:28.572 [2024-11-26 05:21:30.091452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with [2024-11-26 05:21:30.091452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:28.572 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.572 [2024-11-26 05:21:30.091465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.091470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.091485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.091501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:12[2024-11-26 05:21:30.091502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.091521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.091522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c1df0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.091540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.091974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.091991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.092021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.092049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.092077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.092106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.092135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.092164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.092192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.092220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.092240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with [2024-11-26 05:21:30.092249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30976 len:12the state(5) to be set 00:25:28.573 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 05:21:30.092270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.092285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.092287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.092302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.092309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.092318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.092332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 05:21:30.092333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.092346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.092349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.092363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.092370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.092378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.092392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.573 [2024-11-26 05:21:30.092394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.573 [2024-11-26 05:21:30.092407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with [2024-11-26 05:21:30.092407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31616 len:12the state(5) to be set 00:25:28.573 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.573 [2024-11-26 05:21:30.092420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.092432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 05:21:30.092456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.092493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 05:21:30.092517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.092553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 05:21:30.092578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.092626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with [2024-11-26 05:21:30.092640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32512 len:1the state(5) to be set 00:25:28.574 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.092671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.092709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 05:21:30.092734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.092772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 05:21:30.092798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.092837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.092867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:33408 len:1[2024-11-26 05:21:30.092880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with [2024-11-26 05:21:30.092894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:28.574 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.092908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.092933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:33664 len:1[2024-11-26 05:21:30.092946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with [2024-11-26 05:21:30.092961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:28.574 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.092975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 [2024-11-26 05:21:30.092987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.092994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.092999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.093010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:33920 len:1[2024-11-26 05:21:30.093012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.574 the state(5) to be set 00:25:28.574 [2024-11-26 05:21:30.093040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with [2024-11-26 05:21:30.093042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:28.574 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.574 [2024-11-26 05:21:30.093058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.575 [2024-11-26 05:21:30.093063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.575 [2024-11-26 05:21:30.093072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.575 [2024-11-26 05:21:30.093078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.093084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.575 [2024-11-26 05:21:30.093093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.575 [2024-11-26 05:21:30.093097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.575 [2024-11-26 05:21:30.093108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.093110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c22a0 is same with the state(5) to be set 00:25:28.575 [2024-11-26 05:21:30.093123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.575 [2024-11-26 05:21:30.093138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.093153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.575 [2024-11-26 05:21:30.093166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.093182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.575 [2024-11-26 05:21:30.093196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.093212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.575 [2024-11-26 05:21:30.093226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.093313] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1754e90 was disconnected and freed. reset controller. 00:25:28.575 [2024-11-26 05:21:30.094757] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:28.575 [2024-11-26 05:21:30.094795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:28.575 [2024-11-26 05:21:30.094823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15f8a30 (9): Bad file descriptor 00:25:28.575 [2024-11-26 05:21:30.095099] nvmf.c:1141:spdk_nvmf_tgt_new_qpair: *ERROR*: No poll groups exist. 00:25:28.575 [2024-11-26 05:21:30.097533] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:28.575 [2024-11-26 05:21:30.097570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x179d100 (9): Bad file descriptor 00:25:28.575 [2024-11-26 05:21:30.097663] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.097693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.097711] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.097731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.097746] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.097760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.097774] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.097787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.097800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1787660 is same with the state(5) to be set 00:25:28.575 [2024-11-26 05:21:30.097852] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.097875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.097892] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.097905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.097920] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.097933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.097948] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.097961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.097974] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x162d650 is same with the state(5) to be set 00:25:28.575 [2024-11-26 05:21:30.098003] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x179bc50 (9): Bad file descriptor 00:25:28.575 [2024-11-26 05:21:30.098055] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.098076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.098091] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.098104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.098119] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.098133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.098147] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.098161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.098173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x162b070 is same with the state(5) to be set 00:25:28.575 [2024-11-26 05:21:30.098203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1777c80 (9): Bad file descriptor 00:25:28.575 [2024-11-26 05:21:30.098259] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.098280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.098295] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.098308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.098322] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.098335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.098349] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.575 [2024-11-26 05:21:30.098362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.098375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x178c700 is same with the state(5) to be set 00:25:28.575 [2024-11-26 05:21:30.098404] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15e3d30 (9): Bad file descriptor 00:25:28.575 [2024-11-26 05:21:30.098855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.575 [2024-11-26 05:21:30.098880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.098901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.575 [2024-11-26 05:21:30.098917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.098934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.575 [2024-11-26 05:21:30.098949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.098965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.575 [2024-11-26 05:21:30.098979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.098994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.575 [2024-11-26 05:21:30.099009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.099025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.575 [2024-11-26 05:21:30.099038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.575 [2024-11-26 05:21:30.099054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.099551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.099566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1757040 is same with the state(5) to be set 00:25:28.576 [2024-11-26 05:21:30.099638] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1757040 was disconnected and freed. reset controller. 00:25:28.576 [2024-11-26 05:21:30.100028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.576 [2024-11-26 05:21:30.100140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.576 [2024-11-26 05:21:30.100167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15f8a30 with addr=10.0.0.2, port=4420 00:25:28.576 [2024-11-26 05:21:30.100184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15f8a30 is same with the state(5) to be set 00:25:28.576 [2024-11-26 05:21:30.100214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15d66b0 (9): Bad file descriptor 00:25:28.576 [2024-11-26 05:21:30.100292] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:28.576 [2024-11-26 05:21:30.101558] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:28.576 [2024-11-26 05:21:30.101626] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:28.576 [2024-11-26 05:21:30.101776] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:28.576 [2024-11-26 05:21:30.101899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.576 [2024-11-26 05:21:30.102046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.576 [2024-11-26 05:21:30.102072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x179d100 with addr=10.0.0.2, port=4420 00:25:28.576 [2024-11-26 05:21:30.102088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x179d100 is same with the state(5) to be set 00:25:28.576 [2024-11-26 05:21:30.102108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15f8a30 (9): Bad file descriptor 00:25:28.576 [2024-11-26 05:21:30.102126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:28.576 [2024-11-26 05:21:30.102140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:28.576 [2024-11-26 05:21:30.102157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:28.576 [2024-11-26 05:21:30.102183] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:28.576 [2024-11-26 05:21:30.102339] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:28.576 [2024-11-26 05:21:30.102411] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:28.576 [2024-11-26 05:21:30.102445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.576 [2024-11-26 05:21:30.102549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.576 [2024-11-26 05:21:30.102653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.576 [2024-11-26 05:21:30.102678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1777c80 with addr=10.0.0.2, port=4420 00:25:28.576 [2024-11-26 05:21:30.102703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1777c80 is same with the state(5) to be set 00:25:28.576 [2024-11-26 05:21:30.102724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x179d100 (9): Bad file descriptor 00:25:28.576 [2024-11-26 05:21:30.102741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:28.576 [2024-11-26 05:21:30.102754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:28.576 [2024-11-26 05:21:30.102767] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:28.576 [2024-11-26 05:21:30.103102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.576 [2024-11-26 05:21:30.103128] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1777c80 (9): Bad file descriptor 00:25:28.576 [2024-11-26 05:21:30.103146] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:28.576 [2024-11-26 05:21:30.103159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:28.576 [2024-11-26 05:21:30.103173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:28.576 [2024-11-26 05:21:30.103236] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.576 [2024-11-26 05:21:30.103256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:28.576 [2024-11-26 05:21:30.103269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:28.576 [2024-11-26 05:21:30.103283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:28.576 [2024-11-26 05:21:30.103343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.576 [2024-11-26 05:21:30.107570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1787660 (9): Bad file descriptor 00:25:28.576 [2024-11-26 05:21:30.107626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x162d650 (9): Bad file descriptor 00:25:28.576 [2024-11-26 05:21:30.107668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x162b070 (9): Bad file descriptor 00:25:28.576 [2024-11-26 05:21:30.107712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x178c700 (9): Bad file descriptor 00:25:28.576 [2024-11-26 05:21:30.107876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.107902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.107935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.107950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.576 [2024-11-26 05:21:30.107969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.576 [2024-11-26 05:21:30.107984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.108983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.108999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.109013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.109029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.109043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.109058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.109072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.109090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.109104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.109120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.109134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.109150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.109163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.109179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.577 [2024-11-26 05:21:30.109197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.577 [2024-11-26 05:21:30.109214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.109868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.109884] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17538f0 is same with the state(5) to be set 00:25:28.578 [2024-11-26 05:21:30.111162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.578 [2024-11-26 05:21:30.111872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.578 [2024-11-26 05:21:30.111895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.111909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.111926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.111940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.111956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.111969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.111984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.111998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.112973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.112988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.113003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.113019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.113033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.113049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.113062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.113078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.579 [2024-11-26 05:21:30.113092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.579 [2024-11-26 05:21:30.113108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.580 [2024-11-26 05:21:30.113121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.580 [2024-11-26 05:21:30.113137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.580 [2024-11-26 05:21:30.113151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.580 [2024-11-26 05:21:30.113166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.580 [2024-11-26 05:21:30.113180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.580 [2024-11-26 05:21:30.113195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.580 [2024-11-26 05:21:30.113209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.580 [2024-11-26 05:21:30.113225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.580 [2024-11-26 05:21:30.113239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.580 [2024-11-26 05:21:30.113254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.580 [2024-11-26 05:21:30.113269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.580 [2024-11-26 05:21:30.113285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.580 [2024-11-26 05:21:30.113298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.580 [2024-11-26 05:21:30.113313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x164dd90 is same with the state(5) to be set 00:25:28.580 [2024-11-26 05:21:30.115356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:28.580 [2024-11-26 05:21:30.115390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:28.580 [2024-11-26 05:21:30.115571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:28.580 [2024-11-26 05:21:30.115853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.580 [2024-11-26 05:21:30.115964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.580 [2024-11-26 05:21:30.115990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15e3d30 with addr=10.0.0.2, port=4420 00:25:28.580 [2024-11-26 05:21:30.116007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15e3d30 is same with the state(5) to be set 00:25:28.580 [2024-11-26 05:21:30.116099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.580 [2024-11-26 05:21:30.116207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.580 [2024-11-26 05:21:30.116232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x179bc50 with addr=10.0.0.2, port=4420 00:25:28.580 [2024-11-26 05:21:30.116248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x179bc50 is same with the state(5) to be set 00:25:28.580 [2024-11-26 05:21:30.116812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:28.580 [2024-11-26 05:21:30.116839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:28.580 [2024-11-26 05:21:30.116856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:28.580 [2024-11-26 05:21:30.116981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.580 [2024-11-26 05:21:30.117085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.580 [2024-11-26 05:21:30.117110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15f8a30 with addr=10.0.0.2, port=4420 00:25:28.580 [2024-11-26 05:21:30.117126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15f8a30 is same with the state(5) to be set 00:25:28.580 [2024-11-26 05:21:30.117150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15e3d30 (9): Bad file descriptor 00:25:28.580 [2024-11-26 05:21:30.117172] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x179bc50 (9): Bad file descriptor 00:25:28.580 [2024-11-26 05:21:30.117321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.580 [2024-11-26 05:21:30.117428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.580 [2024-11-26 05:21:30.117454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x179d100 with addr=10.0.0.2, port=4420 00:25:28.580 [2024-11-26 05:21:30.117470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x179d100 is same with the state(5) to be set 00:25:28.580 [2024-11-26 05:21:30.117570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.580 [2024-11-26 05:21:30.117678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.580 [2024-11-26 05:21:30.117709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15d66b0 with addr=10.0.0.2, port=4420 00:25:28.580 [2024-11-26 05:21:30.117725] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15d66b0 is same with the state(5) to be set 00:25:28.580 [2024-11-26 05:21:30.117818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.580 [2024-11-26 05:21:30.117923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.580 [2024-11-26 05:21:30.117947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1777c80 with addr=10.0.0.2, port=4420 00:25:28.580 [2024-11-26 05:21:30.117963] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1777c80 is same with the state(5) to be set 00:25:28.580 [2024-11-26 05:21:30.117989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15f8a30 (9): Bad file descriptor 00:25:28.580 [2024-11-26 05:21:30.118009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:28.580 [2024-11-26 05:21:30.118023] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:28.580 [2024-11-26 05:21:30.118040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:28.580 [2024-11-26 05:21:30.118062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:28.580 [2024-11-26 05:21:30.118076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:28.580 [2024-11-26 05:21:30.118090] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:28.580 [2024-11-26 05:21:30.118158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.580 [2024-11-26 05:21:30.118179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.580 [2024-11-26 05:21:30.118195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x179d100 (9): Bad file descriptor 00:25:28.580 [2024-11-26 05:21:30.118214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15d66b0 (9): Bad file descriptor 00:25:28.580 [2024-11-26 05:21:30.118232] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1777c80 (9): Bad file descriptor 00:25:28.580 [2024-11-26 05:21:30.118247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:28.580 [2024-11-26 05:21:30.118261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:28.580 [2024-11-26 05:21:30.118274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:28.580 [2024-11-26 05:21:30.118352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.580 [2024-11-26 05:21:30.118389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:28.580 [2024-11-26 05:21:30.118404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:28.580 [2024-11-26 05:21:30.118419] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:28.580 [2024-11-26 05:21:30.118437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:28.580 [2024-11-26 05:21:30.118452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:28.580 [2024-11-26 05:21:30.118464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:28.580 [2024-11-26 05:21:30.118482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:28.580 [2024-11-26 05:21:30.118495] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:28.580 [2024-11-26 05:21:30.118508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:28.580 [2024-11-26 05:21:30.118577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.580 [2024-11-26 05:21:30.118600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.580 [2024-11-26 05:21:30.118628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.580 [2024-11-26 05:21:30.118645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.580 [2024-11-26 05:21:30.118668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.580 [2024-11-26 05:21:30.118683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.580 [2024-11-26 05:21:30.118710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.118725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.118742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.118756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.118772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.118785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.118802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.118816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.118833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.118847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.118865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.118878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.118895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.118909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.118925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.118939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.118955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.118969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.118985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.118999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.581 [2024-11-26 05:21:30.119892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.581 [2024-11-26 05:21:30.119908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.119922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.119937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.119951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.119967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.119982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.119998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.120555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.120570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1648820 is same with the state(5) to be set 00:25:28.582 [2024-11-26 05:21:30.121826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.121855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.121878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.121894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.121910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.121925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.121941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.121955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.121971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.121986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.122001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.122015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.122030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.122044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.122060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.122073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.122089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.122103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.122119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.122133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.122149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.122162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.122178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.122193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.122210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.122224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.122245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.122259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.122276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.122291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.122308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.122323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.122338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.122353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.582 [2024-11-26 05:21:30.122370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.582 [2024-11-26 05:21:30.122384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.122973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.122987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.583 [2024-11-26 05:21:30.123577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.583 [2024-11-26 05:21:30.123591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.123607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.123620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.123636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.123650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.123666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.123680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.123704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.123719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.123735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.123749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.123764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.123778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.123798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.123813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.123828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1649dc0 is same with the state(5) to be set 00:25:28.584 [2024-11-26 05:21:30.125023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.584 [2024-11-26 05:21:30.125885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.584 [2024-11-26 05:21:30.125899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.125915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.125929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.125945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.125959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.125974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.125988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.126979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.126993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.127009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.127022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.127038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x164b360 is same with the state(5) to be set 00:25:28.585 [2024-11-26 05:21:30.128250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.128274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.128295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.128311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.585 [2024-11-26 05:21:30.128328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.585 [2024-11-26 05:21:30.128342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.128980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.128996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.586 [2024-11-26 05:21:30.129552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.586 [2024-11-26 05:21:30.129568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.129600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.129630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.129660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.129696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.129733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.129764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.129794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.129823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.129853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.129883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.129913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.129944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.129974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.129989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.130005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.130019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.130035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.130048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.130065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.130079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.130099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.130114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.130130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.130144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.130160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.130174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.130190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.130204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.130219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.587 [2024-11-26 05:21:30.130233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.587 [2024-11-26 05:21:30.130248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x164c870 is same with the state(5) to be set 00:25:28.587 [2024-11-26 05:21:30.131827] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.587 [2024-11-26 05:21:30.131854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.587 [2024-11-26 05:21:30.131867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.587 [2024-11-26 05:21:30.131884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:28.587 [2024-11-26 05:21:30.131905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:28.587 [2024-11-26 05:21:30.132049] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:28.587 [2024-11-26 05:21:30.132077] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:28.587 [2024-11-26 05:21:30.132158] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:28.587 task offset: 29184 on job bdev=Nvme1n1 fails 00:25:28.587 00:25:28.587 Latency(us) 00:25:28.587 [2024-11-26T04:21:30.355Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme1n1 ended in about 0.56 seconds with error 00:25:28.587 Verification LBA range: start 0x0 length 0x400 00:25:28.587 Nvme1n1 : 0.56 372.30 23.27 114.55 0.00 130297.24 22816.24 118061.89 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme2n1 ended in about 0.58 seconds with error 00:25:28.587 Verification LBA range: start 0x0 length 0x400 00:25:28.587 Nvme2n1 : 0.58 282.03 17.63 110.06 0.00 159734.10 86992.97 146023.92 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme3n1 ended in about 0.57 seconds with error 00:25:28.587 Verification LBA range: start 0x0 length 0x400 00:25:28.587 Nvme3n1 : 0.57 366.86 22.93 112.88 0.00 128697.93 22136.60 115731.72 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme4n1 ended in about 0.56 seconds with error 00:25:28.587 Verification LBA range: start 0x0 length 0x400 00:25:28.587 Nvme4n1 : 0.56 368.19 23.01 113.29 0.00 126505.36 7961.41 115731.72 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme5n1 ended in about 0.57 seconds with error 00:25:28.587 Verification LBA range: start 0x0 length 0x400 00:25:28.587 Nvme5n1 : 0.57 358.38 22.40 40.21 0.00 150226.38 3689.43 117285.17 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme6n1 ended in about 0.59 seconds with error 00:25:28.587 Verification LBA range: start 0x0 length 0x400 00:25:28.587 Nvme6n1 : 0.59 276.95 17.31 108.08 0.00 154452.04 100197.26 128936.01 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme7n1 ended in about 0.60 seconds with error 00:25:28.587 Verification LBA range: start 0x0 length 0x400 00:25:28.587 Nvme7n1 : 0.60 275.46 17.22 107.49 0.00 153235.01 85051.16 134373.07 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme8n1 ended in about 0.60 seconds with error 00:25:28.587 Verification LBA range: start 0x0 length 0x400 00:25:28.587 Nvme8n1 : 0.60 273.98 17.12 106.92 0.00 152094.62 93595.12 128159.29 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme9n1 ended in about 0.60 seconds with error 00:25:28.587 Verification LBA range: start 0x0 length 0x400 00:25:28.587 Nvme9n1 : 0.60 272.52 17.03 106.35 0.00 151042.81 96702.01 121168.78 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.587 [2024-11-26T04:21:30.355Z] Job: Nvme10n1 ended in about 0.58 seconds with error 00:25:28.587 Verification LBA range: start 0x0 length 0x400 00:25:28.587 Nvme10n1 : 0.58 280.39 17.52 109.42 0.00 144371.68 63691.28 123498.95 00:25:28.587 [2024-11-26T04:21:30.355Z] =================================================================================================================== 00:25:28.587 [2024-11-26T04:21:30.356Z] Total : 3127.07 195.44 1029.26 0.00 144159.14 3689.43 146023.92 00:25:28.588 [2024-11-26 05:21:30.157776] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:28.588 [2024-11-26 05:21:30.157864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:28.588 [2024-11-26 05:21:30.158208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.158352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.158380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1787660 with addr=10.0.0.2, port=4420 00:25:28.588 [2024-11-26 05:21:30.158401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1787660 is same with the state(5) to be set 00:25:28.588 [2024-11-26 05:21:30.158497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.158599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.158626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x178c700 with addr=10.0.0.2, port=4420 00:25:28.588 [2024-11-26 05:21:30.158642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x178c700 is same with the state(5) to be set 00:25:28.588 [2024-11-26 05:21:30.159769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:28.588 [2024-11-26 05:21:30.159799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:28.588 [2024-11-26 05:21:30.159816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:28.588 [2024-11-26 05:21:30.159833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:28.588 [2024-11-26 05:21:30.159849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:28.588 [2024-11-26 05:21:30.160022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.160142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.160170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x162b070 with addr=10.0.0.2, port=4420 00:25:28.588 [2024-11-26 05:21:30.160187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x162b070 is same with the state(5) to be set 00:25:28.588 [2024-11-26 05:21:30.160277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.160375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.160401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x162d650 with addr=10.0.0.2, port=4420 00:25:28.588 [2024-11-26 05:21:30.160417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x162d650 is same with the state(5) to be set 00:25:28.588 [2024-11-26 05:21:30.160443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1787660 (9): Bad file descriptor 00:25:28.588 [2024-11-26 05:21:30.160467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x178c700 (9): Bad file descriptor 00:25:28.588 [2024-11-26 05:21:30.160530] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:28.588 [2024-11-26 05:21:30.160560] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:28.588 [2024-11-26 05:21:30.160580] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:28.588 [2024-11-26 05:21:30.160646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:28.588 [2024-11-26 05:21:30.160800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.160902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.160929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x179bc50 with addr=10.0.0.2, port=4420 00:25:28.588 [2024-11-26 05:21:30.160945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x179bc50 is same with the state(5) to be set 00:25:28.588 [2024-11-26 05:21:30.161028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.161129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.161156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15e3d30 with addr=10.0.0.2, port=4420 00:25:28.588 [2024-11-26 05:21:30.161172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15e3d30 is same with the state(5) to be set 00:25:28.588 [2024-11-26 05:21:30.161257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.161350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.161376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15f8a30 with addr=10.0.0.2, port=4420 00:25:28.588 [2024-11-26 05:21:30.161393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15f8a30 is same with the state(5) to be set 00:25:28.588 [2024-11-26 05:21:30.161487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.161579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.161605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1777c80 with addr=10.0.0.2, port=4420 00:25:28.588 [2024-11-26 05:21:30.161621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1777c80 is same with the state(5) to be set 00:25:28.588 [2024-11-26 05:21:30.161707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.161798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.161824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15d66b0 with addr=10.0.0.2, port=4420 00:25:28.588 [2024-11-26 05:21:30.161846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15d66b0 is same with the state(5) to be set 00:25:28.588 [2024-11-26 05:21:30.161865] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x162b070 (9): Bad file descriptor 00:25:28.588 [2024-11-26 05:21:30.161885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x162d650 (9): Bad file descriptor 00:25:28.588 [2024-11-26 05:21:30.161902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:28.588 [2024-11-26 05:21:30.161915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:28.588 [2024-11-26 05:21:30.161933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:28.588 [2024-11-26 05:21:30.161954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:28.588 [2024-11-26 05:21:30.161968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:28.588 [2024-11-26 05:21:30.161982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:28.588 [2024-11-26 05:21:30.162066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.588 [2024-11-26 05:21:30.162088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.588 [2024-11-26 05:21:30.162178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.162274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:28.588 [2024-11-26 05:21:30.162299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x179d100 with addr=10.0.0.2, port=4420 00:25:28.588 [2024-11-26 05:21:30.162315] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x179d100 is same with the state(5) to be set 00:25:28.588 [2024-11-26 05:21:30.162334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x179bc50 (9): Bad file descriptor 00:25:28.588 [2024-11-26 05:21:30.162353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15e3d30 (9): Bad file descriptor 00:25:28.588 [2024-11-26 05:21:30.162371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15f8a30 (9): Bad file descriptor 00:25:28.588 [2024-11-26 05:21:30.162389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1777c80 (9): Bad file descriptor 00:25:28.588 [2024-11-26 05:21:30.162406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15d66b0 (9): Bad file descriptor 00:25:28.588 [2024-11-26 05:21:30.162422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:28.588 [2024-11-26 05:21:30.162434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:28.588 [2024-11-26 05:21:30.162448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:28.588 [2024-11-26 05:21:30.162464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:28.588 [2024-11-26 05:21:30.162478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:28.588 [2024-11-26 05:21:30.162492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:28.588 [2024-11-26 05:21:30.162530] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.588 [2024-11-26 05:21:30.162548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.588 [2024-11-26 05:21:30.162565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x179d100 (9): Bad file descriptor 00:25:28.588 [2024-11-26 05:21:30.162582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:28.588 [2024-11-26 05:21:30.162601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:28.588 [2024-11-26 05:21:30.162615] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:28.588 [2024-11-26 05:21:30.162632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:28.588 [2024-11-26 05:21:30.162646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:28.588 [2024-11-26 05:21:30.162658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:28.588 [2024-11-26 05:21:30.162674] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:28.588 [2024-11-26 05:21:30.162695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:28.588 [2024-11-26 05:21:30.162710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:28.588 [2024-11-26 05:21:30.162725] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:28.588 [2024-11-26 05:21:30.162739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:28.588 [2024-11-26 05:21:30.162753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:28.588 [2024-11-26 05:21:30.162768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:28.588 [2024-11-26 05:21:30.162783] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:28.588 [2024-11-26 05:21:30.162796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:28.588 [2024-11-26 05:21:30.162835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.589 [2024-11-26 05:21:30.162852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.589 [2024-11-26 05:21:30.162865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.589 [2024-11-26 05:21:30.162877] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.589 [2024-11-26 05:21:30.162888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.589 [2024-11-26 05:21:30.162900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:28.589 [2024-11-26 05:21:30.162913] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:28.589 [2024-11-26 05:21:30.162926] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:28.589 [2024-11-26 05:21:30.162965] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:28.846 05:21:30 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:28.846 05:21:30 -- target/shutdown.sh@138 -- # sleep 1 00:25:30.228 05:21:31 -- target/shutdown.sh@141 -- # kill -9 3374489 00:25:30.228 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (3374489) - No such process 00:25:30.228 05:21:31 -- target/shutdown.sh@141 -- # true 00:25:30.228 05:21:31 -- target/shutdown.sh@143 -- # stoptarget 00:25:30.228 05:21:31 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:30.228 05:21:31 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:30.228 05:21:31 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:30.228 05:21:31 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:30.228 05:21:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:30.228 05:21:31 -- nvmf/common.sh@116 -- # sync 00:25:30.228 05:21:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:30.228 05:21:31 -- nvmf/common.sh@119 -- # set +e 00:25:30.228 05:21:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:30.228 05:21:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:30.228 rmmod nvme_tcp 00:25:30.228 rmmod nvme_fabrics 00:25:30.228 rmmod nvme_keyring 00:25:30.228 05:21:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:30.228 05:21:31 -- nvmf/common.sh@123 -- # set -e 00:25:30.228 05:21:31 -- nvmf/common.sh@124 -- # return 0 00:25:30.228 05:21:31 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:30.228 05:21:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:30.228 05:21:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:30.228 05:21:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:30.228 05:21:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:30.228 05:21:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:30.228 05:21:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:30.228 05:21:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:30.228 05:21:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:32.134 05:21:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:32.134 00:25:32.134 real 0m7.604s 00:25:32.134 user 0m18.801s 00:25:32.134 sys 0m1.401s 00:25:32.134 05:21:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:32.134 05:21:33 -- common/autotest_common.sh@10 -- # set +x 00:25:32.134 ************************************ 00:25:32.134 END TEST nvmf_shutdown_tc3 00:25:32.134 ************************************ 00:25:32.134 05:21:33 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:32.134 00:25:32.134 real 0m28.212s 00:25:32.134 user 1m19.877s 00:25:32.134 sys 0m6.270s 00:25:32.134 05:21:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:32.134 05:21:33 -- common/autotest_common.sh@10 -- # set +x 00:25:32.134 ************************************ 00:25:32.134 END TEST nvmf_shutdown 00:25:32.134 ************************************ 00:25:32.134 05:21:33 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:32.134 05:21:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:32.134 05:21:33 -- common/autotest_common.sh@10 -- # set +x 00:25:32.134 05:21:33 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:32.134 05:21:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:32.134 05:21:33 -- common/autotest_common.sh@10 -- # set +x 00:25:32.134 05:21:33 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:32.134 05:21:33 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:32.134 05:21:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:32.134 05:21:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:32.134 05:21:33 -- common/autotest_common.sh@10 -- # set +x 00:25:32.134 ************************************ 00:25:32.134 START TEST nvmf_multicontroller 00:25:32.134 ************************************ 00:25:32.134 05:21:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:32.134 * Looking for test storage... 00:25:32.134 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:32.134 05:21:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:32.134 05:21:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:32.134 05:21:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:32.394 05:21:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:32.394 05:21:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:32.394 05:21:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:32.394 05:21:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:32.394 05:21:33 -- scripts/common.sh@335 -- # IFS=.-: 00:25:32.394 05:21:33 -- scripts/common.sh@335 -- # read -ra ver1 00:25:32.394 05:21:33 -- scripts/common.sh@336 -- # IFS=.-: 00:25:32.394 05:21:33 -- scripts/common.sh@336 -- # read -ra ver2 00:25:32.394 05:21:33 -- scripts/common.sh@337 -- # local 'op=<' 00:25:32.394 05:21:33 -- scripts/common.sh@339 -- # ver1_l=2 00:25:32.394 05:21:33 -- scripts/common.sh@340 -- # ver2_l=1 00:25:32.394 05:21:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:32.394 05:21:33 -- scripts/common.sh@343 -- # case "$op" in 00:25:32.394 05:21:33 -- scripts/common.sh@344 -- # : 1 00:25:32.394 05:21:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:32.394 05:21:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:32.394 05:21:33 -- scripts/common.sh@364 -- # decimal 1 00:25:32.394 05:21:33 -- scripts/common.sh@352 -- # local d=1 00:25:32.394 05:21:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:32.394 05:21:33 -- scripts/common.sh@354 -- # echo 1 00:25:32.394 05:21:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:32.394 05:21:33 -- scripts/common.sh@365 -- # decimal 2 00:25:32.394 05:21:33 -- scripts/common.sh@352 -- # local d=2 00:25:32.394 05:21:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:32.394 05:21:33 -- scripts/common.sh@354 -- # echo 2 00:25:32.394 05:21:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:32.394 05:21:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:32.394 05:21:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:32.394 05:21:33 -- scripts/common.sh@367 -- # return 0 00:25:32.394 05:21:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:32.394 05:21:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:32.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:32.394 --rc genhtml_branch_coverage=1 00:25:32.394 --rc genhtml_function_coverage=1 00:25:32.394 --rc genhtml_legend=1 00:25:32.394 --rc geninfo_all_blocks=1 00:25:32.394 --rc geninfo_unexecuted_blocks=1 00:25:32.394 00:25:32.394 ' 00:25:32.394 05:21:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:32.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:32.394 --rc genhtml_branch_coverage=1 00:25:32.394 --rc genhtml_function_coverage=1 00:25:32.394 --rc genhtml_legend=1 00:25:32.394 --rc geninfo_all_blocks=1 00:25:32.394 --rc geninfo_unexecuted_blocks=1 00:25:32.394 00:25:32.394 ' 00:25:32.394 05:21:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:32.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:32.394 --rc genhtml_branch_coverage=1 00:25:32.394 --rc genhtml_function_coverage=1 00:25:32.394 --rc genhtml_legend=1 00:25:32.394 --rc geninfo_all_blocks=1 00:25:32.394 --rc geninfo_unexecuted_blocks=1 00:25:32.394 00:25:32.394 ' 00:25:32.394 05:21:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:32.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:32.394 --rc genhtml_branch_coverage=1 00:25:32.394 --rc genhtml_function_coverage=1 00:25:32.394 --rc genhtml_legend=1 00:25:32.394 --rc geninfo_all_blocks=1 00:25:32.394 --rc geninfo_unexecuted_blocks=1 00:25:32.394 00:25:32.394 ' 00:25:32.394 05:21:33 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:32.394 05:21:33 -- nvmf/common.sh@7 -- # uname -s 00:25:32.394 05:21:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:32.394 05:21:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:32.394 05:21:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:32.394 05:21:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:32.394 05:21:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:32.394 05:21:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:32.394 05:21:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:32.394 05:21:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:32.394 05:21:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:32.394 05:21:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:32.394 05:21:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:32.394 05:21:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:32.394 05:21:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:32.394 05:21:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:32.394 05:21:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:32.394 05:21:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:32.394 05:21:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:32.394 05:21:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:32.394 05:21:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:32.394 05:21:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.394 05:21:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.394 05:21:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.394 05:21:33 -- paths/export.sh@5 -- # export PATH 00:25:32.394 05:21:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.394 05:21:33 -- nvmf/common.sh@46 -- # : 0 00:25:32.394 05:21:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:32.394 05:21:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:32.395 05:21:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:32.395 05:21:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:32.395 05:21:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:32.395 05:21:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:32.395 05:21:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:32.395 05:21:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:32.395 05:21:33 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:32.395 05:21:33 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:32.395 05:21:33 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:32.395 05:21:33 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:32.395 05:21:33 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:32.395 05:21:33 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:32.395 05:21:33 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:32.395 05:21:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:32.395 05:21:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:32.395 05:21:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:32.395 05:21:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:32.395 05:21:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:32.395 05:21:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:32.395 05:21:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:32.395 05:21:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:32.395 05:21:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:32.395 05:21:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:32.395 05:21:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:32.395 05:21:33 -- common/autotest_common.sh@10 -- # set +x 00:25:34.298 05:21:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:34.298 05:21:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:34.298 05:21:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:34.298 05:21:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:34.298 05:21:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:34.298 05:21:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:34.298 05:21:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:34.298 05:21:36 -- nvmf/common.sh@294 -- # net_devs=() 00:25:34.298 05:21:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:34.298 05:21:36 -- nvmf/common.sh@295 -- # e810=() 00:25:34.298 05:21:36 -- nvmf/common.sh@295 -- # local -ga e810 00:25:34.298 05:21:36 -- nvmf/common.sh@296 -- # x722=() 00:25:34.298 05:21:36 -- nvmf/common.sh@296 -- # local -ga x722 00:25:34.298 05:21:36 -- nvmf/common.sh@297 -- # mlx=() 00:25:34.298 05:21:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:34.298 05:21:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:34.298 05:21:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:34.298 05:21:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:34.298 05:21:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:34.298 05:21:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:34.298 05:21:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:34.298 05:21:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:34.298 05:21:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:34.298 05:21:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:34.298 05:21:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:34.298 05:21:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:34.298 05:21:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:34.298 05:21:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:34.298 05:21:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:34.298 05:21:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:34.298 05:21:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:34.298 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:34.298 05:21:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:34.298 05:21:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:34.298 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:34.298 05:21:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:34.298 05:21:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:34.298 05:21:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:34.298 05:21:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:34.298 05:21:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:34.298 05:21:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:34.298 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:34.298 05:21:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:34.298 05:21:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:34.298 05:21:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:34.298 05:21:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:34.298 05:21:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:34.298 05:21:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:34.298 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:34.298 05:21:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:34.298 05:21:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:34.298 05:21:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:34.298 05:21:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:34.298 05:21:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:34.298 05:21:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:34.298 05:21:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:34.298 05:21:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:34.298 05:21:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:34.298 05:21:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:34.298 05:21:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:34.298 05:21:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:34.298 05:21:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:34.298 05:21:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:34.298 05:21:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:34.298 05:21:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:34.298 05:21:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:34.298 05:21:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:34.557 05:21:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:34.557 05:21:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:34.557 05:21:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:34.557 05:21:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:34.557 05:21:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:34.557 05:21:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:34.557 05:21:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:34.557 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:34.557 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.308 ms 00:25:34.557 00:25:34.557 --- 10.0.0.2 ping statistics --- 00:25:34.557 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:34.557 rtt min/avg/max/mdev = 0.308/0.308/0.308/0.000 ms 00:25:34.557 05:21:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:34.557 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:34.557 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:25:34.557 00:25:34.557 --- 10.0.0.1 ping statistics --- 00:25:34.557 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:34.557 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:25:34.557 05:21:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:34.557 05:21:36 -- nvmf/common.sh@410 -- # return 0 00:25:34.557 05:21:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:34.557 05:21:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:34.557 05:21:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:34.557 05:21:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:34.557 05:21:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:34.557 05:21:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:34.557 05:21:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:34.557 05:21:36 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:34.557 05:21:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:34.557 05:21:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:34.557 05:21:36 -- common/autotest_common.sh@10 -- # set +x 00:25:34.557 05:21:36 -- nvmf/common.sh@469 -- # nvmfpid=3377040 00:25:34.557 05:21:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:34.557 05:21:36 -- nvmf/common.sh@470 -- # waitforlisten 3377040 00:25:34.557 05:21:36 -- common/autotest_common.sh@829 -- # '[' -z 3377040 ']' 00:25:34.557 05:21:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:34.557 05:21:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:34.557 05:21:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:34.557 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:34.557 05:21:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:34.557 05:21:36 -- common/autotest_common.sh@10 -- # set +x 00:25:34.838 [2024-11-26 05:21:36.337291] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:34.838 [2024-11-26 05:21:36.337393] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:34.838 EAL: No free 2048 kB hugepages reported on node 1 00:25:34.838 [2024-11-26 05:21:36.406465] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:34.838 [2024-11-26 05:21:36.497087] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:34.838 [2024-11-26 05:21:36.497263] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:34.838 [2024-11-26 05:21:36.497280] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:34.838 [2024-11-26 05:21:36.497292] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:34.838 [2024-11-26 05:21:36.497351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:34.838 [2024-11-26 05:21:36.497413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:34.838 [2024-11-26 05:21:36.497416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:35.784 05:21:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:35.784 05:21:37 -- common/autotest_common.sh@862 -- # return 0 00:25:35.784 05:21:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:35.784 05:21:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:35.784 05:21:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.784 05:21:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:35.784 05:21:37 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:35.784 05:21:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.784 05:21:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.784 [2024-11-26 05:21:37.402520] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:35.784 05:21:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.784 05:21:37 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:35.784 05:21:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.784 05:21:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.784 Malloc0 00:25:35.784 05:21:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.784 05:21:37 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:35.784 05:21:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.784 05:21:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.784 05:21:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.784 05:21:37 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:35.784 05:21:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.784 05:21:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.784 05:21:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.784 05:21:37 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:35.784 05:21:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.784 05:21:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.784 [2024-11-26 05:21:37.461784] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:35.784 05:21:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.784 05:21:37 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:35.784 05:21:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.784 05:21:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.784 [2024-11-26 05:21:37.469622] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:35.784 05:21:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.784 05:21:37 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:35.784 05:21:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.784 05:21:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.784 Malloc1 00:25:35.784 05:21:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.784 05:21:37 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:35.784 05:21:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.784 05:21:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.784 05:21:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.784 05:21:37 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:35.784 05:21:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.784 05:21:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.784 05:21:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.784 05:21:37 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:35.784 05:21:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.784 05:21:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.784 05:21:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.784 05:21:37 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:35.784 05:21:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.784 05:21:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.784 05:21:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.784 05:21:37 -- host/multicontroller.sh@44 -- # bdevperf_pid=3377204 00:25:35.784 05:21:37 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:35.784 05:21:37 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:35.784 05:21:37 -- host/multicontroller.sh@47 -- # waitforlisten 3377204 /var/tmp/bdevperf.sock 00:25:35.784 05:21:37 -- common/autotest_common.sh@829 -- # '[' -z 3377204 ']' 00:25:35.784 05:21:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:35.784 05:21:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:35.784 05:21:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:35.784 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:35.784 05:21:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:35.784 05:21:37 -- common/autotest_common.sh@10 -- # set +x 00:25:37.162 05:21:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:37.162 05:21:38 -- common/autotest_common.sh@862 -- # return 0 00:25:37.162 05:21:38 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:37.162 05:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.162 05:21:38 -- common/autotest_common.sh@10 -- # set +x 00:25:37.162 NVMe0n1 00:25:37.162 05:21:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.162 05:21:38 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:37.162 05:21:38 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:37.162 05:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.162 05:21:38 -- common/autotest_common.sh@10 -- # set +x 00:25:37.162 05:21:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.162 1 00:25:37.162 05:21:38 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:37.162 05:21:38 -- common/autotest_common.sh@650 -- # local es=0 00:25:37.162 05:21:38 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:37.162 05:21:38 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:37.162 05:21:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:37.162 05:21:38 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:37.162 05:21:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:37.162 05:21:38 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:37.162 05:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.162 05:21:38 -- common/autotest_common.sh@10 -- # set +x 00:25:37.162 request: 00:25:37.162 { 00:25:37.162 "name": "NVMe0", 00:25:37.162 "trtype": "tcp", 00:25:37.162 "traddr": "10.0.0.2", 00:25:37.162 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:37.162 "hostaddr": "10.0.0.2", 00:25:37.162 "hostsvcid": "60000", 00:25:37.162 "adrfam": "ipv4", 00:25:37.162 "trsvcid": "4420", 00:25:37.162 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:37.162 "method": "bdev_nvme_attach_controller", 00:25:37.162 "req_id": 1 00:25:37.162 } 00:25:37.162 Got JSON-RPC error response 00:25:37.162 response: 00:25:37.162 { 00:25:37.162 "code": -114, 00:25:37.162 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:37.162 } 00:25:37.162 05:21:38 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:37.162 05:21:38 -- common/autotest_common.sh@653 -- # es=1 00:25:37.162 05:21:38 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:37.162 05:21:38 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:37.162 05:21:38 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:37.162 05:21:38 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:37.162 05:21:38 -- common/autotest_common.sh@650 -- # local es=0 00:25:37.162 05:21:38 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:37.162 05:21:38 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:37.162 05:21:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:37.162 05:21:38 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:37.162 05:21:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:37.162 05:21:38 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:37.162 05:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.162 05:21:38 -- common/autotest_common.sh@10 -- # set +x 00:25:37.162 request: 00:25:37.162 { 00:25:37.162 "name": "NVMe0", 00:25:37.162 "trtype": "tcp", 00:25:37.162 "traddr": "10.0.0.2", 00:25:37.162 "hostaddr": "10.0.0.2", 00:25:37.162 "hostsvcid": "60000", 00:25:37.162 "adrfam": "ipv4", 00:25:37.162 "trsvcid": "4420", 00:25:37.162 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:37.162 "method": "bdev_nvme_attach_controller", 00:25:37.162 "req_id": 1 00:25:37.162 } 00:25:37.162 Got JSON-RPC error response 00:25:37.162 response: 00:25:37.162 { 00:25:37.162 "code": -114, 00:25:37.162 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:37.162 } 00:25:37.162 05:21:38 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:37.162 05:21:38 -- common/autotest_common.sh@653 -- # es=1 00:25:37.162 05:21:38 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:37.162 05:21:38 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:37.162 05:21:38 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:37.162 05:21:38 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:37.162 05:21:38 -- common/autotest_common.sh@650 -- # local es=0 00:25:37.162 05:21:38 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:37.162 05:21:38 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:37.162 05:21:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:37.162 05:21:38 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:37.162 05:21:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:37.162 05:21:38 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:37.162 05:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.162 05:21:38 -- common/autotest_common.sh@10 -- # set +x 00:25:37.162 request: 00:25:37.162 { 00:25:37.162 "name": "NVMe0", 00:25:37.162 "trtype": "tcp", 00:25:37.162 "traddr": "10.0.0.2", 00:25:37.162 "hostaddr": "10.0.0.2", 00:25:37.162 "hostsvcid": "60000", 00:25:37.162 "adrfam": "ipv4", 00:25:37.162 "trsvcid": "4420", 00:25:37.162 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:37.162 "multipath": "disable", 00:25:37.162 "method": "bdev_nvme_attach_controller", 00:25:37.162 "req_id": 1 00:25:37.162 } 00:25:37.162 Got JSON-RPC error response 00:25:37.162 response: 00:25:37.162 { 00:25:37.162 "code": -114, 00:25:37.162 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:37.162 } 00:25:37.162 05:21:38 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:37.162 05:21:38 -- common/autotest_common.sh@653 -- # es=1 00:25:37.162 05:21:38 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:37.163 05:21:38 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:37.163 05:21:38 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:37.163 05:21:38 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:37.163 05:21:38 -- common/autotest_common.sh@650 -- # local es=0 00:25:37.163 05:21:38 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:37.163 05:21:38 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:37.163 05:21:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:37.163 05:21:38 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:37.163 05:21:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:37.163 05:21:38 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:37.163 05:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.163 05:21:38 -- common/autotest_common.sh@10 -- # set +x 00:25:37.163 request: 00:25:37.163 { 00:25:37.163 "name": "NVMe0", 00:25:37.163 "trtype": "tcp", 00:25:37.163 "traddr": "10.0.0.2", 00:25:37.163 "hostaddr": "10.0.0.2", 00:25:37.163 "hostsvcid": "60000", 00:25:37.163 "adrfam": "ipv4", 00:25:37.163 "trsvcid": "4420", 00:25:37.163 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:37.163 "multipath": "failover", 00:25:37.163 "method": "bdev_nvme_attach_controller", 00:25:37.163 "req_id": 1 00:25:37.163 } 00:25:37.163 Got JSON-RPC error response 00:25:37.163 response: 00:25:37.163 { 00:25:37.163 "code": -114, 00:25:37.163 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:37.163 } 00:25:37.163 05:21:38 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:37.163 05:21:38 -- common/autotest_common.sh@653 -- # es=1 00:25:37.163 05:21:38 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:37.163 05:21:38 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:37.163 05:21:38 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:37.163 05:21:38 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:37.163 05:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.163 05:21:38 -- common/autotest_common.sh@10 -- # set +x 00:25:37.163 00:25:37.163 05:21:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.163 05:21:38 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:37.163 05:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.163 05:21:38 -- common/autotest_common.sh@10 -- # set +x 00:25:37.163 05:21:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.163 05:21:38 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:37.163 05:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.163 05:21:38 -- common/autotest_common.sh@10 -- # set +x 00:25:37.422 00:25:37.422 05:21:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.422 05:21:39 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:37.422 05:21:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.422 05:21:39 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:37.422 05:21:39 -- common/autotest_common.sh@10 -- # set +x 00:25:37.422 05:21:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.422 05:21:39 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:37.422 05:21:39 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:38.797 0 00:25:38.797 05:21:40 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:38.797 05:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.797 05:21:40 -- common/autotest_common.sh@10 -- # set +x 00:25:38.797 05:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.797 05:21:40 -- host/multicontroller.sh@100 -- # killprocess 3377204 00:25:38.797 05:21:40 -- common/autotest_common.sh@936 -- # '[' -z 3377204 ']' 00:25:38.797 05:21:40 -- common/autotest_common.sh@940 -- # kill -0 3377204 00:25:38.797 05:21:40 -- common/autotest_common.sh@941 -- # uname 00:25:38.797 05:21:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:38.797 05:21:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3377204 00:25:38.797 05:21:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:38.797 05:21:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:38.797 05:21:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3377204' 00:25:38.797 killing process with pid 3377204 00:25:38.797 05:21:40 -- common/autotest_common.sh@955 -- # kill 3377204 00:25:38.797 05:21:40 -- common/autotest_common.sh@960 -- # wait 3377204 00:25:38.797 05:21:40 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:38.797 05:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.797 05:21:40 -- common/autotest_common.sh@10 -- # set +x 00:25:38.797 05:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.797 05:21:40 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:38.797 05:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.797 05:21:40 -- common/autotest_common.sh@10 -- # set +x 00:25:38.797 05:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.797 05:21:40 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:38.797 05:21:40 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:38.797 05:21:40 -- common/autotest_common.sh@1607 -- # read -r file 00:25:38.797 05:21:40 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:38.797 05:21:40 -- common/autotest_common.sh@1606 -- # sort -u 00:25:38.797 05:21:40 -- common/autotest_common.sh@1608 -- # cat 00:25:38.797 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:38.797 [2024-11-26 05:21:37.566957] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:38.797 [2024-11-26 05:21:37.567063] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3377204 ] 00:25:38.797 EAL: No free 2048 kB hugepages reported on node 1 00:25:38.797 [2024-11-26 05:21:37.628008] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:38.797 [2024-11-26 05:21:37.711637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:38.797 [2024-11-26 05:21:39.052325] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name f2ea5498-8901-4cc8-b67e-6dcdf9d19949 already exists 00:25:38.797 [2024-11-26 05:21:39.052368] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:f2ea5498-8901-4cc8-b67e-6dcdf9d19949 alias for bdev NVMe1n1 00:25:38.797 [2024-11-26 05:21:39.052400] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:38.797 Running I/O for 1 seconds... 00:25:38.797 00:25:38.797 Latency(us) 00:25:38.797 [2024-11-26T04:21:40.565Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:38.797 [2024-11-26T04:21:40.565Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:38.797 NVMe0n1 : 1.01 19473.57 76.07 0.00 0.00 6563.45 3446.71 12136.30 00:25:38.797 [2024-11-26T04:21:40.565Z] =================================================================================================================== 00:25:38.797 [2024-11-26T04:21:40.565Z] Total : 19473.57 76.07 0.00 0.00 6563.45 3446.71 12136.30 00:25:38.797 Received shutdown signal, test time was about 1.000000 seconds 00:25:38.797 00:25:38.797 Latency(us) 00:25:38.797 [2024-11-26T04:21:40.565Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:38.797 [2024-11-26T04:21:40.565Z] =================================================================================================================== 00:25:38.797 [2024-11-26T04:21:40.565Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:38.797 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:38.797 05:21:40 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:38.797 05:21:40 -- common/autotest_common.sh@1607 -- # read -r file 00:25:38.797 05:21:40 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:38.797 05:21:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:38.797 05:21:40 -- nvmf/common.sh@116 -- # sync 00:25:38.797 05:21:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:38.797 05:21:40 -- nvmf/common.sh@119 -- # set +e 00:25:38.797 05:21:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:38.797 05:21:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:38.797 rmmod nvme_tcp 00:25:38.797 rmmod nvme_fabrics 00:25:38.797 rmmod nvme_keyring 00:25:39.056 05:21:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:39.056 05:21:40 -- nvmf/common.sh@123 -- # set -e 00:25:39.056 05:21:40 -- nvmf/common.sh@124 -- # return 0 00:25:39.056 05:21:40 -- nvmf/common.sh@477 -- # '[' -n 3377040 ']' 00:25:39.056 05:21:40 -- nvmf/common.sh@478 -- # killprocess 3377040 00:25:39.056 05:21:40 -- common/autotest_common.sh@936 -- # '[' -z 3377040 ']' 00:25:39.056 05:21:40 -- common/autotest_common.sh@940 -- # kill -0 3377040 00:25:39.056 05:21:40 -- common/autotest_common.sh@941 -- # uname 00:25:39.056 05:21:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:39.056 05:21:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3377040 00:25:39.056 05:21:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:39.056 05:21:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:39.056 05:21:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3377040' 00:25:39.056 killing process with pid 3377040 00:25:39.056 05:21:40 -- common/autotest_common.sh@955 -- # kill 3377040 00:25:39.056 05:21:40 -- common/autotest_common.sh@960 -- # wait 3377040 00:25:39.315 05:21:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:39.315 05:21:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:39.315 05:21:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:39.315 05:21:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:39.315 05:21:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:39.315 05:21:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:39.315 05:21:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:39.315 05:21:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:41.222 05:21:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:41.222 00:25:41.222 real 0m9.153s 00:25:41.222 user 0m17.340s 00:25:41.223 sys 0m2.517s 00:25:41.223 05:21:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:41.223 05:21:42 -- common/autotest_common.sh@10 -- # set +x 00:25:41.223 ************************************ 00:25:41.223 END TEST nvmf_multicontroller 00:25:41.223 ************************************ 00:25:41.223 05:21:42 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:41.223 05:21:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:41.223 05:21:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:41.223 05:21:42 -- common/autotest_common.sh@10 -- # set +x 00:25:41.223 ************************************ 00:25:41.223 START TEST nvmf_aer 00:25:41.223 ************************************ 00:25:41.223 05:21:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:41.481 * Looking for test storage... 00:25:41.481 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:41.481 05:21:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:41.481 05:21:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:41.481 05:21:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:41.481 05:21:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:41.481 05:21:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:41.481 05:21:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:41.481 05:21:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:41.481 05:21:43 -- scripts/common.sh@335 -- # IFS=.-: 00:25:41.481 05:21:43 -- scripts/common.sh@335 -- # read -ra ver1 00:25:41.481 05:21:43 -- scripts/common.sh@336 -- # IFS=.-: 00:25:41.481 05:21:43 -- scripts/common.sh@336 -- # read -ra ver2 00:25:41.481 05:21:43 -- scripts/common.sh@337 -- # local 'op=<' 00:25:41.481 05:21:43 -- scripts/common.sh@339 -- # ver1_l=2 00:25:41.481 05:21:43 -- scripts/common.sh@340 -- # ver2_l=1 00:25:41.481 05:21:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:41.481 05:21:43 -- scripts/common.sh@343 -- # case "$op" in 00:25:41.481 05:21:43 -- scripts/common.sh@344 -- # : 1 00:25:41.481 05:21:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:41.481 05:21:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:41.481 05:21:43 -- scripts/common.sh@364 -- # decimal 1 00:25:41.481 05:21:43 -- scripts/common.sh@352 -- # local d=1 00:25:41.481 05:21:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:41.481 05:21:43 -- scripts/common.sh@354 -- # echo 1 00:25:41.481 05:21:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:41.481 05:21:43 -- scripts/common.sh@365 -- # decimal 2 00:25:41.481 05:21:43 -- scripts/common.sh@352 -- # local d=2 00:25:41.481 05:21:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:41.481 05:21:43 -- scripts/common.sh@354 -- # echo 2 00:25:41.481 05:21:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:41.481 05:21:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:41.481 05:21:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:41.481 05:21:43 -- scripts/common.sh@367 -- # return 0 00:25:41.481 05:21:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:41.481 05:21:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:41.481 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:41.481 --rc genhtml_branch_coverage=1 00:25:41.481 --rc genhtml_function_coverage=1 00:25:41.481 --rc genhtml_legend=1 00:25:41.481 --rc geninfo_all_blocks=1 00:25:41.481 --rc geninfo_unexecuted_blocks=1 00:25:41.481 00:25:41.481 ' 00:25:41.481 05:21:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:41.481 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:41.481 --rc genhtml_branch_coverage=1 00:25:41.481 --rc genhtml_function_coverage=1 00:25:41.481 --rc genhtml_legend=1 00:25:41.481 --rc geninfo_all_blocks=1 00:25:41.481 --rc geninfo_unexecuted_blocks=1 00:25:41.481 00:25:41.481 ' 00:25:41.481 05:21:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:41.481 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:41.481 --rc genhtml_branch_coverage=1 00:25:41.481 --rc genhtml_function_coverage=1 00:25:41.481 --rc genhtml_legend=1 00:25:41.481 --rc geninfo_all_blocks=1 00:25:41.481 --rc geninfo_unexecuted_blocks=1 00:25:41.481 00:25:41.481 ' 00:25:41.481 05:21:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:41.481 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:41.481 --rc genhtml_branch_coverage=1 00:25:41.481 --rc genhtml_function_coverage=1 00:25:41.481 --rc genhtml_legend=1 00:25:41.481 --rc geninfo_all_blocks=1 00:25:41.481 --rc geninfo_unexecuted_blocks=1 00:25:41.481 00:25:41.481 ' 00:25:41.481 05:21:43 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:41.481 05:21:43 -- nvmf/common.sh@7 -- # uname -s 00:25:41.481 05:21:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:41.481 05:21:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:41.481 05:21:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:41.481 05:21:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:41.481 05:21:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:41.481 05:21:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:41.481 05:21:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:41.481 05:21:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:41.481 05:21:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:41.481 05:21:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:41.481 05:21:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:41.482 05:21:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:41.482 05:21:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:41.482 05:21:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:41.482 05:21:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:41.482 05:21:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:41.482 05:21:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:41.482 05:21:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:41.482 05:21:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:41.482 05:21:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.482 05:21:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.482 05:21:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.482 05:21:43 -- paths/export.sh@5 -- # export PATH 00:25:41.482 05:21:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.482 05:21:43 -- nvmf/common.sh@46 -- # : 0 00:25:41.482 05:21:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:41.482 05:21:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:41.482 05:21:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:41.482 05:21:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:41.482 05:21:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:41.482 05:21:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:41.482 05:21:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:41.482 05:21:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:41.482 05:21:43 -- host/aer.sh@11 -- # nvmftestinit 00:25:41.482 05:21:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:41.482 05:21:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:41.482 05:21:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:41.482 05:21:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:41.482 05:21:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:41.482 05:21:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:41.482 05:21:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:41.482 05:21:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:41.482 05:21:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:41.482 05:21:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:41.482 05:21:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:41.482 05:21:43 -- common/autotest_common.sh@10 -- # set +x 00:25:43.387 05:21:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:43.387 05:21:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:43.387 05:21:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:43.387 05:21:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:43.387 05:21:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:43.387 05:21:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:43.387 05:21:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:43.387 05:21:45 -- nvmf/common.sh@294 -- # net_devs=() 00:25:43.387 05:21:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:43.387 05:21:45 -- nvmf/common.sh@295 -- # e810=() 00:25:43.387 05:21:45 -- nvmf/common.sh@295 -- # local -ga e810 00:25:43.387 05:21:45 -- nvmf/common.sh@296 -- # x722=() 00:25:43.387 05:21:45 -- nvmf/common.sh@296 -- # local -ga x722 00:25:43.387 05:21:45 -- nvmf/common.sh@297 -- # mlx=() 00:25:43.387 05:21:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:43.387 05:21:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:43.387 05:21:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:43.387 05:21:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:43.387 05:21:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:43.387 05:21:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:43.387 05:21:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:43.387 05:21:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:43.387 05:21:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:43.387 05:21:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:43.387 05:21:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:43.387 05:21:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:43.387 05:21:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:43.387 05:21:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:43.387 05:21:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:43.387 05:21:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.387 05:21:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:43.387 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:43.387 05:21:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.387 05:21:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:43.387 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:43.387 05:21:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:43.387 05:21:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:43.387 05:21:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.387 05:21:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.387 05:21:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.387 05:21:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.387 05:21:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:43.387 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:43.387 05:21:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.387 05:21:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.387 05:21:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.387 05:21:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.387 05:21:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.387 05:21:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:43.387 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:43.388 05:21:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.388 05:21:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:43.388 05:21:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:43.388 05:21:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:43.388 05:21:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:43.388 05:21:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:43.388 05:21:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:43.388 05:21:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:43.388 05:21:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:43.388 05:21:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:43.388 05:21:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:43.388 05:21:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:43.388 05:21:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:43.388 05:21:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:43.388 05:21:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:43.388 05:21:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:43.388 05:21:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:43.388 05:21:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:43.388 05:21:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:43.646 05:21:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:43.646 05:21:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:43.646 05:21:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:43.646 05:21:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:43.646 05:21:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:43.646 05:21:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:43.646 05:21:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:43.646 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:43.646 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.263 ms 00:25:43.646 00:25:43.646 --- 10.0.0.2 ping statistics --- 00:25:43.646 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.646 rtt min/avg/max/mdev = 0.263/0.263/0.263/0.000 ms 00:25:43.646 05:21:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:43.646 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:43.646 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:25:43.646 00:25:43.646 --- 10.0.0.1 ping statistics --- 00:25:43.646 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.646 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:25:43.646 05:21:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:43.646 05:21:45 -- nvmf/common.sh@410 -- # return 0 00:25:43.646 05:21:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:43.646 05:21:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:43.646 05:21:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:43.646 05:21:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:43.646 05:21:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:43.646 05:21:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:43.646 05:21:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:43.646 05:21:45 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:43.646 05:21:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:43.646 05:21:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:43.646 05:21:45 -- common/autotest_common.sh@10 -- # set +x 00:25:43.646 05:21:45 -- nvmf/common.sh@469 -- # nvmfpid=3379571 00:25:43.646 05:21:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:43.646 05:21:45 -- nvmf/common.sh@470 -- # waitforlisten 3379571 00:25:43.646 05:21:45 -- common/autotest_common.sh@829 -- # '[' -z 3379571 ']' 00:25:43.646 05:21:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:43.646 05:21:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:43.646 05:21:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:43.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:43.646 05:21:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:43.646 05:21:45 -- common/autotest_common.sh@10 -- # set +x 00:25:43.646 [2024-11-26 05:21:45.340527] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:43.646 [2024-11-26 05:21:45.340603] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:43.646 EAL: No free 2048 kB hugepages reported on node 1 00:25:43.906 [2024-11-26 05:21:45.411054] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:43.906 [2024-11-26 05:21:45.501348] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:43.906 [2024-11-26 05:21:45.501507] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:43.906 [2024-11-26 05:21:45.501527] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:43.906 [2024-11-26 05:21:45.501541] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:43.907 [2024-11-26 05:21:45.501601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:43.907 [2024-11-26 05:21:45.501658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:43.907 [2024-11-26 05:21:45.501706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:43.907 [2024-11-26 05:21:45.501708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:44.843 05:21:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:44.843 05:21:46 -- common/autotest_common.sh@862 -- # return 0 00:25:44.843 05:21:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:44.843 05:21:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:44.843 05:21:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.843 05:21:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:44.843 05:21:46 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:44.843 05:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.843 05:21:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.843 [2024-11-26 05:21:46.341385] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:44.843 05:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.843 05:21:46 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:44.843 05:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.843 05:21:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.843 Malloc0 00:25:44.844 05:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.844 05:21:46 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:44.844 05:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.844 05:21:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.844 05:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.844 05:21:46 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:44.844 05:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.844 05:21:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.844 05:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.844 05:21:46 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:44.844 05:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.844 05:21:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.844 [2024-11-26 05:21:46.392451] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:44.844 05:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.844 05:21:46 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:44.844 05:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.844 05:21:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.844 [2024-11-26 05:21:46.400168] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:44.844 [ 00:25:44.844 { 00:25:44.844 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:44.844 "subtype": "Discovery", 00:25:44.844 "listen_addresses": [], 00:25:44.844 "allow_any_host": true, 00:25:44.844 "hosts": [] 00:25:44.844 }, 00:25:44.844 { 00:25:44.844 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:44.844 "subtype": "NVMe", 00:25:44.844 "listen_addresses": [ 00:25:44.844 { 00:25:44.844 "transport": "TCP", 00:25:44.844 "trtype": "TCP", 00:25:44.844 "adrfam": "IPv4", 00:25:44.844 "traddr": "10.0.0.2", 00:25:44.844 "trsvcid": "4420" 00:25:44.844 } 00:25:44.844 ], 00:25:44.844 "allow_any_host": true, 00:25:44.844 "hosts": [], 00:25:44.844 "serial_number": "SPDK00000000000001", 00:25:44.844 "model_number": "SPDK bdev Controller", 00:25:44.844 "max_namespaces": 2, 00:25:44.844 "min_cntlid": 1, 00:25:44.844 "max_cntlid": 65519, 00:25:44.844 "namespaces": [ 00:25:44.844 { 00:25:44.844 "nsid": 1, 00:25:44.844 "bdev_name": "Malloc0", 00:25:44.844 "name": "Malloc0", 00:25:44.844 "nguid": "1AE8A5C3551A472D99F7C894BC0C12F5", 00:25:44.844 "uuid": "1ae8a5c3-551a-472d-99f7-c894bc0c12f5" 00:25:44.844 } 00:25:44.844 ] 00:25:44.844 } 00:25:44.844 ] 00:25:44.844 05:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.844 05:21:46 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:44.844 05:21:46 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:44.844 05:21:46 -- host/aer.sh@33 -- # aerpid=3379731 00:25:44.844 05:21:46 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:44.844 05:21:46 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:44.844 05:21:46 -- common/autotest_common.sh@1254 -- # local i=0 00:25:44.844 05:21:46 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:44.844 05:21:46 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:25:44.844 05:21:46 -- common/autotest_common.sh@1257 -- # i=1 00:25:44.844 05:21:46 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:44.844 EAL: No free 2048 kB hugepages reported on node 1 00:25:44.844 05:21:46 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:44.844 05:21:46 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:25:44.844 05:21:46 -- common/autotest_common.sh@1257 -- # i=2 00:25:44.844 05:21:46 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:45.103 05:21:46 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:45.103 05:21:46 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:45.103 05:21:46 -- common/autotest_common.sh@1265 -- # return 0 00:25:45.103 05:21:46 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:45.103 05:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.103 05:21:46 -- common/autotest_common.sh@10 -- # set +x 00:25:45.103 Malloc1 00:25:45.103 05:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.103 05:21:46 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:45.103 05:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.103 05:21:46 -- common/autotest_common.sh@10 -- # set +x 00:25:45.103 05:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.103 05:21:46 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:45.103 05:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.103 05:21:46 -- common/autotest_common.sh@10 -- # set +x 00:25:45.103 Asynchronous Event Request test 00:25:45.103 Attaching to 10.0.0.2 00:25:45.103 Attached to 10.0.0.2 00:25:45.103 Registering asynchronous event callbacks... 00:25:45.103 Starting namespace attribute notice tests for all controllers... 00:25:45.103 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:45.103 aer_cb - Changed Namespace 00:25:45.103 Cleaning up... 00:25:45.103 [ 00:25:45.103 { 00:25:45.103 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:45.103 "subtype": "Discovery", 00:25:45.103 "listen_addresses": [], 00:25:45.103 "allow_any_host": true, 00:25:45.103 "hosts": [] 00:25:45.103 }, 00:25:45.103 { 00:25:45.103 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:45.103 "subtype": "NVMe", 00:25:45.103 "listen_addresses": [ 00:25:45.103 { 00:25:45.103 "transport": "TCP", 00:25:45.103 "trtype": "TCP", 00:25:45.103 "adrfam": "IPv4", 00:25:45.103 "traddr": "10.0.0.2", 00:25:45.103 "trsvcid": "4420" 00:25:45.103 } 00:25:45.103 ], 00:25:45.103 "allow_any_host": true, 00:25:45.103 "hosts": [], 00:25:45.103 "serial_number": "SPDK00000000000001", 00:25:45.103 "model_number": "SPDK bdev Controller", 00:25:45.103 "max_namespaces": 2, 00:25:45.103 "min_cntlid": 1, 00:25:45.103 "max_cntlid": 65519, 00:25:45.103 "namespaces": [ 00:25:45.103 { 00:25:45.103 "nsid": 1, 00:25:45.103 "bdev_name": "Malloc0", 00:25:45.103 "name": "Malloc0", 00:25:45.103 "nguid": "1AE8A5C3551A472D99F7C894BC0C12F5", 00:25:45.103 "uuid": "1ae8a5c3-551a-472d-99f7-c894bc0c12f5" 00:25:45.103 }, 00:25:45.103 { 00:25:45.103 "nsid": 2, 00:25:45.103 "bdev_name": "Malloc1", 00:25:45.103 "name": "Malloc1", 00:25:45.103 "nguid": "39033F7129044A71BA83DE5253575213", 00:25:45.103 "uuid": "39033f71-2904-4a71-ba83-de5253575213" 00:25:45.103 } 00:25:45.103 ] 00:25:45.103 } 00:25:45.103 ] 00:25:45.103 05:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.103 05:21:46 -- host/aer.sh@43 -- # wait 3379731 00:25:45.103 05:21:46 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:45.103 05:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.103 05:21:46 -- common/autotest_common.sh@10 -- # set +x 00:25:45.103 05:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.103 05:21:46 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:45.103 05:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.103 05:21:46 -- common/autotest_common.sh@10 -- # set +x 00:25:45.103 05:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.103 05:21:46 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:45.103 05:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.103 05:21:46 -- common/autotest_common.sh@10 -- # set +x 00:25:45.103 05:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.103 05:21:46 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:45.103 05:21:46 -- host/aer.sh@51 -- # nvmftestfini 00:25:45.103 05:21:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:45.103 05:21:46 -- nvmf/common.sh@116 -- # sync 00:25:45.103 05:21:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:45.103 05:21:46 -- nvmf/common.sh@119 -- # set +e 00:25:45.103 05:21:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:45.103 05:21:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:45.103 rmmod nvme_tcp 00:25:45.103 rmmod nvme_fabrics 00:25:45.103 rmmod nvme_keyring 00:25:45.103 05:21:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:45.103 05:21:46 -- nvmf/common.sh@123 -- # set -e 00:25:45.103 05:21:46 -- nvmf/common.sh@124 -- # return 0 00:25:45.103 05:21:46 -- nvmf/common.sh@477 -- # '[' -n 3379571 ']' 00:25:45.103 05:21:46 -- nvmf/common.sh@478 -- # killprocess 3379571 00:25:45.103 05:21:46 -- common/autotest_common.sh@936 -- # '[' -z 3379571 ']' 00:25:45.103 05:21:46 -- common/autotest_common.sh@940 -- # kill -0 3379571 00:25:45.103 05:21:46 -- common/autotest_common.sh@941 -- # uname 00:25:45.103 05:21:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:45.103 05:21:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3379571 00:25:45.103 05:21:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:45.103 05:21:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:45.103 05:21:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3379571' 00:25:45.103 killing process with pid 3379571 00:25:45.103 05:21:46 -- common/autotest_common.sh@955 -- # kill 3379571 00:25:45.103 [2024-11-26 05:21:46.828703] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:45.103 05:21:46 -- common/autotest_common.sh@960 -- # wait 3379571 00:25:45.364 05:21:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:45.364 05:21:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:45.364 05:21:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:45.364 05:21:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:45.364 05:21:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:45.364 05:21:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:45.364 05:21:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:45.364 05:21:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:47.903 05:21:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:47.903 00:25:47.903 real 0m6.135s 00:25:47.903 user 0m7.113s 00:25:47.903 sys 0m1.878s 00:25:47.903 05:21:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:47.903 05:21:49 -- common/autotest_common.sh@10 -- # set +x 00:25:47.903 ************************************ 00:25:47.903 END TEST nvmf_aer 00:25:47.903 ************************************ 00:25:47.903 05:21:49 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:47.903 05:21:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:47.903 05:21:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:47.903 05:21:49 -- common/autotest_common.sh@10 -- # set +x 00:25:47.903 ************************************ 00:25:47.903 START TEST nvmf_async_init 00:25:47.903 ************************************ 00:25:47.903 05:21:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:47.903 * Looking for test storage... 00:25:47.903 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:47.903 05:21:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:47.903 05:21:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:47.903 05:21:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:47.903 05:21:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:47.903 05:21:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:47.903 05:21:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:47.903 05:21:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:47.903 05:21:49 -- scripts/common.sh@335 -- # IFS=.-: 00:25:47.903 05:21:49 -- scripts/common.sh@335 -- # read -ra ver1 00:25:47.903 05:21:49 -- scripts/common.sh@336 -- # IFS=.-: 00:25:47.903 05:21:49 -- scripts/common.sh@336 -- # read -ra ver2 00:25:47.903 05:21:49 -- scripts/common.sh@337 -- # local 'op=<' 00:25:47.903 05:21:49 -- scripts/common.sh@339 -- # ver1_l=2 00:25:47.903 05:21:49 -- scripts/common.sh@340 -- # ver2_l=1 00:25:47.903 05:21:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:47.903 05:21:49 -- scripts/common.sh@343 -- # case "$op" in 00:25:47.903 05:21:49 -- scripts/common.sh@344 -- # : 1 00:25:47.903 05:21:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:47.903 05:21:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:47.903 05:21:49 -- scripts/common.sh@364 -- # decimal 1 00:25:47.903 05:21:49 -- scripts/common.sh@352 -- # local d=1 00:25:47.903 05:21:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:47.903 05:21:49 -- scripts/common.sh@354 -- # echo 1 00:25:47.903 05:21:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:47.903 05:21:49 -- scripts/common.sh@365 -- # decimal 2 00:25:47.903 05:21:49 -- scripts/common.sh@352 -- # local d=2 00:25:47.903 05:21:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:47.903 05:21:49 -- scripts/common.sh@354 -- # echo 2 00:25:47.903 05:21:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:47.903 05:21:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:47.903 05:21:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:47.903 05:21:49 -- scripts/common.sh@367 -- # return 0 00:25:47.903 05:21:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:47.903 05:21:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:47.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.903 --rc genhtml_branch_coverage=1 00:25:47.903 --rc genhtml_function_coverage=1 00:25:47.903 --rc genhtml_legend=1 00:25:47.903 --rc geninfo_all_blocks=1 00:25:47.903 --rc geninfo_unexecuted_blocks=1 00:25:47.903 00:25:47.903 ' 00:25:47.903 05:21:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:47.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.903 --rc genhtml_branch_coverage=1 00:25:47.903 --rc genhtml_function_coverage=1 00:25:47.903 --rc genhtml_legend=1 00:25:47.903 --rc geninfo_all_blocks=1 00:25:47.903 --rc geninfo_unexecuted_blocks=1 00:25:47.903 00:25:47.903 ' 00:25:47.903 05:21:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:47.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.903 --rc genhtml_branch_coverage=1 00:25:47.903 --rc genhtml_function_coverage=1 00:25:47.903 --rc genhtml_legend=1 00:25:47.903 --rc geninfo_all_blocks=1 00:25:47.903 --rc geninfo_unexecuted_blocks=1 00:25:47.903 00:25:47.903 ' 00:25:47.903 05:21:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:47.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.903 --rc genhtml_branch_coverage=1 00:25:47.903 --rc genhtml_function_coverage=1 00:25:47.903 --rc genhtml_legend=1 00:25:47.903 --rc geninfo_all_blocks=1 00:25:47.903 --rc geninfo_unexecuted_blocks=1 00:25:47.903 00:25:47.903 ' 00:25:47.903 05:21:49 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:47.903 05:21:49 -- nvmf/common.sh@7 -- # uname -s 00:25:47.903 05:21:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:47.903 05:21:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:47.903 05:21:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:47.903 05:21:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:47.903 05:21:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:47.903 05:21:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:47.903 05:21:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:47.903 05:21:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:47.903 05:21:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:47.903 05:21:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:47.903 05:21:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:47.903 05:21:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:47.903 05:21:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:47.903 05:21:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:47.903 05:21:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:47.903 05:21:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:47.903 05:21:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:47.903 05:21:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:47.903 05:21:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:47.903 05:21:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.903 05:21:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.903 05:21:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.903 05:21:49 -- paths/export.sh@5 -- # export PATH 00:25:47.904 05:21:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.904 05:21:49 -- nvmf/common.sh@46 -- # : 0 00:25:47.904 05:21:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:47.904 05:21:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:47.904 05:21:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:47.904 05:21:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:47.904 05:21:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:47.904 05:21:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:47.904 05:21:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:47.904 05:21:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:47.904 05:21:49 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:47.904 05:21:49 -- host/async_init.sh@14 -- # null_block_size=512 00:25:47.904 05:21:49 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:47.904 05:21:49 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:47.904 05:21:49 -- host/async_init.sh@20 -- # uuidgen 00:25:47.904 05:21:49 -- host/async_init.sh@20 -- # tr -d - 00:25:47.904 05:21:49 -- host/async_init.sh@20 -- # nguid=5aba40133a5245f48d5105d260114059 00:25:47.904 05:21:49 -- host/async_init.sh@22 -- # nvmftestinit 00:25:47.904 05:21:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:47.904 05:21:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:47.904 05:21:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:47.904 05:21:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:47.904 05:21:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:47.904 05:21:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:47.904 05:21:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:47.904 05:21:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:47.904 05:21:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:47.904 05:21:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:47.904 05:21:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:47.904 05:21:49 -- common/autotest_common.sh@10 -- # set +x 00:25:49.808 05:21:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:49.808 05:21:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:49.808 05:21:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:49.808 05:21:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:49.808 05:21:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:49.808 05:21:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:49.808 05:21:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:49.808 05:21:51 -- nvmf/common.sh@294 -- # net_devs=() 00:25:49.808 05:21:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:49.808 05:21:51 -- nvmf/common.sh@295 -- # e810=() 00:25:49.808 05:21:51 -- nvmf/common.sh@295 -- # local -ga e810 00:25:49.808 05:21:51 -- nvmf/common.sh@296 -- # x722=() 00:25:49.808 05:21:51 -- nvmf/common.sh@296 -- # local -ga x722 00:25:49.808 05:21:51 -- nvmf/common.sh@297 -- # mlx=() 00:25:49.808 05:21:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:49.808 05:21:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:49.808 05:21:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:49.808 05:21:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:49.808 05:21:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:49.808 05:21:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:49.808 05:21:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:49.808 05:21:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:49.808 05:21:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:49.808 05:21:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:49.808 05:21:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:49.808 05:21:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:49.808 05:21:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:49.808 05:21:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:49.808 05:21:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:49.808 05:21:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:49.808 05:21:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:49.808 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:49.808 05:21:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:49.808 05:21:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:49.808 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:49.808 05:21:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:49.808 05:21:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:49.808 05:21:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:49.808 05:21:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:49.808 05:21:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:49.808 05:21:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:49.808 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:49.808 05:21:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:49.808 05:21:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:49.808 05:21:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:49.808 05:21:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:49.808 05:21:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:49.808 05:21:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:49.808 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:49.808 05:21:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:49.808 05:21:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:49.808 05:21:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:49.808 05:21:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:49.808 05:21:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:49.808 05:21:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:49.808 05:21:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:49.808 05:21:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:49.808 05:21:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:49.808 05:21:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:49.808 05:21:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:49.808 05:21:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:49.808 05:21:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:49.808 05:21:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:49.808 05:21:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:49.808 05:21:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:49.808 05:21:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:49.808 05:21:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:49.808 05:21:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:49.808 05:21:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:49.808 05:21:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:49.808 05:21:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:49.808 05:21:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:49.808 05:21:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:49.808 05:21:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:50.067 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:50.067 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.226 ms 00:25:50.067 00:25:50.067 --- 10.0.0.2 ping statistics --- 00:25:50.067 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:50.067 rtt min/avg/max/mdev = 0.226/0.226/0.226/0.000 ms 00:25:50.067 05:21:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:50.067 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:50.067 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:25:50.067 00:25:50.067 --- 10.0.0.1 ping statistics --- 00:25:50.067 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:50.067 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:25:50.067 05:21:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:50.067 05:21:51 -- nvmf/common.sh@410 -- # return 0 00:25:50.067 05:21:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:50.067 05:21:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:50.067 05:21:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:50.067 05:21:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:50.067 05:21:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:50.067 05:21:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:50.067 05:21:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:50.067 05:21:51 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:50.067 05:21:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:50.067 05:21:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:50.067 05:21:51 -- common/autotest_common.sh@10 -- # set +x 00:25:50.067 05:21:51 -- nvmf/common.sh@469 -- # nvmfpid=3381691 00:25:50.067 05:21:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:50.067 05:21:51 -- nvmf/common.sh@470 -- # waitforlisten 3381691 00:25:50.067 05:21:51 -- common/autotest_common.sh@829 -- # '[' -z 3381691 ']' 00:25:50.067 05:21:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:50.067 05:21:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:50.067 05:21:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:50.067 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:50.067 05:21:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:50.067 05:21:51 -- common/autotest_common.sh@10 -- # set +x 00:25:50.067 [2024-11-26 05:21:51.651432] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:50.067 [2024-11-26 05:21:51.651502] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:50.067 EAL: No free 2048 kB hugepages reported on node 1 00:25:50.067 [2024-11-26 05:21:51.714421] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:50.067 [2024-11-26 05:21:51.799613] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:50.067 [2024-11-26 05:21:51.799796] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:50.067 [2024-11-26 05:21:51.799817] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:50.067 [2024-11-26 05:21:51.799830] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:50.067 [2024-11-26 05:21:51.799864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:51.003 05:21:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:51.003 05:21:52 -- common/autotest_common.sh@862 -- # return 0 00:25:51.003 05:21:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:51.003 05:21:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:51.003 05:21:52 -- common/autotest_common.sh@10 -- # set +x 00:25:51.003 05:21:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:51.003 05:21:52 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:25:51.003 05:21:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.003 05:21:52 -- common/autotest_common.sh@10 -- # set +x 00:25:51.003 [2024-11-26 05:21:52.645984] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:51.003 05:21:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.003 05:21:52 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:25:51.003 05:21:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.003 05:21:52 -- common/autotest_common.sh@10 -- # set +x 00:25:51.003 null0 00:25:51.003 05:21:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.003 05:21:52 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:25:51.003 05:21:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.003 05:21:52 -- common/autotest_common.sh@10 -- # set +x 00:25:51.003 05:21:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.003 05:21:52 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:25:51.003 05:21:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.003 05:21:52 -- common/autotest_common.sh@10 -- # set +x 00:25:51.003 05:21:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.003 05:21:52 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 5aba40133a5245f48d5105d260114059 00:25:51.003 05:21:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.003 05:21:52 -- common/autotest_common.sh@10 -- # set +x 00:25:51.003 05:21:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.003 05:21:52 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:51.003 05:21:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.003 05:21:52 -- common/autotest_common.sh@10 -- # set +x 00:25:51.003 [2024-11-26 05:21:52.686249] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:51.003 05:21:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.003 05:21:52 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:25:51.003 05:21:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.003 05:21:52 -- common/autotest_common.sh@10 -- # set +x 00:25:51.263 nvme0n1 00:25:51.263 05:21:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.263 05:21:52 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:51.263 05:21:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.263 05:21:52 -- common/autotest_common.sh@10 -- # set +x 00:25:51.263 [ 00:25:51.263 { 00:25:51.263 "name": "nvme0n1", 00:25:51.263 "aliases": [ 00:25:51.263 "5aba4013-3a52-45f4-8d51-05d260114059" 00:25:51.263 ], 00:25:51.263 "product_name": "NVMe disk", 00:25:51.263 "block_size": 512, 00:25:51.263 "num_blocks": 2097152, 00:25:51.263 "uuid": "5aba4013-3a52-45f4-8d51-05d260114059", 00:25:51.263 "assigned_rate_limits": { 00:25:51.263 "rw_ios_per_sec": 0, 00:25:51.263 "rw_mbytes_per_sec": 0, 00:25:51.263 "r_mbytes_per_sec": 0, 00:25:51.263 "w_mbytes_per_sec": 0 00:25:51.263 }, 00:25:51.263 "claimed": false, 00:25:51.263 "zoned": false, 00:25:51.263 "supported_io_types": { 00:25:51.263 "read": true, 00:25:51.263 "write": true, 00:25:51.263 "unmap": false, 00:25:51.263 "write_zeroes": true, 00:25:51.263 "flush": true, 00:25:51.263 "reset": true, 00:25:51.263 "compare": true, 00:25:51.263 "compare_and_write": true, 00:25:51.263 "abort": true, 00:25:51.263 "nvme_admin": true, 00:25:51.263 "nvme_io": true 00:25:51.263 }, 00:25:51.263 "driver_specific": { 00:25:51.263 "nvme": [ 00:25:51.263 { 00:25:51.263 "trid": { 00:25:51.263 "trtype": "TCP", 00:25:51.263 "adrfam": "IPv4", 00:25:51.263 "traddr": "10.0.0.2", 00:25:51.263 "trsvcid": "4420", 00:25:51.263 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:51.263 }, 00:25:51.263 "ctrlr_data": { 00:25:51.263 "cntlid": 1, 00:25:51.263 "vendor_id": "0x8086", 00:25:51.263 "model_number": "SPDK bdev Controller", 00:25:51.263 "serial_number": "00000000000000000000", 00:25:51.263 "firmware_revision": "24.01.1", 00:25:51.263 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:51.263 "oacs": { 00:25:51.263 "security": 0, 00:25:51.263 "format": 0, 00:25:51.263 "firmware": 0, 00:25:51.263 "ns_manage": 0 00:25:51.263 }, 00:25:51.263 "multi_ctrlr": true, 00:25:51.263 "ana_reporting": false 00:25:51.263 }, 00:25:51.263 "vs": { 00:25:51.263 "nvme_version": "1.3" 00:25:51.263 }, 00:25:51.263 "ns_data": { 00:25:51.263 "id": 1, 00:25:51.263 "can_share": true 00:25:51.263 } 00:25:51.263 } 00:25:51.263 ], 00:25:51.263 "mp_policy": "active_passive" 00:25:51.263 } 00:25:51.263 } 00:25:51.263 ] 00:25:51.263 05:21:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.263 05:21:52 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:25:51.263 05:21:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.263 05:21:52 -- common/autotest_common.sh@10 -- # set +x 00:25:51.263 [2024-11-26 05:21:52.934828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:51.263 [2024-11-26 05:21:52.934919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x79f3f0 (9): Bad file descriptor 00:25:51.523 [2024-11-26 05:21:53.066838] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:51.523 05:21:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.523 05:21:53 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:51.523 05:21:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.523 05:21:53 -- common/autotest_common.sh@10 -- # set +x 00:25:51.523 [ 00:25:51.523 { 00:25:51.523 "name": "nvme0n1", 00:25:51.523 "aliases": [ 00:25:51.523 "5aba4013-3a52-45f4-8d51-05d260114059" 00:25:51.523 ], 00:25:51.523 "product_name": "NVMe disk", 00:25:51.523 "block_size": 512, 00:25:51.523 "num_blocks": 2097152, 00:25:51.523 "uuid": "5aba4013-3a52-45f4-8d51-05d260114059", 00:25:51.523 "assigned_rate_limits": { 00:25:51.523 "rw_ios_per_sec": 0, 00:25:51.523 "rw_mbytes_per_sec": 0, 00:25:51.523 "r_mbytes_per_sec": 0, 00:25:51.523 "w_mbytes_per_sec": 0 00:25:51.523 }, 00:25:51.523 "claimed": false, 00:25:51.523 "zoned": false, 00:25:51.523 "supported_io_types": { 00:25:51.523 "read": true, 00:25:51.523 "write": true, 00:25:51.523 "unmap": false, 00:25:51.523 "write_zeroes": true, 00:25:51.523 "flush": true, 00:25:51.523 "reset": true, 00:25:51.523 "compare": true, 00:25:51.523 "compare_and_write": true, 00:25:51.523 "abort": true, 00:25:51.523 "nvme_admin": true, 00:25:51.523 "nvme_io": true 00:25:51.523 }, 00:25:51.523 "driver_specific": { 00:25:51.523 "nvme": [ 00:25:51.523 { 00:25:51.523 "trid": { 00:25:51.523 "trtype": "TCP", 00:25:51.523 "adrfam": "IPv4", 00:25:51.523 "traddr": "10.0.0.2", 00:25:51.523 "trsvcid": "4420", 00:25:51.523 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:51.523 }, 00:25:51.523 "ctrlr_data": { 00:25:51.523 "cntlid": 2, 00:25:51.523 "vendor_id": "0x8086", 00:25:51.523 "model_number": "SPDK bdev Controller", 00:25:51.523 "serial_number": "00000000000000000000", 00:25:51.523 "firmware_revision": "24.01.1", 00:25:51.523 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:51.523 "oacs": { 00:25:51.523 "security": 0, 00:25:51.523 "format": 0, 00:25:51.523 "firmware": 0, 00:25:51.523 "ns_manage": 0 00:25:51.523 }, 00:25:51.523 "multi_ctrlr": true, 00:25:51.523 "ana_reporting": false 00:25:51.523 }, 00:25:51.523 "vs": { 00:25:51.523 "nvme_version": "1.3" 00:25:51.523 }, 00:25:51.523 "ns_data": { 00:25:51.523 "id": 1, 00:25:51.523 "can_share": true 00:25:51.523 } 00:25:51.523 } 00:25:51.523 ], 00:25:51.523 "mp_policy": "active_passive" 00:25:51.523 } 00:25:51.523 } 00:25:51.523 ] 00:25:51.523 05:21:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.523 05:21:53 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:51.523 05:21:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.523 05:21:53 -- common/autotest_common.sh@10 -- # set +x 00:25:51.523 05:21:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.523 05:21:53 -- host/async_init.sh@53 -- # mktemp 00:25:51.523 05:21:53 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.7519hJwpnQ 00:25:51.523 05:21:53 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:25:51.523 05:21:53 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.7519hJwpnQ 00:25:51.523 05:21:53 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:25:51.523 05:21:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.523 05:21:53 -- common/autotest_common.sh@10 -- # set +x 00:25:51.523 05:21:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.523 05:21:53 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:25:51.523 05:21:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.523 05:21:53 -- common/autotest_common.sh@10 -- # set +x 00:25:51.523 [2024-11-26 05:21:53.111423] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:25:51.523 [2024-11-26 05:21:53.111555] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:51.523 05:21:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.523 05:21:53 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.7519hJwpnQ 00:25:51.523 05:21:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.523 05:21:53 -- common/autotest_common.sh@10 -- # set +x 00:25:51.523 05:21:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.523 05:21:53 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.7519hJwpnQ 00:25:51.523 05:21:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.523 05:21:53 -- common/autotest_common.sh@10 -- # set +x 00:25:51.523 [2024-11-26 05:21:53.127462] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:25:51.523 nvme0n1 00:25:51.523 05:21:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.523 05:21:53 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:51.523 05:21:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.523 05:21:53 -- common/autotest_common.sh@10 -- # set +x 00:25:51.523 [ 00:25:51.523 { 00:25:51.523 "name": "nvme0n1", 00:25:51.523 "aliases": [ 00:25:51.523 "5aba4013-3a52-45f4-8d51-05d260114059" 00:25:51.523 ], 00:25:51.523 "product_name": "NVMe disk", 00:25:51.523 "block_size": 512, 00:25:51.523 "num_blocks": 2097152, 00:25:51.523 "uuid": "5aba4013-3a52-45f4-8d51-05d260114059", 00:25:51.523 "assigned_rate_limits": { 00:25:51.523 "rw_ios_per_sec": 0, 00:25:51.523 "rw_mbytes_per_sec": 0, 00:25:51.523 "r_mbytes_per_sec": 0, 00:25:51.523 "w_mbytes_per_sec": 0 00:25:51.523 }, 00:25:51.523 "claimed": false, 00:25:51.523 "zoned": false, 00:25:51.523 "supported_io_types": { 00:25:51.523 "read": true, 00:25:51.523 "write": true, 00:25:51.523 "unmap": false, 00:25:51.523 "write_zeroes": true, 00:25:51.523 "flush": true, 00:25:51.523 "reset": true, 00:25:51.523 "compare": true, 00:25:51.523 "compare_and_write": true, 00:25:51.523 "abort": true, 00:25:51.523 "nvme_admin": true, 00:25:51.523 "nvme_io": true 00:25:51.523 }, 00:25:51.523 "driver_specific": { 00:25:51.523 "nvme": [ 00:25:51.523 { 00:25:51.523 "trid": { 00:25:51.523 "trtype": "TCP", 00:25:51.523 "adrfam": "IPv4", 00:25:51.523 "traddr": "10.0.0.2", 00:25:51.523 "trsvcid": "4421", 00:25:51.523 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:51.523 }, 00:25:51.523 "ctrlr_data": { 00:25:51.523 "cntlid": 3, 00:25:51.523 "vendor_id": "0x8086", 00:25:51.523 "model_number": "SPDK bdev Controller", 00:25:51.523 "serial_number": "00000000000000000000", 00:25:51.523 "firmware_revision": "24.01.1", 00:25:51.523 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:51.523 "oacs": { 00:25:51.523 "security": 0, 00:25:51.523 "format": 0, 00:25:51.523 "firmware": 0, 00:25:51.523 "ns_manage": 0 00:25:51.523 }, 00:25:51.523 "multi_ctrlr": true, 00:25:51.523 "ana_reporting": false 00:25:51.523 }, 00:25:51.523 "vs": { 00:25:51.523 "nvme_version": "1.3" 00:25:51.523 }, 00:25:51.523 "ns_data": { 00:25:51.523 "id": 1, 00:25:51.523 "can_share": true 00:25:51.523 } 00:25:51.523 } 00:25:51.523 ], 00:25:51.523 "mp_policy": "active_passive" 00:25:51.523 } 00:25:51.523 } 00:25:51.523 ] 00:25:51.523 05:21:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.523 05:21:53 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:51.523 05:21:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.523 05:21:53 -- common/autotest_common.sh@10 -- # set +x 00:25:51.523 05:21:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.523 05:21:53 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.7519hJwpnQ 00:25:51.523 05:21:53 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:25:51.523 05:21:53 -- host/async_init.sh@78 -- # nvmftestfini 00:25:51.523 05:21:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:51.523 05:21:53 -- nvmf/common.sh@116 -- # sync 00:25:51.524 05:21:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:51.524 05:21:53 -- nvmf/common.sh@119 -- # set +e 00:25:51.524 05:21:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:51.524 05:21:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:51.524 rmmod nvme_tcp 00:25:51.524 rmmod nvme_fabrics 00:25:51.524 rmmod nvme_keyring 00:25:51.524 05:21:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:51.524 05:21:53 -- nvmf/common.sh@123 -- # set -e 00:25:51.524 05:21:53 -- nvmf/common.sh@124 -- # return 0 00:25:51.524 05:21:53 -- nvmf/common.sh@477 -- # '[' -n 3381691 ']' 00:25:51.524 05:21:53 -- nvmf/common.sh@478 -- # killprocess 3381691 00:25:51.524 05:21:53 -- common/autotest_common.sh@936 -- # '[' -z 3381691 ']' 00:25:51.524 05:21:53 -- common/autotest_common.sh@940 -- # kill -0 3381691 00:25:51.524 05:21:53 -- common/autotest_common.sh@941 -- # uname 00:25:51.524 05:21:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:51.524 05:21:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3381691 00:25:51.782 05:21:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:51.782 05:21:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:51.782 05:21:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3381691' 00:25:51.782 killing process with pid 3381691 00:25:51.782 05:21:53 -- common/autotest_common.sh@955 -- # kill 3381691 00:25:51.782 05:21:53 -- common/autotest_common.sh@960 -- # wait 3381691 00:25:51.782 05:21:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:51.782 05:21:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:51.782 05:21:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:51.782 05:21:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:51.782 05:21:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:51.782 05:21:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:51.782 05:21:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:51.782 05:21:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:54.322 05:21:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:54.322 00:25:54.322 real 0m6.403s 00:25:54.322 user 0m3.075s 00:25:54.322 sys 0m1.973s 00:25:54.322 05:21:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:54.322 05:21:55 -- common/autotest_common.sh@10 -- # set +x 00:25:54.322 ************************************ 00:25:54.322 END TEST nvmf_async_init 00:25:54.322 ************************************ 00:25:54.322 05:21:55 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:54.322 05:21:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:54.322 05:21:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:54.322 05:21:55 -- common/autotest_common.sh@10 -- # set +x 00:25:54.322 ************************************ 00:25:54.322 START TEST dma 00:25:54.322 ************************************ 00:25:54.322 05:21:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:54.322 * Looking for test storage... 00:25:54.322 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:54.322 05:21:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:54.322 05:21:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:54.322 05:21:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:54.322 05:21:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:54.322 05:21:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:54.322 05:21:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:54.322 05:21:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:54.322 05:21:55 -- scripts/common.sh@335 -- # IFS=.-: 00:25:54.322 05:21:55 -- scripts/common.sh@335 -- # read -ra ver1 00:25:54.322 05:21:55 -- scripts/common.sh@336 -- # IFS=.-: 00:25:54.322 05:21:55 -- scripts/common.sh@336 -- # read -ra ver2 00:25:54.322 05:21:55 -- scripts/common.sh@337 -- # local 'op=<' 00:25:54.322 05:21:55 -- scripts/common.sh@339 -- # ver1_l=2 00:25:54.322 05:21:55 -- scripts/common.sh@340 -- # ver2_l=1 00:25:54.322 05:21:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:54.322 05:21:55 -- scripts/common.sh@343 -- # case "$op" in 00:25:54.322 05:21:55 -- scripts/common.sh@344 -- # : 1 00:25:54.322 05:21:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:54.322 05:21:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:54.322 05:21:55 -- scripts/common.sh@364 -- # decimal 1 00:25:54.322 05:21:55 -- scripts/common.sh@352 -- # local d=1 00:25:54.322 05:21:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:54.322 05:21:55 -- scripts/common.sh@354 -- # echo 1 00:25:54.322 05:21:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:54.322 05:21:55 -- scripts/common.sh@365 -- # decimal 2 00:25:54.322 05:21:55 -- scripts/common.sh@352 -- # local d=2 00:25:54.322 05:21:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:54.322 05:21:55 -- scripts/common.sh@354 -- # echo 2 00:25:54.322 05:21:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:54.323 05:21:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:54.323 05:21:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:54.323 05:21:55 -- scripts/common.sh@367 -- # return 0 00:25:54.323 05:21:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:54.323 05:21:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:54.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:54.323 --rc genhtml_branch_coverage=1 00:25:54.323 --rc genhtml_function_coverage=1 00:25:54.323 --rc genhtml_legend=1 00:25:54.323 --rc geninfo_all_blocks=1 00:25:54.323 --rc geninfo_unexecuted_blocks=1 00:25:54.323 00:25:54.323 ' 00:25:54.323 05:21:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:54.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:54.323 --rc genhtml_branch_coverage=1 00:25:54.323 --rc genhtml_function_coverage=1 00:25:54.323 --rc genhtml_legend=1 00:25:54.323 --rc geninfo_all_blocks=1 00:25:54.323 --rc geninfo_unexecuted_blocks=1 00:25:54.323 00:25:54.323 ' 00:25:54.323 05:21:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:54.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:54.323 --rc genhtml_branch_coverage=1 00:25:54.323 --rc genhtml_function_coverage=1 00:25:54.323 --rc genhtml_legend=1 00:25:54.323 --rc geninfo_all_blocks=1 00:25:54.323 --rc geninfo_unexecuted_blocks=1 00:25:54.323 00:25:54.323 ' 00:25:54.323 05:21:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:54.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:54.323 --rc genhtml_branch_coverage=1 00:25:54.323 --rc genhtml_function_coverage=1 00:25:54.323 --rc genhtml_legend=1 00:25:54.323 --rc geninfo_all_blocks=1 00:25:54.323 --rc geninfo_unexecuted_blocks=1 00:25:54.323 00:25:54.323 ' 00:25:54.323 05:21:55 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:54.323 05:21:55 -- nvmf/common.sh@7 -- # uname -s 00:25:54.323 05:21:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:54.323 05:21:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:54.323 05:21:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:54.323 05:21:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:54.323 05:21:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:54.323 05:21:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:54.323 05:21:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:54.323 05:21:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:54.323 05:21:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:54.323 05:21:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:54.323 05:21:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:54.323 05:21:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:54.323 05:21:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:54.323 05:21:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:54.323 05:21:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:54.323 05:21:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:54.323 05:21:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:54.323 05:21:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:54.323 05:21:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:54.323 05:21:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:54.323 05:21:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:54.323 05:21:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:54.323 05:21:55 -- paths/export.sh@5 -- # export PATH 00:25:54.323 05:21:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:54.323 05:21:55 -- nvmf/common.sh@46 -- # : 0 00:25:54.323 05:21:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:54.323 05:21:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:54.323 05:21:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:54.323 05:21:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:54.323 05:21:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:54.323 05:21:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:54.323 05:21:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:54.323 05:21:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:54.323 05:21:55 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:25:54.323 05:21:55 -- host/dma.sh@13 -- # exit 0 00:25:54.323 00:25:54.323 real 0m0.146s 00:25:54.323 user 0m0.102s 00:25:54.323 sys 0m0.054s 00:25:54.323 05:21:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:54.323 05:21:55 -- common/autotest_common.sh@10 -- # set +x 00:25:54.323 ************************************ 00:25:54.323 END TEST dma 00:25:54.323 ************************************ 00:25:54.323 05:21:55 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:54.323 05:21:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:54.323 05:21:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:54.323 05:21:55 -- common/autotest_common.sh@10 -- # set +x 00:25:54.323 ************************************ 00:25:54.323 START TEST nvmf_identify 00:25:54.323 ************************************ 00:25:54.323 05:21:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:54.323 * Looking for test storage... 00:25:54.323 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:54.323 05:21:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:54.323 05:21:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:54.323 05:21:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:54.323 05:21:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:54.323 05:21:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:54.323 05:21:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:54.323 05:21:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:54.323 05:21:55 -- scripts/common.sh@335 -- # IFS=.-: 00:25:54.323 05:21:55 -- scripts/common.sh@335 -- # read -ra ver1 00:25:54.323 05:21:55 -- scripts/common.sh@336 -- # IFS=.-: 00:25:54.323 05:21:55 -- scripts/common.sh@336 -- # read -ra ver2 00:25:54.323 05:21:55 -- scripts/common.sh@337 -- # local 'op=<' 00:25:54.323 05:21:55 -- scripts/common.sh@339 -- # ver1_l=2 00:25:54.323 05:21:55 -- scripts/common.sh@340 -- # ver2_l=1 00:25:54.323 05:21:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:54.323 05:21:55 -- scripts/common.sh@343 -- # case "$op" in 00:25:54.323 05:21:55 -- scripts/common.sh@344 -- # : 1 00:25:54.323 05:21:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:54.323 05:21:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:54.323 05:21:55 -- scripts/common.sh@364 -- # decimal 1 00:25:54.323 05:21:55 -- scripts/common.sh@352 -- # local d=1 00:25:54.323 05:21:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:54.323 05:21:55 -- scripts/common.sh@354 -- # echo 1 00:25:54.323 05:21:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:54.323 05:21:55 -- scripts/common.sh@365 -- # decimal 2 00:25:54.323 05:21:55 -- scripts/common.sh@352 -- # local d=2 00:25:54.323 05:21:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:54.323 05:21:55 -- scripts/common.sh@354 -- # echo 2 00:25:54.323 05:21:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:54.323 05:21:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:54.323 05:21:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:54.323 05:21:55 -- scripts/common.sh@367 -- # return 0 00:25:54.323 05:21:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:54.323 05:21:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:54.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:54.323 --rc genhtml_branch_coverage=1 00:25:54.323 --rc genhtml_function_coverage=1 00:25:54.323 --rc genhtml_legend=1 00:25:54.323 --rc geninfo_all_blocks=1 00:25:54.323 --rc geninfo_unexecuted_blocks=1 00:25:54.323 00:25:54.323 ' 00:25:54.323 05:21:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:54.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:54.323 --rc genhtml_branch_coverage=1 00:25:54.323 --rc genhtml_function_coverage=1 00:25:54.323 --rc genhtml_legend=1 00:25:54.323 --rc geninfo_all_blocks=1 00:25:54.323 --rc geninfo_unexecuted_blocks=1 00:25:54.323 00:25:54.323 ' 00:25:54.323 05:21:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:54.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:54.323 --rc genhtml_branch_coverage=1 00:25:54.323 --rc genhtml_function_coverage=1 00:25:54.323 --rc genhtml_legend=1 00:25:54.323 --rc geninfo_all_blocks=1 00:25:54.323 --rc geninfo_unexecuted_blocks=1 00:25:54.323 00:25:54.323 ' 00:25:54.323 05:21:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:54.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:54.323 --rc genhtml_branch_coverage=1 00:25:54.324 --rc genhtml_function_coverage=1 00:25:54.324 --rc genhtml_legend=1 00:25:54.324 --rc geninfo_all_blocks=1 00:25:54.324 --rc geninfo_unexecuted_blocks=1 00:25:54.324 00:25:54.324 ' 00:25:54.324 05:21:55 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:54.324 05:21:55 -- nvmf/common.sh@7 -- # uname -s 00:25:54.324 05:21:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:54.324 05:21:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:54.324 05:21:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:54.324 05:21:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:54.324 05:21:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:54.324 05:21:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:54.324 05:21:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:54.324 05:21:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:54.324 05:21:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:54.324 05:21:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:54.324 05:21:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:54.324 05:21:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:54.324 05:21:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:54.324 05:21:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:54.324 05:21:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:54.324 05:21:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:54.324 05:21:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:54.324 05:21:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:54.324 05:21:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:54.324 05:21:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:54.324 05:21:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:54.324 05:21:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:54.324 05:21:55 -- paths/export.sh@5 -- # export PATH 00:25:54.324 05:21:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:54.324 05:21:55 -- nvmf/common.sh@46 -- # : 0 00:25:54.324 05:21:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:54.324 05:21:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:54.324 05:21:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:54.324 05:21:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:54.324 05:21:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:54.324 05:21:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:54.324 05:21:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:54.324 05:21:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:54.324 05:21:55 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:54.324 05:21:55 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:54.324 05:21:55 -- host/identify.sh@14 -- # nvmftestinit 00:25:54.324 05:21:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:54.324 05:21:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:54.324 05:21:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:54.324 05:21:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:54.324 05:21:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:54.324 05:21:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:54.324 05:21:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:54.324 05:21:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:54.324 05:21:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:54.324 05:21:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:54.324 05:21:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:54.324 05:21:55 -- common/autotest_common.sh@10 -- # set +x 00:25:56.228 05:21:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:56.228 05:21:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:56.228 05:21:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:56.228 05:21:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:56.228 05:21:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:56.228 05:21:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:56.228 05:21:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:56.228 05:21:57 -- nvmf/common.sh@294 -- # net_devs=() 00:25:56.228 05:21:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:56.228 05:21:57 -- nvmf/common.sh@295 -- # e810=() 00:25:56.228 05:21:57 -- nvmf/common.sh@295 -- # local -ga e810 00:25:56.228 05:21:57 -- nvmf/common.sh@296 -- # x722=() 00:25:56.228 05:21:57 -- nvmf/common.sh@296 -- # local -ga x722 00:25:56.228 05:21:57 -- nvmf/common.sh@297 -- # mlx=() 00:25:56.228 05:21:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:56.228 05:21:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:56.228 05:21:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:56.228 05:21:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:56.228 05:21:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:56.228 05:21:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:56.228 05:21:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:56.228 05:21:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:56.228 05:21:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:56.228 05:21:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:56.228 05:21:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:56.228 05:21:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:56.228 05:21:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:56.228 05:21:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:56.228 05:21:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:56.228 05:21:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:56.228 05:21:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:56.228 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:56.228 05:21:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:56.228 05:21:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:56.228 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:56.228 05:21:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:56.228 05:21:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:56.228 05:21:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:56.228 05:21:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:56.228 05:21:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:56.228 05:21:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:56.228 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:56.228 05:21:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:56.228 05:21:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:56.228 05:21:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:56.228 05:21:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:56.228 05:21:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:56.228 05:21:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:56.228 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:56.228 05:21:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:56.228 05:21:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:56.228 05:21:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:56.228 05:21:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:56.228 05:21:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:56.228 05:21:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:56.228 05:21:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:56.228 05:21:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:56.228 05:21:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:56.228 05:21:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:56.228 05:21:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:56.228 05:21:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:56.228 05:21:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:56.228 05:21:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:56.228 05:21:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:56.228 05:21:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:56.228 05:21:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:56.228 05:21:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:56.228 05:21:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:56.228 05:21:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:56.228 05:21:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:56.229 05:21:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:56.229 05:21:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:56.229 05:21:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:56.229 05:21:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:56.229 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:56.229 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:25:56.229 00:25:56.229 --- 10.0.0.2 ping statistics --- 00:25:56.229 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:56.229 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:25:56.229 05:21:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:56.229 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:56.229 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:25:56.229 00:25:56.229 --- 10.0.0.1 ping statistics --- 00:25:56.229 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:56.229 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:25:56.229 05:21:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:56.229 05:21:57 -- nvmf/common.sh@410 -- # return 0 00:25:56.229 05:21:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:56.229 05:21:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:56.229 05:21:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:56.229 05:21:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:56.229 05:21:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:56.229 05:21:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:56.229 05:21:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:56.229 05:21:57 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:25:56.229 05:21:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:56.229 05:21:57 -- common/autotest_common.sh@10 -- # set +x 00:25:56.229 05:21:57 -- host/identify.sh@19 -- # nvmfpid=3383966 00:25:56.229 05:21:57 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:56.229 05:21:57 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:56.229 05:21:57 -- host/identify.sh@23 -- # waitforlisten 3383966 00:25:56.229 05:21:57 -- common/autotest_common.sh@829 -- # '[' -z 3383966 ']' 00:25:56.229 05:21:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:56.229 05:21:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:56.229 05:21:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:56.229 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:56.229 05:21:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:56.229 05:21:57 -- common/autotest_common.sh@10 -- # set +x 00:25:56.489 [2024-11-26 05:21:58.022739] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:56.489 [2024-11-26 05:21:58.022813] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:56.489 EAL: No free 2048 kB hugepages reported on node 1 00:25:56.489 [2024-11-26 05:21:58.092769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:56.489 [2024-11-26 05:21:58.183225] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:56.489 [2024-11-26 05:21:58.183391] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:56.489 [2024-11-26 05:21:58.183410] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:56.489 [2024-11-26 05:21:58.183425] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:56.489 [2024-11-26 05:21:58.183512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:56.489 [2024-11-26 05:21:58.183576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:56.489 [2024-11-26 05:21:58.183644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:56.489 [2024-11-26 05:21:58.183647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:57.429 05:21:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:57.429 05:21:58 -- common/autotest_common.sh@862 -- # return 0 00:25:57.429 05:21:58 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:57.429 05:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:57.429 05:21:58 -- common/autotest_common.sh@10 -- # set +x 00:25:57.429 [2024-11-26 05:21:58.978196] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:57.429 05:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:57.429 05:21:58 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:25:57.429 05:21:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:57.429 05:21:58 -- common/autotest_common.sh@10 -- # set +x 00:25:57.429 05:21:59 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:57.429 05:21:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:57.429 05:21:59 -- common/autotest_common.sh@10 -- # set +x 00:25:57.429 Malloc0 00:25:57.429 05:21:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:57.429 05:21:59 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:57.429 05:21:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:57.429 05:21:59 -- common/autotest_common.sh@10 -- # set +x 00:25:57.429 05:21:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:57.429 05:21:59 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:25:57.429 05:21:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:57.429 05:21:59 -- common/autotest_common.sh@10 -- # set +x 00:25:57.429 05:21:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:57.429 05:21:59 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:57.429 05:21:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:57.429 05:21:59 -- common/autotest_common.sh@10 -- # set +x 00:25:57.429 [2024-11-26 05:21:59.049310] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:57.429 05:21:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:57.429 05:21:59 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:57.429 05:21:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:57.429 05:21:59 -- common/autotest_common.sh@10 -- # set +x 00:25:57.429 05:21:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:57.429 05:21:59 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:25:57.429 05:21:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:57.429 05:21:59 -- common/autotest_common.sh@10 -- # set +x 00:25:57.429 [2024-11-26 05:21:59.065087] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:57.429 [ 00:25:57.429 { 00:25:57.429 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:57.429 "subtype": "Discovery", 00:25:57.429 "listen_addresses": [ 00:25:57.429 { 00:25:57.429 "transport": "TCP", 00:25:57.429 "trtype": "TCP", 00:25:57.429 "adrfam": "IPv4", 00:25:57.429 "traddr": "10.0.0.2", 00:25:57.429 "trsvcid": "4420" 00:25:57.429 } 00:25:57.429 ], 00:25:57.429 "allow_any_host": true, 00:25:57.429 "hosts": [] 00:25:57.429 }, 00:25:57.429 { 00:25:57.429 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:57.429 "subtype": "NVMe", 00:25:57.430 "listen_addresses": [ 00:25:57.430 { 00:25:57.430 "transport": "TCP", 00:25:57.430 "trtype": "TCP", 00:25:57.430 "adrfam": "IPv4", 00:25:57.430 "traddr": "10.0.0.2", 00:25:57.430 "trsvcid": "4420" 00:25:57.430 } 00:25:57.430 ], 00:25:57.430 "allow_any_host": true, 00:25:57.430 "hosts": [], 00:25:57.430 "serial_number": "SPDK00000000000001", 00:25:57.430 "model_number": "SPDK bdev Controller", 00:25:57.430 "max_namespaces": 32, 00:25:57.430 "min_cntlid": 1, 00:25:57.430 "max_cntlid": 65519, 00:25:57.430 "namespaces": [ 00:25:57.430 { 00:25:57.430 "nsid": 1, 00:25:57.430 "bdev_name": "Malloc0", 00:25:57.430 "name": "Malloc0", 00:25:57.430 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:25:57.430 "eui64": "ABCDEF0123456789", 00:25:57.430 "uuid": "97a1e46b-dd0f-496e-9d5a-7f07d5609a71" 00:25:57.430 } 00:25:57.430 ] 00:25:57.430 } 00:25:57.430 ] 00:25:57.430 05:21:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:57.430 05:21:59 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:25:57.430 [2024-11-26 05:21:59.085949] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:57.430 [2024-11-26 05:21:59.085995] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3384124 ] 00:25:57.430 EAL: No free 2048 kB hugepages reported on node 1 00:25:57.430 [2024-11-26 05:21:59.117914] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:25:57.430 [2024-11-26 05:21:59.117974] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:57.430 [2024-11-26 05:21:59.117984] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:57.430 [2024-11-26 05:21:59.118014] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:57.430 [2024-11-26 05:21:59.118027] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:57.430 [2024-11-26 05:21:59.121731] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:25:57.430 [2024-11-26 05:21:59.121810] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1784420 0 00:25:57.430 [2024-11-26 05:21:59.129718] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:57.430 [2024-11-26 05:21:59.129739] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:57.430 [2024-11-26 05:21:59.129748] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:57.430 [2024-11-26 05:21:59.129754] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:57.430 [2024-11-26 05:21:59.129819] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.129833] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.129840] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1784420) 00:25:57.430 [2024-11-26 05:21:59.129859] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:57.430 [2024-11-26 05:21:59.129886] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9b00, cid 0, qid 0 00:25:57.430 [2024-11-26 05:21:59.137719] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.430 [2024-11-26 05:21:59.137736] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.430 [2024-11-26 05:21:59.137744] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.137751] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9b00) on tqpair=0x1784420 00:25:57.430 [2024-11-26 05:21:59.137771] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:57.430 [2024-11-26 05:21:59.137803] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:25:57.430 [2024-11-26 05:21:59.137814] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:25:57.430 [2024-11-26 05:21:59.137832] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.137841] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.137848] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1784420) 00:25:57.430 [2024-11-26 05:21:59.137859] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.430 [2024-11-26 05:21:59.137883] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9b00, cid 0, qid 0 00:25:57.430 [2024-11-26 05:21:59.137999] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.430 [2024-11-26 05:21:59.138011] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.430 [2024-11-26 05:21:59.138018] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138025] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9b00) on tqpair=0x1784420 00:25:57.430 [2024-11-26 05:21:59.138036] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:25:57.430 [2024-11-26 05:21:59.138049] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:25:57.430 [2024-11-26 05:21:59.138062] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138069] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138075] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1784420) 00:25:57.430 [2024-11-26 05:21:59.138086] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.430 [2024-11-26 05:21:59.138107] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9b00, cid 0, qid 0 00:25:57.430 [2024-11-26 05:21:59.138195] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.430 [2024-11-26 05:21:59.138207] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.430 [2024-11-26 05:21:59.138214] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138221] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9b00) on tqpair=0x1784420 00:25:57.430 [2024-11-26 05:21:59.138231] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:25:57.430 [2024-11-26 05:21:59.138245] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:25:57.430 [2024-11-26 05:21:59.138257] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138265] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138271] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1784420) 00:25:57.430 [2024-11-26 05:21:59.138281] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.430 [2024-11-26 05:21:59.138302] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9b00, cid 0, qid 0 00:25:57.430 [2024-11-26 05:21:59.138396] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.430 [2024-11-26 05:21:59.138411] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.430 [2024-11-26 05:21:59.138418] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138424] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9b00) on tqpair=0x1784420 00:25:57.430 [2024-11-26 05:21:59.138434] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:57.430 [2024-11-26 05:21:59.138457] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138467] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138473] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1784420) 00:25:57.430 [2024-11-26 05:21:59.138483] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.430 [2024-11-26 05:21:59.138504] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9b00, cid 0, qid 0 00:25:57.430 [2024-11-26 05:21:59.138595] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.430 [2024-11-26 05:21:59.138610] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.430 [2024-11-26 05:21:59.138617] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138623] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9b00) on tqpair=0x1784420 00:25:57.430 [2024-11-26 05:21:59.138633] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:25:57.430 [2024-11-26 05:21:59.138642] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:25:57.430 [2024-11-26 05:21:59.138655] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:57.430 [2024-11-26 05:21:59.138765] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:25:57.430 [2024-11-26 05:21:59.138776] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:57.430 [2024-11-26 05:21:59.138791] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138799] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138805] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1784420) 00:25:57.430 [2024-11-26 05:21:59.138815] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.430 [2024-11-26 05:21:59.138837] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9b00, cid 0, qid 0 00:25:57.430 [2024-11-26 05:21:59.138933] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.430 [2024-11-26 05:21:59.138948] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.430 [2024-11-26 05:21:59.138955] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138961] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9b00) on tqpair=0x1784420 00:25:57.430 [2024-11-26 05:21:59.138971] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:57.430 [2024-11-26 05:21:59.138988] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.138997] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.430 [2024-11-26 05:21:59.139003] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1784420) 00:25:57.431 [2024-11-26 05:21:59.139014] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.431 [2024-11-26 05:21:59.139035] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9b00, cid 0, qid 0 00:25:57.431 [2024-11-26 05:21:59.139123] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.431 [2024-11-26 05:21:59.139137] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.431 [2024-11-26 05:21:59.139144] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.139151] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9b00) on tqpair=0x1784420 00:25:57.431 [2024-11-26 05:21:59.139165] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:57.431 [2024-11-26 05:21:59.139174] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:25:57.431 [2024-11-26 05:21:59.139188] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:25:57.431 [2024-11-26 05:21:59.139203] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:25:57.431 [2024-11-26 05:21:59.139218] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.139226] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.139232] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1784420) 00:25:57.431 [2024-11-26 05:21:59.139243] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.431 [2024-11-26 05:21:59.139265] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9b00, cid 0, qid 0 00:25:57.431 [2024-11-26 05:21:59.139393] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:57.431 [2024-11-26 05:21:59.139405] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:57.431 [2024-11-26 05:21:59.139412] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.139419] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1784420): datao=0, datal=4096, cccid=0 00:25:57.431 [2024-11-26 05:21:59.139426] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x17e9b00) on tqpair(0x1784420): expected_datao=0, payload_size=4096 00:25:57.431 [2024-11-26 05:21:59.139446] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.139456] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.179761] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.431 [2024-11-26 05:21:59.179780] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.431 [2024-11-26 05:21:59.179788] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.179795] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9b00) on tqpair=0x1784420 00:25:57.431 [2024-11-26 05:21:59.179809] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:25:57.431 [2024-11-26 05:21:59.179818] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:25:57.431 [2024-11-26 05:21:59.179826] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:25:57.431 [2024-11-26 05:21:59.179834] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:25:57.431 [2024-11-26 05:21:59.179842] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:25:57.431 [2024-11-26 05:21:59.179850] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:25:57.431 [2024-11-26 05:21:59.179870] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:25:57.431 [2024-11-26 05:21:59.179885] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.179893] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.179899] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1784420) 00:25:57.431 [2024-11-26 05:21:59.179911] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:57.431 [2024-11-26 05:21:59.179939] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9b00, cid 0, qid 0 00:25:57.431 [2024-11-26 05:21:59.180043] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.431 [2024-11-26 05:21:59.180058] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.431 [2024-11-26 05:21:59.180065] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180071] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9b00) on tqpair=0x1784420 00:25:57.431 [2024-11-26 05:21:59.180086] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180094] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180100] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1784420) 00:25:57.431 [2024-11-26 05:21:59.180110] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.431 [2024-11-26 05:21:59.180120] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180127] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180133] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1784420) 00:25:57.431 [2024-11-26 05:21:59.180142] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.431 [2024-11-26 05:21:59.180151] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180158] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180164] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1784420) 00:25:57.431 [2024-11-26 05:21:59.180173] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.431 [2024-11-26 05:21:59.180182] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180189] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180195] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.431 [2024-11-26 05:21:59.180203] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.431 [2024-11-26 05:21:59.180212] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:25:57.431 [2024-11-26 05:21:59.180231] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:57.431 [2024-11-26 05:21:59.180244] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180252] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180258] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1784420) 00:25:57.431 [2024-11-26 05:21:59.180268] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.431 [2024-11-26 05:21:59.180291] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9b00, cid 0, qid 0 00:25:57.431 [2024-11-26 05:21:59.180302] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9c60, cid 1, qid 0 00:25:57.431 [2024-11-26 05:21:59.180310] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9dc0, cid 2, qid 0 00:25:57.431 [2024-11-26 05:21:59.180317] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.431 [2024-11-26 05:21:59.180325] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17ea080, cid 4, qid 0 00:25:57.431 [2024-11-26 05:21:59.180451] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.431 [2024-11-26 05:21:59.180466] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.431 [2024-11-26 05:21:59.180476] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180484] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17ea080) on tqpair=0x1784420 00:25:57.431 [2024-11-26 05:21:59.180494] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:25:57.431 [2024-11-26 05:21:59.180503] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:25:57.431 [2024-11-26 05:21:59.180521] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180530] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180536] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1784420) 00:25:57.431 [2024-11-26 05:21:59.180546] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.431 [2024-11-26 05:21:59.180567] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17ea080, cid 4, qid 0 00:25:57.431 [2024-11-26 05:21:59.180692] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:57.431 [2024-11-26 05:21:59.180708] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:57.431 [2024-11-26 05:21:59.180715] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180722] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1784420): datao=0, datal=4096, cccid=4 00:25:57.431 [2024-11-26 05:21:59.180729] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x17ea080) on tqpair(0x1784420): expected_datao=0, payload_size=4096 00:25:57.431 [2024-11-26 05:21:59.180740] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180748] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180760] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.431 [2024-11-26 05:21:59.180770] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.431 [2024-11-26 05:21:59.180776] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180783] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17ea080) on tqpair=0x1784420 00:25:57.431 [2024-11-26 05:21:59.180803] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:25:57.431 [2024-11-26 05:21:59.180842] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180853] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180859] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1784420) 00:25:57.431 [2024-11-26 05:21:59.180870] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.431 [2024-11-26 05:21:59.180882] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180889] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.431 [2024-11-26 05:21:59.180896] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1784420) 00:25:57.432 [2024-11-26 05:21:59.180905] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.432 [2024-11-26 05:21:59.180931] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17ea080, cid 4, qid 0 00:25:57.432 [2024-11-26 05:21:59.180943] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17ea1e0, cid 5, qid 0 00:25:57.432 [2024-11-26 05:21:59.181077] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:57.432 [2024-11-26 05:21:59.181089] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:57.432 [2024-11-26 05:21:59.181096] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:57.432 [2024-11-26 05:21:59.181102] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1784420): datao=0, datal=1024, cccid=4 00:25:57.432 [2024-11-26 05:21:59.181114] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x17ea080) on tqpair(0x1784420): expected_datao=0, payload_size=1024 00:25:57.432 [2024-11-26 05:21:59.181125] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:57.432 [2024-11-26 05:21:59.181133] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:57.432 [2024-11-26 05:21:59.181141] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.432 [2024-11-26 05:21:59.181150] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.432 [2024-11-26 05:21:59.181157] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.432 [2024-11-26 05:21:59.181164] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17ea1e0) on tqpair=0x1784420 00:25:57.693 [2024-11-26 05:21:59.224698] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.693 [2024-11-26 05:21:59.224719] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.693 [2024-11-26 05:21:59.224727] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.693 [2024-11-26 05:21:59.224734] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17ea080) on tqpair=0x1784420 00:25:57.693 [2024-11-26 05:21:59.224754] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.693 [2024-11-26 05:21:59.224764] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.693 [2024-11-26 05:21:59.224770] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1784420) 00:25:57.693 [2024-11-26 05:21:59.224781] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.693 [2024-11-26 05:21:59.224827] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17ea080, cid 4, qid 0 00:25:57.693 [2024-11-26 05:21:59.225029] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:57.693 [2024-11-26 05:21:59.225045] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:57.693 [2024-11-26 05:21:59.225052] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:57.693 [2024-11-26 05:21:59.225059] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1784420): datao=0, datal=3072, cccid=4 00:25:57.693 [2024-11-26 05:21:59.225067] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x17ea080) on tqpair(0x1784420): expected_datao=0, payload_size=3072 00:25:57.693 [2024-11-26 05:21:59.225078] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:57.693 [2024-11-26 05:21:59.225085] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:57.693 [2024-11-26 05:21:59.225098] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.693 [2024-11-26 05:21:59.225108] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.693 [2024-11-26 05:21:59.225115] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.693 [2024-11-26 05:21:59.225121] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17ea080) on tqpair=0x1784420 00:25:57.693 [2024-11-26 05:21:59.225138] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.693 [2024-11-26 05:21:59.225146] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.693 [2024-11-26 05:21:59.225153] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1784420) 00:25:57.693 [2024-11-26 05:21:59.225164] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.693 [2024-11-26 05:21:59.225192] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17ea080, cid 4, qid 0 00:25:57.693 [2024-11-26 05:21:59.225301] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:57.693 [2024-11-26 05:21:59.225316] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:57.693 [2024-11-26 05:21:59.225323] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:57.693 [2024-11-26 05:21:59.225330] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1784420): datao=0, datal=8, cccid=4 00:25:57.693 [2024-11-26 05:21:59.225343] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x17ea080) on tqpair(0x1784420): expected_datao=0, payload_size=8 00:25:57.693 [2024-11-26 05:21:59.225354] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:57.693 [2024-11-26 05:21:59.225362] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:57.693 [2024-11-26 05:21:59.265762] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.693 [2024-11-26 05:21:59.265780] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.693 [2024-11-26 05:21:59.265787] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.693 [2024-11-26 05:21:59.265794] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17ea080) on tqpair=0x1784420 00:25:57.693 ===================================================== 00:25:57.693 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:25:57.693 ===================================================== 00:25:57.693 Controller Capabilities/Features 00:25:57.693 ================================ 00:25:57.693 Vendor ID: 0000 00:25:57.693 Subsystem Vendor ID: 0000 00:25:57.693 Serial Number: .................... 00:25:57.693 Model Number: ........................................ 00:25:57.693 Firmware Version: 24.01.1 00:25:57.693 Recommended Arb Burst: 0 00:25:57.693 IEEE OUI Identifier: 00 00 00 00:25:57.693 Multi-path I/O 00:25:57.693 May have multiple subsystem ports: No 00:25:57.693 May have multiple controllers: No 00:25:57.693 Associated with SR-IOV VF: No 00:25:57.693 Max Data Transfer Size: 131072 00:25:57.693 Max Number of Namespaces: 0 00:25:57.693 Max Number of I/O Queues: 1024 00:25:57.693 NVMe Specification Version (VS): 1.3 00:25:57.693 NVMe Specification Version (Identify): 1.3 00:25:57.693 Maximum Queue Entries: 128 00:25:57.693 Contiguous Queues Required: Yes 00:25:57.693 Arbitration Mechanisms Supported 00:25:57.693 Weighted Round Robin: Not Supported 00:25:57.693 Vendor Specific: Not Supported 00:25:57.693 Reset Timeout: 15000 ms 00:25:57.693 Doorbell Stride: 4 bytes 00:25:57.693 NVM Subsystem Reset: Not Supported 00:25:57.693 Command Sets Supported 00:25:57.693 NVM Command Set: Supported 00:25:57.693 Boot Partition: Not Supported 00:25:57.693 Memory Page Size Minimum: 4096 bytes 00:25:57.693 Memory Page Size Maximum: 4096 bytes 00:25:57.693 Persistent Memory Region: Not Supported 00:25:57.693 Optional Asynchronous Events Supported 00:25:57.693 Namespace Attribute Notices: Not Supported 00:25:57.693 Firmware Activation Notices: Not Supported 00:25:57.693 ANA Change Notices: Not Supported 00:25:57.693 PLE Aggregate Log Change Notices: Not Supported 00:25:57.693 LBA Status Info Alert Notices: Not Supported 00:25:57.693 EGE Aggregate Log Change Notices: Not Supported 00:25:57.693 Normal NVM Subsystem Shutdown event: Not Supported 00:25:57.693 Zone Descriptor Change Notices: Not Supported 00:25:57.694 Discovery Log Change Notices: Supported 00:25:57.694 Controller Attributes 00:25:57.694 128-bit Host Identifier: Not Supported 00:25:57.694 Non-Operational Permissive Mode: Not Supported 00:25:57.694 NVM Sets: Not Supported 00:25:57.694 Read Recovery Levels: Not Supported 00:25:57.694 Endurance Groups: Not Supported 00:25:57.694 Predictable Latency Mode: Not Supported 00:25:57.694 Traffic Based Keep ALive: Not Supported 00:25:57.694 Namespace Granularity: Not Supported 00:25:57.694 SQ Associations: Not Supported 00:25:57.694 UUID List: Not Supported 00:25:57.694 Multi-Domain Subsystem: Not Supported 00:25:57.694 Fixed Capacity Management: Not Supported 00:25:57.694 Variable Capacity Management: Not Supported 00:25:57.694 Delete Endurance Group: Not Supported 00:25:57.694 Delete NVM Set: Not Supported 00:25:57.694 Extended LBA Formats Supported: Not Supported 00:25:57.694 Flexible Data Placement Supported: Not Supported 00:25:57.694 00:25:57.694 Controller Memory Buffer Support 00:25:57.694 ================================ 00:25:57.694 Supported: No 00:25:57.694 00:25:57.694 Persistent Memory Region Support 00:25:57.694 ================================ 00:25:57.694 Supported: No 00:25:57.694 00:25:57.694 Admin Command Set Attributes 00:25:57.694 ============================ 00:25:57.694 Security Send/Receive: Not Supported 00:25:57.694 Format NVM: Not Supported 00:25:57.694 Firmware Activate/Download: Not Supported 00:25:57.694 Namespace Management: Not Supported 00:25:57.694 Device Self-Test: Not Supported 00:25:57.694 Directives: Not Supported 00:25:57.694 NVMe-MI: Not Supported 00:25:57.694 Virtualization Management: Not Supported 00:25:57.694 Doorbell Buffer Config: Not Supported 00:25:57.694 Get LBA Status Capability: Not Supported 00:25:57.694 Command & Feature Lockdown Capability: Not Supported 00:25:57.694 Abort Command Limit: 1 00:25:57.694 Async Event Request Limit: 4 00:25:57.694 Number of Firmware Slots: N/A 00:25:57.694 Firmware Slot 1 Read-Only: N/A 00:25:57.694 Firmware Activation Without Reset: N/A 00:25:57.694 Multiple Update Detection Support: N/A 00:25:57.694 Firmware Update Granularity: No Information Provided 00:25:57.694 Per-Namespace SMART Log: No 00:25:57.694 Asymmetric Namespace Access Log Page: Not Supported 00:25:57.694 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:25:57.694 Command Effects Log Page: Not Supported 00:25:57.694 Get Log Page Extended Data: Supported 00:25:57.694 Telemetry Log Pages: Not Supported 00:25:57.694 Persistent Event Log Pages: Not Supported 00:25:57.694 Supported Log Pages Log Page: May Support 00:25:57.694 Commands Supported & Effects Log Page: Not Supported 00:25:57.694 Feature Identifiers & Effects Log Page:May Support 00:25:57.694 NVMe-MI Commands & Effects Log Page: May Support 00:25:57.694 Data Area 4 for Telemetry Log: Not Supported 00:25:57.694 Error Log Page Entries Supported: 128 00:25:57.694 Keep Alive: Not Supported 00:25:57.694 00:25:57.694 NVM Command Set Attributes 00:25:57.694 ========================== 00:25:57.694 Submission Queue Entry Size 00:25:57.694 Max: 1 00:25:57.694 Min: 1 00:25:57.694 Completion Queue Entry Size 00:25:57.694 Max: 1 00:25:57.694 Min: 1 00:25:57.694 Number of Namespaces: 0 00:25:57.694 Compare Command: Not Supported 00:25:57.694 Write Uncorrectable Command: Not Supported 00:25:57.694 Dataset Management Command: Not Supported 00:25:57.694 Write Zeroes Command: Not Supported 00:25:57.694 Set Features Save Field: Not Supported 00:25:57.694 Reservations: Not Supported 00:25:57.694 Timestamp: Not Supported 00:25:57.694 Copy: Not Supported 00:25:57.694 Volatile Write Cache: Not Present 00:25:57.694 Atomic Write Unit (Normal): 1 00:25:57.694 Atomic Write Unit (PFail): 1 00:25:57.694 Atomic Compare & Write Unit: 1 00:25:57.694 Fused Compare & Write: Supported 00:25:57.694 Scatter-Gather List 00:25:57.694 SGL Command Set: Supported 00:25:57.694 SGL Keyed: Supported 00:25:57.694 SGL Bit Bucket Descriptor: Not Supported 00:25:57.694 SGL Metadata Pointer: Not Supported 00:25:57.694 Oversized SGL: Not Supported 00:25:57.694 SGL Metadata Address: Not Supported 00:25:57.694 SGL Offset: Supported 00:25:57.694 Transport SGL Data Block: Not Supported 00:25:57.694 Replay Protected Memory Block: Not Supported 00:25:57.694 00:25:57.694 Firmware Slot Information 00:25:57.694 ========================= 00:25:57.694 Active slot: 0 00:25:57.694 00:25:57.694 00:25:57.694 Error Log 00:25:57.694 ========= 00:25:57.694 00:25:57.694 Active Namespaces 00:25:57.694 ================= 00:25:57.694 Discovery Log Page 00:25:57.694 ================== 00:25:57.694 Generation Counter: 2 00:25:57.694 Number of Records: 2 00:25:57.694 Record Format: 0 00:25:57.694 00:25:57.694 Discovery Log Entry 0 00:25:57.694 ---------------------- 00:25:57.694 Transport Type: 3 (TCP) 00:25:57.694 Address Family: 1 (IPv4) 00:25:57.694 Subsystem Type: 3 (Current Discovery Subsystem) 00:25:57.694 Entry Flags: 00:25:57.694 Duplicate Returned Information: 1 00:25:57.694 Explicit Persistent Connection Support for Discovery: 1 00:25:57.694 Transport Requirements: 00:25:57.694 Secure Channel: Not Required 00:25:57.694 Port ID: 0 (0x0000) 00:25:57.694 Controller ID: 65535 (0xffff) 00:25:57.694 Admin Max SQ Size: 128 00:25:57.694 Transport Service Identifier: 4420 00:25:57.694 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:25:57.694 Transport Address: 10.0.0.2 00:25:57.694 Discovery Log Entry 1 00:25:57.694 ---------------------- 00:25:57.694 Transport Type: 3 (TCP) 00:25:57.694 Address Family: 1 (IPv4) 00:25:57.694 Subsystem Type: 2 (NVM Subsystem) 00:25:57.694 Entry Flags: 00:25:57.694 Duplicate Returned Information: 0 00:25:57.694 Explicit Persistent Connection Support for Discovery: 0 00:25:57.694 Transport Requirements: 00:25:57.694 Secure Channel: Not Required 00:25:57.694 Port ID: 0 (0x0000) 00:25:57.694 Controller ID: 65535 (0xffff) 00:25:57.694 Admin Max SQ Size: 128 00:25:57.694 Transport Service Identifier: 4420 00:25:57.694 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:25:57.694 Transport Address: 10.0.0.2 [2024-11-26 05:21:59.265924] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:25:57.694 [2024-11-26 05:21:59.265952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.694 [2024-11-26 05:21:59.265964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.694 [2024-11-26 05:21:59.265974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.694 [2024-11-26 05:21:59.265983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.694 [2024-11-26 05:21:59.265997] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.694 [2024-11-26 05:21:59.266005] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.694 [2024-11-26 05:21:59.266011] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.694 [2024-11-26 05:21:59.266022] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.694 [2024-11-26 05:21:59.266047] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.694 [2024-11-26 05:21:59.266150] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.694 [2024-11-26 05:21:59.266165] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.694 [2024-11-26 05:21:59.266172] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.694 [2024-11-26 05:21:59.266179] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.694 [2024-11-26 05:21:59.266192] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.694 [2024-11-26 05:21:59.266200] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.694 [2024-11-26 05:21:59.266206] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.694 [2024-11-26 05:21:59.266217] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.694 [2024-11-26 05:21:59.266243] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.694 [2024-11-26 05:21:59.266376] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.694 [2024-11-26 05:21:59.266390] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.694 [2024-11-26 05:21:59.266397] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.694 [2024-11-26 05:21:59.266404] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.694 [2024-11-26 05:21:59.266413] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:25:57.694 [2024-11-26 05:21:59.266422] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:25:57.694 [2024-11-26 05:21:59.266438] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.694 [2024-11-26 05:21:59.266447] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.694 [2024-11-26 05:21:59.266454] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.694 [2024-11-26 05:21:59.266468] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.694 [2024-11-26 05:21:59.266490] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.694 [2024-11-26 05:21:59.266586] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.266600] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.266607] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.266614] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.695 [2024-11-26 05:21:59.266633] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.266642] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.266649] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.695 [2024-11-26 05:21:59.266659] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.695 [2024-11-26 05:21:59.266679] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.695 [2024-11-26 05:21:59.266785] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.266798] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.266806] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.266812] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.695 [2024-11-26 05:21:59.266830] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.266839] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.266846] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.695 [2024-11-26 05:21:59.266856] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.695 [2024-11-26 05:21:59.266876] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.695 [2024-11-26 05:21:59.266967] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.266979] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.266986] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.266993] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.695 [2024-11-26 05:21:59.267010] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267019] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267025] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.695 [2024-11-26 05:21:59.267036] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.695 [2024-11-26 05:21:59.267056] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.695 [2024-11-26 05:21:59.267145] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.267160] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.267167] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267173] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.695 [2024-11-26 05:21:59.267191] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267200] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267207] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.695 [2024-11-26 05:21:59.267217] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.695 [2024-11-26 05:21:59.267242] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.695 [2024-11-26 05:21:59.267337] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.267352] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.267359] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267365] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.695 [2024-11-26 05:21:59.267383] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267392] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267399] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.695 [2024-11-26 05:21:59.267409] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.695 [2024-11-26 05:21:59.267429] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.695 [2024-11-26 05:21:59.267513] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.267525] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.267532] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267538] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.695 [2024-11-26 05:21:59.267555] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267565] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267571] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.695 [2024-11-26 05:21:59.267581] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.695 [2024-11-26 05:21:59.267601] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.695 [2024-11-26 05:21:59.267698] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.267712] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.267719] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267725] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.695 [2024-11-26 05:21:59.267743] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267752] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267759] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.695 [2024-11-26 05:21:59.267769] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.695 [2024-11-26 05:21:59.267789] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.695 [2024-11-26 05:21:59.267876] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.267891] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.267898] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267904] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.695 [2024-11-26 05:21:59.267922] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267931] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.267938] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.695 [2024-11-26 05:21:59.267948] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.695 [2024-11-26 05:21:59.267973] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.695 [2024-11-26 05:21:59.268060] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.268075] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.268081] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.268088] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.695 [2024-11-26 05:21:59.268106] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.268115] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.268122] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.695 [2024-11-26 05:21:59.268132] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.695 [2024-11-26 05:21:59.268152] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.695 [2024-11-26 05:21:59.268245] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.268257] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.268264] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.268270] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.695 [2024-11-26 05:21:59.268288] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.268297] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.268303] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.695 [2024-11-26 05:21:59.268314] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.695 [2024-11-26 05:21:59.268333] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.695 [2024-11-26 05:21:59.268418] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.268430] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.268437] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.268443] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.695 [2024-11-26 05:21:59.268460] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.268469] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.268476] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.695 [2024-11-26 05:21:59.268486] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.695 [2024-11-26 05:21:59.268506] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.695 [2024-11-26 05:21:59.268596] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.268607] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.268614] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.268621] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.695 [2024-11-26 05:21:59.268638] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.268647] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.268654] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.695 [2024-11-26 05:21:59.268664] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.695 [2024-11-26 05:21:59.272694] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.695 [2024-11-26 05:21:59.272719] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.272731] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.272738] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.272745] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.695 [2024-11-26 05:21:59.272764] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.272773] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.695 [2024-11-26 05:21:59.272780] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1784420) 00:25:57.695 [2024-11-26 05:21:59.272790] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.695 [2024-11-26 05:21:59.272813] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17e9f20, cid 3, qid 0 00:25:57.695 [2024-11-26 05:21:59.272910] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.695 [2024-11-26 05:21:59.272925] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.695 [2024-11-26 05:21:59.272932] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.272938] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17e9f20) on tqpair=0x1784420 00:25:57.696 [2024-11-26 05:21:59.272953] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:25:57.696 00:25:57.696 05:21:59 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:25:57.696 [2024-11-26 05:21:59.302836] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:57.696 [2024-11-26 05:21:59.302879] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3384130 ] 00:25:57.696 EAL: No free 2048 kB hugepages reported on node 1 00:25:57.696 [2024-11-26 05:21:59.337420] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:25:57.696 [2024-11-26 05:21:59.337466] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:57.696 [2024-11-26 05:21:59.337475] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:57.696 [2024-11-26 05:21:59.337490] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:57.696 [2024-11-26 05:21:59.337502] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:57.696 [2024-11-26 05:21:59.337789] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:25:57.696 [2024-11-26 05:21:59.337833] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x148d420 0 00:25:57.696 [2024-11-26 05:21:59.344702] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:57.696 [2024-11-26 05:21:59.344721] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:57.696 [2024-11-26 05:21:59.344738] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:57.696 [2024-11-26 05:21:59.344744] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:57.696 [2024-11-26 05:21:59.344782] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.344793] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.344800] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x148d420) 00:25:57.696 [2024-11-26 05:21:59.344817] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:57.696 [2024-11-26 05:21:59.344844] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2b00, cid 0, qid 0 00:25:57.696 [2024-11-26 05:21:59.352712] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.696 [2024-11-26 05:21:59.352729] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.696 [2024-11-26 05:21:59.352737] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.352743] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2b00) on tqpair=0x148d420 00:25:57.696 [2024-11-26 05:21:59.352762] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:57.696 [2024-11-26 05:21:59.352773] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:25:57.696 [2024-11-26 05:21:59.352781] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:25:57.696 [2024-11-26 05:21:59.352797] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.352806] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.352813] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x148d420) 00:25:57.696 [2024-11-26 05:21:59.352823] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.696 [2024-11-26 05:21:59.352847] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2b00, cid 0, qid 0 00:25:57.696 [2024-11-26 05:21:59.352985] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.696 [2024-11-26 05:21:59.352998] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.696 [2024-11-26 05:21:59.353005] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353012] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2b00) on tqpair=0x148d420 00:25:57.696 [2024-11-26 05:21:59.353021] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:25:57.696 [2024-11-26 05:21:59.353034] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:25:57.696 [2024-11-26 05:21:59.353047] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353055] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353061] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x148d420) 00:25:57.696 [2024-11-26 05:21:59.353071] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.696 [2024-11-26 05:21:59.353092] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2b00, cid 0, qid 0 00:25:57.696 [2024-11-26 05:21:59.353188] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.696 [2024-11-26 05:21:59.353200] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.696 [2024-11-26 05:21:59.353206] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353213] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2b00) on tqpair=0x148d420 00:25:57.696 [2024-11-26 05:21:59.353222] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:25:57.696 [2024-11-26 05:21:59.353236] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:25:57.696 [2024-11-26 05:21:59.353248] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353256] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353262] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x148d420) 00:25:57.696 [2024-11-26 05:21:59.353272] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.696 [2024-11-26 05:21:59.353297] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2b00, cid 0, qid 0 00:25:57.696 [2024-11-26 05:21:59.353391] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.696 [2024-11-26 05:21:59.353406] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.696 [2024-11-26 05:21:59.353412] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353419] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2b00) on tqpair=0x148d420 00:25:57.696 [2024-11-26 05:21:59.353429] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:57.696 [2024-11-26 05:21:59.353446] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353455] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353461] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x148d420) 00:25:57.696 [2024-11-26 05:21:59.353472] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.696 [2024-11-26 05:21:59.353493] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2b00, cid 0, qid 0 00:25:57.696 [2024-11-26 05:21:59.353584] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.696 [2024-11-26 05:21:59.353596] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.696 [2024-11-26 05:21:59.353603] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353610] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2b00) on tqpair=0x148d420 00:25:57.696 [2024-11-26 05:21:59.353618] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:25:57.696 [2024-11-26 05:21:59.353627] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:25:57.696 [2024-11-26 05:21:59.353639] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:57.696 [2024-11-26 05:21:59.353749] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:25:57.696 [2024-11-26 05:21:59.353758] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:57.696 [2024-11-26 05:21:59.353770] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353778] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353784] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x148d420) 00:25:57.696 [2024-11-26 05:21:59.353795] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.696 [2024-11-26 05:21:59.353816] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2b00, cid 0, qid 0 00:25:57.696 [2024-11-26 05:21:59.353913] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.696 [2024-11-26 05:21:59.353926] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.696 [2024-11-26 05:21:59.353932] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353939] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2b00) on tqpair=0x148d420 00:25:57.696 [2024-11-26 05:21:59.353948] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:57.696 [2024-11-26 05:21:59.353964] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353973] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.353979] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x148d420) 00:25:57.696 [2024-11-26 05:21:59.353993] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.696 [2024-11-26 05:21:59.354015] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2b00, cid 0, qid 0 00:25:57.696 [2024-11-26 05:21:59.354111] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.696 [2024-11-26 05:21:59.354123] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.696 [2024-11-26 05:21:59.354130] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.354136] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2b00) on tqpair=0x148d420 00:25:57.696 [2024-11-26 05:21:59.354145] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:57.696 [2024-11-26 05:21:59.354153] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:25:57.696 [2024-11-26 05:21:59.354165] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:25:57.696 [2024-11-26 05:21:59.354180] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:25:57.696 [2024-11-26 05:21:59.354193] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.354200] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.696 [2024-11-26 05:21:59.354206] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x148d420) 00:25:57.696 [2024-11-26 05:21:59.354217] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.696 [2024-11-26 05:21:59.354238] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2b00, cid 0, qid 0 00:25:57.696 [2024-11-26 05:21:59.354399] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:57.696 [2024-11-26 05:21:59.354415] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:57.697 [2024-11-26 05:21:59.354421] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.354428] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x148d420): datao=0, datal=4096, cccid=0 00:25:57.697 [2024-11-26 05:21:59.354435] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14f2b00) on tqpair(0x148d420): expected_datao=0, payload_size=4096 00:25:57.697 [2024-11-26 05:21:59.354446] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.354453] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.394821] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.697 [2024-11-26 05:21:59.394840] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.697 [2024-11-26 05:21:59.394847] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.394854] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2b00) on tqpair=0x148d420 00:25:57.697 [2024-11-26 05:21:59.394866] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:25:57.697 [2024-11-26 05:21:59.394875] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:25:57.697 [2024-11-26 05:21:59.394882] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:25:57.697 [2024-11-26 05:21:59.394888] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:25:57.697 [2024-11-26 05:21:59.394896] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:25:57.697 [2024-11-26 05:21:59.394903] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:25:57.697 [2024-11-26 05:21:59.394923] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:25:57.697 [2024-11-26 05:21:59.394940] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.394949] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.394955] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x148d420) 00:25:57.697 [2024-11-26 05:21:59.394967] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:57.697 [2024-11-26 05:21:59.394991] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2b00, cid 0, qid 0 00:25:57.697 [2024-11-26 05:21:59.395084] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.697 [2024-11-26 05:21:59.395099] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.697 [2024-11-26 05:21:59.395106] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395112] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2b00) on tqpair=0x148d420 00:25:57.697 [2024-11-26 05:21:59.395124] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395131] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395138] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x148d420) 00:25:57.697 [2024-11-26 05:21:59.395148] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.697 [2024-11-26 05:21:59.395158] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395165] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395171] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x148d420) 00:25:57.697 [2024-11-26 05:21:59.395180] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.697 [2024-11-26 05:21:59.395190] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395196] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395202] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x148d420) 00:25:57.697 [2024-11-26 05:21:59.395211] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.697 [2024-11-26 05:21:59.395220] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395227] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395233] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x148d420) 00:25:57.697 [2024-11-26 05:21:59.395242] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.697 [2024-11-26 05:21:59.395250] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:25:57.697 [2024-11-26 05:21:59.395285] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:57.697 [2024-11-26 05:21:59.395298] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395305] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395311] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x148d420) 00:25:57.697 [2024-11-26 05:21:59.395320] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.697 [2024-11-26 05:21:59.395343] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2b00, cid 0, qid 0 00:25:57.697 [2024-11-26 05:21:59.395369] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2c60, cid 1, qid 0 00:25:57.697 [2024-11-26 05:21:59.395381] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2dc0, cid 2, qid 0 00:25:57.697 [2024-11-26 05:21:59.395389] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2f20, cid 3, qid 0 00:25:57.697 [2024-11-26 05:21:59.395396] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f3080, cid 4, qid 0 00:25:57.697 [2024-11-26 05:21:59.395537] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.697 [2024-11-26 05:21:59.395552] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.697 [2024-11-26 05:21:59.395558] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395565] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f3080) on tqpair=0x148d420 00:25:57.697 [2024-11-26 05:21:59.395574] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:25:57.697 [2024-11-26 05:21:59.395583] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:25:57.697 [2024-11-26 05:21:59.395597] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:25:57.697 [2024-11-26 05:21:59.395614] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:25:57.697 [2024-11-26 05:21:59.395626] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395634] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395640] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x148d420) 00:25:57.697 [2024-11-26 05:21:59.395651] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:57.697 [2024-11-26 05:21:59.395672] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f3080, cid 4, qid 0 00:25:57.697 [2024-11-26 05:21:59.395771] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.697 [2024-11-26 05:21:59.395784] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.697 [2024-11-26 05:21:59.395791] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395797] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f3080) on tqpair=0x148d420 00:25:57.697 [2024-11-26 05:21:59.395864] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:25:57.697 [2024-11-26 05:21:59.395882] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:25:57.697 [2024-11-26 05:21:59.395897] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395904] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.395910] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x148d420) 00:25:57.697 [2024-11-26 05:21:59.395920] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.697 [2024-11-26 05:21:59.395943] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f3080, cid 4, qid 0 00:25:57.697 [2024-11-26 05:21:59.396055] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:57.697 [2024-11-26 05:21:59.396070] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:57.697 [2024-11-26 05:21:59.396077] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.396083] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x148d420): datao=0, datal=4096, cccid=4 00:25:57.697 [2024-11-26 05:21:59.396090] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14f3080) on tqpair(0x148d420): expected_datao=0, payload_size=4096 00:25:57.697 [2024-11-26 05:21:59.396101] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.396113] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.396125] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.697 [2024-11-26 05:21:59.396135] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.697 [2024-11-26 05:21:59.396142] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.396148] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f3080) on tqpair=0x148d420 00:25:57.697 [2024-11-26 05:21:59.396171] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:25:57.697 [2024-11-26 05:21:59.396192] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:25:57.697 [2024-11-26 05:21:59.396211] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:25:57.697 [2024-11-26 05:21:59.396224] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.396231] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.697 [2024-11-26 05:21:59.396238] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x148d420) 00:25:57.697 [2024-11-26 05:21:59.396248] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.697 [2024-11-26 05:21:59.396269] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f3080, cid 4, qid 0 00:25:57.697 [2024-11-26 05:21:59.396392] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:57.697 [2024-11-26 05:21:59.396405] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:57.697 [2024-11-26 05:21:59.396412] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.396418] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x148d420): datao=0, datal=4096, cccid=4 00:25:57.698 [2024-11-26 05:21:59.396425] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14f3080) on tqpair(0x148d420): expected_datao=0, payload_size=4096 00:25:57.698 [2024-11-26 05:21:59.396436] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.396443] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.396454] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.698 [2024-11-26 05:21:59.396464] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.698 [2024-11-26 05:21:59.396470] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.396477] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f3080) on tqpair=0x148d420 00:25:57.698 [2024-11-26 05:21:59.396503] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:25:57.698 [2024-11-26 05:21:59.396523] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:25:57.698 [2024-11-26 05:21:59.396536] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.396544] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.396550] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x148d420) 00:25:57.698 [2024-11-26 05:21:59.396560] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.698 [2024-11-26 05:21:59.396581] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f3080, cid 4, qid 0 00:25:57.698 [2024-11-26 05:21:59.400700] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:57.698 [2024-11-26 05:21:59.400717] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:57.698 [2024-11-26 05:21:59.400739] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.400746] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x148d420): datao=0, datal=4096, cccid=4 00:25:57.698 [2024-11-26 05:21:59.400757] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14f3080) on tqpair(0x148d420): expected_datao=0, payload_size=4096 00:25:57.698 [2024-11-26 05:21:59.400770] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.400777] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.400785] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.698 [2024-11-26 05:21:59.400794] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.698 [2024-11-26 05:21:59.400800] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.400807] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f3080) on tqpair=0x148d420 00:25:57.698 [2024-11-26 05:21:59.400822] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:25:57.698 [2024-11-26 05:21:59.400838] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:25:57.698 [2024-11-26 05:21:59.400855] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:25:57.698 [2024-11-26 05:21:59.400866] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:25:57.698 [2024-11-26 05:21:59.400875] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:25:57.698 [2024-11-26 05:21:59.400884] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:25:57.698 [2024-11-26 05:21:59.400892] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:25:57.698 [2024-11-26 05:21:59.400901] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:25:57.698 [2024-11-26 05:21:59.400921] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.400929] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.400936] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x148d420) 00:25:57.698 [2024-11-26 05:21:59.400946] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.698 [2024-11-26 05:21:59.400957] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.400964] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.400970] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x148d420) 00:25:57.698 [2024-11-26 05:21:59.400979] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.698 [2024-11-26 05:21:59.401006] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f3080, cid 4, qid 0 00:25:57.698 [2024-11-26 05:21:59.401018] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f31e0, cid 5, qid 0 00:25:57.698 [2024-11-26 05:21:59.401138] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.698 [2024-11-26 05:21:59.401153] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.698 [2024-11-26 05:21:59.401160] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401166] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f3080) on tqpair=0x148d420 00:25:57.698 [2024-11-26 05:21:59.401177] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.698 [2024-11-26 05:21:59.401187] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.698 [2024-11-26 05:21:59.401193] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401200] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f31e0) on tqpair=0x148d420 00:25:57.698 [2024-11-26 05:21:59.401221] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401231] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401237] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x148d420) 00:25:57.698 [2024-11-26 05:21:59.401247] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.698 [2024-11-26 05:21:59.401268] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f31e0, cid 5, qid 0 00:25:57.698 [2024-11-26 05:21:59.401369] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.698 [2024-11-26 05:21:59.401382] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.698 [2024-11-26 05:21:59.401388] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401395] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f31e0) on tqpair=0x148d420 00:25:57.698 [2024-11-26 05:21:59.401411] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401420] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401427] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x148d420) 00:25:57.698 [2024-11-26 05:21:59.401437] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.698 [2024-11-26 05:21:59.401457] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f31e0, cid 5, qid 0 00:25:57.698 [2024-11-26 05:21:59.401547] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.698 [2024-11-26 05:21:59.401559] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.698 [2024-11-26 05:21:59.401566] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401573] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f31e0) on tqpair=0x148d420 00:25:57.698 [2024-11-26 05:21:59.401589] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401598] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401605] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x148d420) 00:25:57.698 [2024-11-26 05:21:59.401615] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.698 [2024-11-26 05:21:59.401635] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f31e0, cid 5, qid 0 00:25:57.698 [2024-11-26 05:21:59.401730] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.698 [2024-11-26 05:21:59.401744] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.698 [2024-11-26 05:21:59.401751] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401758] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f31e0) on tqpair=0x148d420 00:25:57.698 [2024-11-26 05:21:59.401777] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401787] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401794] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x148d420) 00:25:57.698 [2024-11-26 05:21:59.401804] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.698 [2024-11-26 05:21:59.401816] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401823] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401829] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x148d420) 00:25:57.698 [2024-11-26 05:21:59.401838] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.698 [2024-11-26 05:21:59.401854] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401862] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401868] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x148d420) 00:25:57.698 [2024-11-26 05:21:59.401878] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.698 [2024-11-26 05:21:59.401889] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401897] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.401903] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x148d420) 00:25:57.698 [2024-11-26 05:21:59.401912] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.698 [2024-11-26 05:21:59.401950] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f31e0, cid 5, qid 0 00:25:57.698 [2024-11-26 05:21:59.401962] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f3080, cid 4, qid 0 00:25:57.698 [2024-11-26 05:21:59.401969] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f3340, cid 6, qid 0 00:25:57.698 [2024-11-26 05:21:59.401976] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f34a0, cid 7, qid 0 00:25:57.698 [2024-11-26 05:21:59.402211] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:57.698 [2024-11-26 05:21:59.402224] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:57.698 [2024-11-26 05:21:59.402231] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.402237] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x148d420): datao=0, datal=8192, cccid=5 00:25:57.698 [2024-11-26 05:21:59.402244] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14f31e0) on tqpair(0x148d420): expected_datao=0, payload_size=8192 00:25:57.698 [2024-11-26 05:21:59.402262] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.402271] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.402283] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:57.698 [2024-11-26 05:21:59.402293] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:57.698 [2024-11-26 05:21:59.402300] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:57.698 [2024-11-26 05:21:59.402306] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x148d420): datao=0, datal=512, cccid=4 00:25:57.698 [2024-11-26 05:21:59.402313] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14f3080) on tqpair(0x148d420): expected_datao=0, payload_size=512 00:25:57.698 [2024-11-26 05:21:59.402322] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:57.699 [2024-11-26 05:21:59.402329] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:57.699 [2024-11-26 05:21:59.402337] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:57.699 [2024-11-26 05:21:59.402346] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:57.699 [2024-11-26 05:21:59.402352] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:57.699 [2024-11-26 05:21:59.402358] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x148d420): datao=0, datal=512, cccid=6 00:25:57.699 [2024-11-26 05:21:59.402365] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14f3340) on tqpair(0x148d420): expected_datao=0, payload_size=512 00:25:57.699 [2024-11-26 05:21:59.402375] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:57.699 [2024-11-26 05:21:59.402382] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:57.699 [2024-11-26 05:21:59.402390] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:57.699 [2024-11-26 05:21:59.402399] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:57.699 [2024-11-26 05:21:59.402408] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:57.699 [2024-11-26 05:21:59.402415] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x148d420): datao=0, datal=4096, cccid=7 00:25:57.699 [2024-11-26 05:21:59.402422] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14f34a0) on tqpair(0x148d420): expected_datao=0, payload_size=4096 00:25:57.699 [2024-11-26 05:21:59.402432] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:57.699 [2024-11-26 05:21:59.402439] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:57.699 [2024-11-26 05:21:59.402451] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.699 [2024-11-26 05:21:59.402460] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.699 [2024-11-26 05:21:59.402466] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.699 [2024-11-26 05:21:59.402473] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f31e0) on tqpair=0x148d420 00:25:57.699 [2024-11-26 05:21:59.402493] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.699 [2024-11-26 05:21:59.402504] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.699 [2024-11-26 05:21:59.402511] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.699 [2024-11-26 05:21:59.402517] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f3080) on tqpair=0x148d420 00:25:57.699 [2024-11-26 05:21:59.402532] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.699 [2024-11-26 05:21:59.402542] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.699 [2024-11-26 05:21:59.402549] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.699 [2024-11-26 05:21:59.402555] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f3340) on tqpair=0x148d420 00:25:57.699 [2024-11-26 05:21:59.402585] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.699 [2024-11-26 05:21:59.402595] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.699 [2024-11-26 05:21:59.402601] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.699 [2024-11-26 05:21:59.402607] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f34a0) on tqpair=0x148d420 00:25:57.699 ===================================================== 00:25:57.699 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:57.699 ===================================================== 00:25:57.699 Controller Capabilities/Features 00:25:57.699 ================================ 00:25:57.699 Vendor ID: 8086 00:25:57.699 Subsystem Vendor ID: 8086 00:25:57.699 Serial Number: SPDK00000000000001 00:25:57.699 Model Number: SPDK bdev Controller 00:25:57.699 Firmware Version: 24.01.1 00:25:57.699 Recommended Arb Burst: 6 00:25:57.699 IEEE OUI Identifier: e4 d2 5c 00:25:57.699 Multi-path I/O 00:25:57.699 May have multiple subsystem ports: Yes 00:25:57.699 May have multiple controllers: Yes 00:25:57.699 Associated with SR-IOV VF: No 00:25:57.699 Max Data Transfer Size: 131072 00:25:57.699 Max Number of Namespaces: 32 00:25:57.699 Max Number of I/O Queues: 127 00:25:57.699 NVMe Specification Version (VS): 1.3 00:25:57.699 NVMe Specification Version (Identify): 1.3 00:25:57.699 Maximum Queue Entries: 128 00:25:57.699 Contiguous Queues Required: Yes 00:25:57.699 Arbitration Mechanisms Supported 00:25:57.699 Weighted Round Robin: Not Supported 00:25:57.699 Vendor Specific: Not Supported 00:25:57.699 Reset Timeout: 15000 ms 00:25:57.699 Doorbell Stride: 4 bytes 00:25:57.699 NVM Subsystem Reset: Not Supported 00:25:57.699 Command Sets Supported 00:25:57.699 NVM Command Set: Supported 00:25:57.699 Boot Partition: Not Supported 00:25:57.699 Memory Page Size Minimum: 4096 bytes 00:25:57.699 Memory Page Size Maximum: 4096 bytes 00:25:57.699 Persistent Memory Region: Not Supported 00:25:57.699 Optional Asynchronous Events Supported 00:25:57.699 Namespace Attribute Notices: Supported 00:25:57.699 Firmware Activation Notices: Not Supported 00:25:57.699 ANA Change Notices: Not Supported 00:25:57.699 PLE Aggregate Log Change Notices: Not Supported 00:25:57.699 LBA Status Info Alert Notices: Not Supported 00:25:57.699 EGE Aggregate Log Change Notices: Not Supported 00:25:57.699 Normal NVM Subsystem Shutdown event: Not Supported 00:25:57.699 Zone Descriptor Change Notices: Not Supported 00:25:57.699 Discovery Log Change Notices: Not Supported 00:25:57.699 Controller Attributes 00:25:57.699 128-bit Host Identifier: Supported 00:25:57.699 Non-Operational Permissive Mode: Not Supported 00:25:57.699 NVM Sets: Not Supported 00:25:57.699 Read Recovery Levels: Not Supported 00:25:57.699 Endurance Groups: Not Supported 00:25:57.699 Predictable Latency Mode: Not Supported 00:25:57.699 Traffic Based Keep ALive: Not Supported 00:25:57.699 Namespace Granularity: Not Supported 00:25:57.699 SQ Associations: Not Supported 00:25:57.699 UUID List: Not Supported 00:25:57.699 Multi-Domain Subsystem: Not Supported 00:25:57.699 Fixed Capacity Management: Not Supported 00:25:57.699 Variable Capacity Management: Not Supported 00:25:57.699 Delete Endurance Group: Not Supported 00:25:57.699 Delete NVM Set: Not Supported 00:25:57.699 Extended LBA Formats Supported: Not Supported 00:25:57.699 Flexible Data Placement Supported: Not Supported 00:25:57.699 00:25:57.699 Controller Memory Buffer Support 00:25:57.699 ================================ 00:25:57.699 Supported: No 00:25:57.699 00:25:57.699 Persistent Memory Region Support 00:25:57.699 ================================ 00:25:57.699 Supported: No 00:25:57.699 00:25:57.699 Admin Command Set Attributes 00:25:57.699 ============================ 00:25:57.699 Security Send/Receive: Not Supported 00:25:57.699 Format NVM: Not Supported 00:25:57.699 Firmware Activate/Download: Not Supported 00:25:57.699 Namespace Management: Not Supported 00:25:57.699 Device Self-Test: Not Supported 00:25:57.699 Directives: Not Supported 00:25:57.699 NVMe-MI: Not Supported 00:25:57.699 Virtualization Management: Not Supported 00:25:57.699 Doorbell Buffer Config: Not Supported 00:25:57.699 Get LBA Status Capability: Not Supported 00:25:57.699 Command & Feature Lockdown Capability: Not Supported 00:25:57.699 Abort Command Limit: 4 00:25:57.699 Async Event Request Limit: 4 00:25:57.699 Number of Firmware Slots: N/A 00:25:57.699 Firmware Slot 1 Read-Only: N/A 00:25:57.699 Firmware Activation Without Reset: N/A 00:25:57.699 Multiple Update Detection Support: N/A 00:25:57.699 Firmware Update Granularity: No Information Provided 00:25:57.699 Per-Namespace SMART Log: No 00:25:57.699 Asymmetric Namespace Access Log Page: Not Supported 00:25:57.699 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:25:57.699 Command Effects Log Page: Supported 00:25:57.699 Get Log Page Extended Data: Supported 00:25:57.699 Telemetry Log Pages: Not Supported 00:25:57.699 Persistent Event Log Pages: Not Supported 00:25:57.699 Supported Log Pages Log Page: May Support 00:25:57.699 Commands Supported & Effects Log Page: Not Supported 00:25:57.699 Feature Identifiers & Effects Log Page:May Support 00:25:57.699 NVMe-MI Commands & Effects Log Page: May Support 00:25:57.699 Data Area 4 for Telemetry Log: Not Supported 00:25:57.699 Error Log Page Entries Supported: 128 00:25:57.699 Keep Alive: Supported 00:25:57.699 Keep Alive Granularity: 10000 ms 00:25:57.699 00:25:57.699 NVM Command Set Attributes 00:25:57.699 ========================== 00:25:57.699 Submission Queue Entry Size 00:25:57.699 Max: 64 00:25:57.699 Min: 64 00:25:57.699 Completion Queue Entry Size 00:25:57.699 Max: 16 00:25:57.699 Min: 16 00:25:57.699 Number of Namespaces: 32 00:25:57.699 Compare Command: Supported 00:25:57.699 Write Uncorrectable Command: Not Supported 00:25:57.699 Dataset Management Command: Supported 00:25:57.699 Write Zeroes Command: Supported 00:25:57.699 Set Features Save Field: Not Supported 00:25:57.699 Reservations: Supported 00:25:57.699 Timestamp: Not Supported 00:25:57.699 Copy: Supported 00:25:57.699 Volatile Write Cache: Present 00:25:57.699 Atomic Write Unit (Normal): 1 00:25:57.699 Atomic Write Unit (PFail): 1 00:25:57.699 Atomic Compare & Write Unit: 1 00:25:57.699 Fused Compare & Write: Supported 00:25:57.699 Scatter-Gather List 00:25:57.699 SGL Command Set: Supported 00:25:57.699 SGL Keyed: Supported 00:25:57.699 SGL Bit Bucket Descriptor: Not Supported 00:25:57.699 SGL Metadata Pointer: Not Supported 00:25:57.699 Oversized SGL: Not Supported 00:25:57.699 SGL Metadata Address: Not Supported 00:25:57.699 SGL Offset: Supported 00:25:57.699 Transport SGL Data Block: Not Supported 00:25:57.699 Replay Protected Memory Block: Not Supported 00:25:57.699 00:25:57.699 Firmware Slot Information 00:25:57.699 ========================= 00:25:57.699 Active slot: 1 00:25:57.699 Slot 1 Firmware Revision: 24.01.1 00:25:57.699 00:25:57.699 00:25:57.699 Commands Supported and Effects 00:25:57.699 ============================== 00:25:57.699 Admin Commands 00:25:57.699 -------------- 00:25:57.699 Get Log Page (02h): Supported 00:25:57.699 Identify (06h): Supported 00:25:57.699 Abort (08h): Supported 00:25:57.699 Set Features (09h): Supported 00:25:57.699 Get Features (0Ah): Supported 00:25:57.699 Asynchronous Event Request (0Ch): Supported 00:25:57.699 Keep Alive (18h): Supported 00:25:57.699 I/O Commands 00:25:57.699 ------------ 00:25:57.699 Flush (00h): Supported LBA-Change 00:25:57.699 Write (01h): Supported LBA-Change 00:25:57.699 Read (02h): Supported 00:25:57.699 Compare (05h): Supported 00:25:57.699 Write Zeroes (08h): Supported LBA-Change 00:25:57.699 Dataset Management (09h): Supported LBA-Change 00:25:57.699 Copy (19h): Supported LBA-Change 00:25:57.699 Unknown (79h): Supported LBA-Change 00:25:57.699 Unknown (7Ah): Supported 00:25:57.699 00:25:57.699 Error Log 00:25:57.699 ========= 00:25:57.699 00:25:57.699 Arbitration 00:25:57.699 =========== 00:25:57.699 Arbitration Burst: 1 00:25:57.699 00:25:57.699 Power Management 00:25:57.699 ================ 00:25:57.700 Number of Power States: 1 00:25:57.700 Current Power State: Power State #0 00:25:57.700 Power State #0: 00:25:57.700 Max Power: 0.00 W 00:25:57.700 Non-Operational State: Operational 00:25:57.700 Entry Latency: Not Reported 00:25:57.700 Exit Latency: Not Reported 00:25:57.700 Relative Read Throughput: 0 00:25:57.700 Relative Read Latency: 0 00:25:57.700 Relative Write Throughput: 0 00:25:57.700 Relative Write Latency: 0 00:25:57.700 Idle Power: Not Reported 00:25:57.700 Active Power: Not Reported 00:25:57.700 Non-Operational Permissive Mode: Not Supported 00:25:57.700 00:25:57.700 Health Information 00:25:57.700 ================== 00:25:57.700 Critical Warnings: 00:25:57.700 Available Spare Space: OK 00:25:57.700 Temperature: OK 00:25:57.700 Device Reliability: OK 00:25:57.700 Read Only: No 00:25:57.700 Volatile Memory Backup: OK 00:25:57.700 Current Temperature: 0 Kelvin (-273 Celsius) 00:25:57.700 Temperature Threshold: [2024-11-26 05:21:59.402766] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.402778] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.402785] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x148d420) 00:25:57.700 [2024-11-26 05:21:59.402795] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.700 [2024-11-26 05:21:59.402817] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f34a0, cid 7, qid 0 00:25:57.700 [2024-11-26 05:21:59.402959] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.700 [2024-11-26 05:21:59.402974] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.700 [2024-11-26 05:21:59.402981] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.402988] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f34a0) on tqpair=0x148d420 00:25:57.700 [2024-11-26 05:21:59.403031] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:25:57.700 [2024-11-26 05:21:59.403052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.700 [2024-11-26 05:21:59.403064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.700 [2024-11-26 05:21:59.403073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.700 [2024-11-26 05:21:59.403083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.700 [2024-11-26 05:21:59.403095] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403107] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403114] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x148d420) 00:25:57.700 [2024-11-26 05:21:59.403125] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.700 [2024-11-26 05:21:59.403161] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2f20, cid 3, qid 0 00:25:57.700 [2024-11-26 05:21:59.403323] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.700 [2024-11-26 05:21:59.403339] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.700 [2024-11-26 05:21:59.403345] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403352] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2f20) on tqpair=0x148d420 00:25:57.700 [2024-11-26 05:21:59.403364] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403372] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403378] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x148d420) 00:25:57.700 [2024-11-26 05:21:59.403388] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.700 [2024-11-26 05:21:59.403415] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2f20, cid 3, qid 0 00:25:57.700 [2024-11-26 05:21:59.403524] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.700 [2024-11-26 05:21:59.403536] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.700 [2024-11-26 05:21:59.403542] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403549] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2f20) on tqpair=0x148d420 00:25:57.700 [2024-11-26 05:21:59.403557] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:25:57.700 [2024-11-26 05:21:59.403565] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:25:57.700 [2024-11-26 05:21:59.403580] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403589] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403595] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x148d420) 00:25:57.700 [2024-11-26 05:21:59.403606] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.700 [2024-11-26 05:21:59.403626] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2f20, cid 3, qid 0 00:25:57.700 [2024-11-26 05:21:59.403732] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.700 [2024-11-26 05:21:59.403745] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.700 [2024-11-26 05:21:59.403752] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403758] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2f20) on tqpair=0x148d420 00:25:57.700 [2024-11-26 05:21:59.403776] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403785] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403792] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x148d420) 00:25:57.700 [2024-11-26 05:21:59.403802] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.700 [2024-11-26 05:21:59.403822] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2f20, cid 3, qid 0 00:25:57.700 [2024-11-26 05:21:59.403913] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.700 [2024-11-26 05:21:59.403925] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.700 [2024-11-26 05:21:59.403932] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403942] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2f20) on tqpair=0x148d420 00:25:57.700 [2024-11-26 05:21:59.403959] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403969] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.403975] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x148d420) 00:25:57.700 [2024-11-26 05:21:59.403985] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.700 [2024-11-26 05:21:59.404005] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2f20, cid 3, qid 0 00:25:57.700 [2024-11-26 05:21:59.404094] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.700 [2024-11-26 05:21:59.404109] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.700 [2024-11-26 05:21:59.404115] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.404122] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2f20) on tqpair=0x148d420 00:25:57.700 [2024-11-26 05:21:59.404139] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.404149] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.404155] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x148d420) 00:25:57.700 [2024-11-26 05:21:59.404165] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.700 [2024-11-26 05:21:59.404186] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2f20, cid 3, qid 0 00:25:57.700 [2024-11-26 05:21:59.404275] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.700 [2024-11-26 05:21:59.404290] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.700 [2024-11-26 05:21:59.404296] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.404303] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2f20) on tqpair=0x148d420 00:25:57.700 [2024-11-26 05:21:59.404320] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.404329] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.404336] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x148d420) 00:25:57.700 [2024-11-26 05:21:59.404346] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.700 [2024-11-26 05:21:59.404367] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2f20, cid 3, qid 0 00:25:57.700 [2024-11-26 05:21:59.404460] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.700 [2024-11-26 05:21:59.404474] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.700 [2024-11-26 05:21:59.404481] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.404487] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2f20) on tqpair=0x148d420 00:25:57.700 [2024-11-26 05:21:59.404505] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.404514] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.404521] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x148d420) 00:25:57.700 [2024-11-26 05:21:59.404531] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.700 [2024-11-26 05:21:59.404552] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2f20, cid 3, qid 0 00:25:57.700 [2024-11-26 05:21:59.404639] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.700 [2024-11-26 05:21:59.404651] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.700 [2024-11-26 05:21:59.404657] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.404664] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2f20) on tqpair=0x148d420 00:25:57.700 [2024-11-26 05:21:59.408692] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.408707] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.408714] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x148d420) 00:25:57.700 [2024-11-26 05:21:59.408725] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.700 [2024-11-26 05:21:59.408747] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14f2f20, cid 3, qid 0 00:25:57.700 [2024-11-26 05:21:59.408883] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:57.700 [2024-11-26 05:21:59.408896] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:57.700 [2024-11-26 05:21:59.408903] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:57.700 [2024-11-26 05:21:59.408909] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14f2f20) on tqpair=0x148d420 00:25:57.700 [2024-11-26 05:21:59.408923] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:25:57.700 0 Kelvin (-273 Celsius) 00:25:57.700 Available Spare: 0% 00:25:57.700 Available Spare Threshold: 0% 00:25:57.700 Life Percentage Used: 0% 00:25:57.700 Data Units Read: 0 00:25:57.700 Data Units Written: 0 00:25:57.700 Host Read Commands: 0 00:25:57.700 Host Write Commands: 0 00:25:57.700 Controller Busy Time: 0 minutes 00:25:57.700 Power Cycles: 0 00:25:57.700 Power On Hours: 0 hours 00:25:57.700 Unsafe Shutdowns: 0 00:25:57.700 Unrecoverable Media Errors: 0 00:25:57.701 Lifetime Error Log Entries: 0 00:25:57.701 Warning Temperature Time: 0 minutes 00:25:57.701 Critical Temperature Time: 0 minutes 00:25:57.701 00:25:57.701 Number of Queues 00:25:57.701 ================ 00:25:57.701 Number of I/O Submission Queues: 127 00:25:57.701 Number of I/O Completion Queues: 127 00:25:57.701 00:25:57.701 Active Namespaces 00:25:57.701 ================= 00:25:57.701 Namespace ID:1 00:25:57.701 Error Recovery Timeout: Unlimited 00:25:57.701 Command Set Identifier: NVM (00h) 00:25:57.701 Deallocate: Supported 00:25:57.701 Deallocated/Unwritten Error: Not Supported 00:25:57.701 Deallocated Read Value: Unknown 00:25:57.701 Deallocate in Write Zeroes: Not Supported 00:25:57.701 Deallocated Guard Field: 0xFFFF 00:25:57.701 Flush: Supported 00:25:57.701 Reservation: Supported 00:25:57.701 Namespace Sharing Capabilities: Multiple Controllers 00:25:57.701 Size (in LBAs): 131072 (0GiB) 00:25:57.701 Capacity (in LBAs): 131072 (0GiB) 00:25:57.701 Utilization (in LBAs): 131072 (0GiB) 00:25:57.701 NGUID: ABCDEF0123456789ABCDEF0123456789 00:25:57.701 EUI64: ABCDEF0123456789 00:25:57.701 UUID: 97a1e46b-dd0f-496e-9d5a-7f07d5609a71 00:25:57.701 Thin Provisioning: Not Supported 00:25:57.701 Per-NS Atomic Units: Yes 00:25:57.701 Atomic Boundary Size (Normal): 0 00:25:57.701 Atomic Boundary Size (PFail): 0 00:25:57.701 Atomic Boundary Offset: 0 00:25:57.701 Maximum Single Source Range Length: 65535 00:25:57.701 Maximum Copy Length: 65535 00:25:57.701 Maximum Source Range Count: 1 00:25:57.701 NGUID/EUI64 Never Reused: No 00:25:57.701 Namespace Write Protected: No 00:25:57.701 Number of LBA Formats: 1 00:25:57.701 Current LBA Format: LBA Format #00 00:25:57.701 LBA Format #00: Data Size: 512 Metadata Size: 0 00:25:57.701 00:25:57.701 05:21:59 -- host/identify.sh@51 -- # sync 00:25:57.701 05:21:59 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:57.701 05:21:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:57.701 05:21:59 -- common/autotest_common.sh@10 -- # set +x 00:25:57.701 05:21:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:57.701 05:21:59 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:25:57.701 05:21:59 -- host/identify.sh@56 -- # nvmftestfini 00:25:57.701 05:21:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:57.701 05:21:59 -- nvmf/common.sh@116 -- # sync 00:25:57.701 05:21:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:57.701 05:21:59 -- nvmf/common.sh@119 -- # set +e 00:25:57.701 05:21:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:57.701 05:21:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:57.701 rmmod nvme_tcp 00:25:57.701 rmmod nvme_fabrics 00:25:57.958 rmmod nvme_keyring 00:25:57.958 05:21:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:57.959 05:21:59 -- nvmf/common.sh@123 -- # set -e 00:25:57.959 05:21:59 -- nvmf/common.sh@124 -- # return 0 00:25:57.959 05:21:59 -- nvmf/common.sh@477 -- # '[' -n 3383966 ']' 00:25:57.959 05:21:59 -- nvmf/common.sh@478 -- # killprocess 3383966 00:25:57.959 05:21:59 -- common/autotest_common.sh@936 -- # '[' -z 3383966 ']' 00:25:57.959 05:21:59 -- common/autotest_common.sh@940 -- # kill -0 3383966 00:25:57.959 05:21:59 -- common/autotest_common.sh@941 -- # uname 00:25:57.959 05:21:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:57.959 05:21:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3383966 00:25:57.959 05:21:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:57.959 05:21:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:57.959 05:21:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3383966' 00:25:57.959 killing process with pid 3383966 00:25:57.959 05:21:59 -- common/autotest_common.sh@955 -- # kill 3383966 00:25:57.959 [2024-11-26 05:21:59.530250] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:57.959 05:21:59 -- common/autotest_common.sh@960 -- # wait 3383966 00:25:58.219 05:21:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:58.219 05:21:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:58.219 05:21:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:58.219 05:21:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:58.219 05:21:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:58.219 05:21:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:58.219 05:21:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:58.219 05:21:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:00.123 05:22:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:00.123 00:26:00.123 real 0m6.094s 00:26:00.123 user 0m7.243s 00:26:00.123 sys 0m1.943s 00:26:00.123 05:22:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:00.123 05:22:01 -- common/autotest_common.sh@10 -- # set +x 00:26:00.123 ************************************ 00:26:00.123 END TEST nvmf_identify 00:26:00.123 ************************************ 00:26:00.123 05:22:01 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:00.123 05:22:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:00.124 05:22:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:00.124 05:22:01 -- common/autotest_common.sh@10 -- # set +x 00:26:00.124 ************************************ 00:26:00.124 START TEST nvmf_perf 00:26:00.124 ************************************ 00:26:00.124 05:22:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:00.382 * Looking for test storage... 00:26:00.382 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:00.382 05:22:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:00.382 05:22:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:00.382 05:22:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:00.382 05:22:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:00.382 05:22:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:00.382 05:22:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:00.382 05:22:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:00.382 05:22:02 -- scripts/common.sh@335 -- # IFS=.-: 00:26:00.382 05:22:02 -- scripts/common.sh@335 -- # read -ra ver1 00:26:00.382 05:22:02 -- scripts/common.sh@336 -- # IFS=.-: 00:26:00.382 05:22:02 -- scripts/common.sh@336 -- # read -ra ver2 00:26:00.382 05:22:02 -- scripts/common.sh@337 -- # local 'op=<' 00:26:00.382 05:22:02 -- scripts/common.sh@339 -- # ver1_l=2 00:26:00.382 05:22:02 -- scripts/common.sh@340 -- # ver2_l=1 00:26:00.382 05:22:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:00.382 05:22:02 -- scripts/common.sh@343 -- # case "$op" in 00:26:00.382 05:22:02 -- scripts/common.sh@344 -- # : 1 00:26:00.382 05:22:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:00.382 05:22:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:00.382 05:22:02 -- scripts/common.sh@364 -- # decimal 1 00:26:00.382 05:22:02 -- scripts/common.sh@352 -- # local d=1 00:26:00.382 05:22:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:00.382 05:22:02 -- scripts/common.sh@354 -- # echo 1 00:26:00.382 05:22:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:00.382 05:22:02 -- scripts/common.sh@365 -- # decimal 2 00:26:00.382 05:22:02 -- scripts/common.sh@352 -- # local d=2 00:26:00.382 05:22:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:00.382 05:22:02 -- scripts/common.sh@354 -- # echo 2 00:26:00.382 05:22:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:00.382 05:22:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:00.382 05:22:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:00.382 05:22:02 -- scripts/common.sh@367 -- # return 0 00:26:00.382 05:22:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:00.382 05:22:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:00.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:00.382 --rc genhtml_branch_coverage=1 00:26:00.382 --rc genhtml_function_coverage=1 00:26:00.382 --rc genhtml_legend=1 00:26:00.382 --rc geninfo_all_blocks=1 00:26:00.382 --rc geninfo_unexecuted_blocks=1 00:26:00.382 00:26:00.382 ' 00:26:00.382 05:22:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:00.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:00.382 --rc genhtml_branch_coverage=1 00:26:00.382 --rc genhtml_function_coverage=1 00:26:00.382 --rc genhtml_legend=1 00:26:00.382 --rc geninfo_all_blocks=1 00:26:00.382 --rc geninfo_unexecuted_blocks=1 00:26:00.382 00:26:00.382 ' 00:26:00.382 05:22:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:00.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:00.382 --rc genhtml_branch_coverage=1 00:26:00.382 --rc genhtml_function_coverage=1 00:26:00.382 --rc genhtml_legend=1 00:26:00.382 --rc geninfo_all_blocks=1 00:26:00.382 --rc geninfo_unexecuted_blocks=1 00:26:00.382 00:26:00.382 ' 00:26:00.382 05:22:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:00.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:00.382 --rc genhtml_branch_coverage=1 00:26:00.382 --rc genhtml_function_coverage=1 00:26:00.382 --rc genhtml_legend=1 00:26:00.382 --rc geninfo_all_blocks=1 00:26:00.382 --rc geninfo_unexecuted_blocks=1 00:26:00.382 00:26:00.382 ' 00:26:00.382 05:22:02 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:00.382 05:22:02 -- nvmf/common.sh@7 -- # uname -s 00:26:00.382 05:22:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:00.382 05:22:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:00.382 05:22:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:00.382 05:22:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:00.382 05:22:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:00.382 05:22:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:00.382 05:22:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:00.382 05:22:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:00.382 05:22:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:00.382 05:22:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:00.383 05:22:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:00.383 05:22:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:00.383 05:22:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:00.383 05:22:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:00.383 05:22:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:00.383 05:22:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:00.383 05:22:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:00.383 05:22:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:00.383 05:22:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:00.383 05:22:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:00.383 05:22:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:00.383 05:22:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:00.383 05:22:02 -- paths/export.sh@5 -- # export PATH 00:26:00.383 05:22:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:00.383 05:22:02 -- nvmf/common.sh@46 -- # : 0 00:26:00.383 05:22:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:00.383 05:22:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:00.383 05:22:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:00.383 05:22:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:00.383 05:22:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:00.383 05:22:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:00.383 05:22:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:00.383 05:22:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:00.383 05:22:02 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:26:00.383 05:22:02 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:26:00.383 05:22:02 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:00.383 05:22:02 -- host/perf.sh@17 -- # nvmftestinit 00:26:00.383 05:22:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:00.383 05:22:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:00.383 05:22:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:00.383 05:22:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:00.383 05:22:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:00.383 05:22:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:00.383 05:22:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:00.383 05:22:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:00.383 05:22:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:00.383 05:22:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:00.383 05:22:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:00.383 05:22:02 -- common/autotest_common.sh@10 -- # set +x 00:26:02.916 05:22:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:02.916 05:22:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:02.916 05:22:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:02.916 05:22:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:02.916 05:22:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:02.916 05:22:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:02.916 05:22:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:02.916 05:22:04 -- nvmf/common.sh@294 -- # net_devs=() 00:26:02.916 05:22:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:02.916 05:22:04 -- nvmf/common.sh@295 -- # e810=() 00:26:02.916 05:22:04 -- nvmf/common.sh@295 -- # local -ga e810 00:26:02.916 05:22:04 -- nvmf/common.sh@296 -- # x722=() 00:26:02.916 05:22:04 -- nvmf/common.sh@296 -- # local -ga x722 00:26:02.916 05:22:04 -- nvmf/common.sh@297 -- # mlx=() 00:26:02.916 05:22:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:02.916 05:22:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:02.916 05:22:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:02.916 05:22:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:02.916 05:22:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:02.916 05:22:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:02.916 05:22:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:02.916 05:22:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:02.916 05:22:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:02.916 05:22:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:02.916 05:22:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:02.916 05:22:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:02.917 05:22:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:02.917 05:22:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:02.917 05:22:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:02.917 05:22:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:02.917 05:22:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:02.917 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:02.917 05:22:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:02.917 05:22:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:02.917 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:02.917 05:22:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:02.917 05:22:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:02.917 05:22:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:02.917 05:22:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:02.917 05:22:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:02.917 05:22:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:02.917 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:02.917 05:22:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:02.917 05:22:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:02.917 05:22:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:02.917 05:22:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:02.917 05:22:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:02.917 05:22:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:02.917 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:02.917 05:22:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:02.917 05:22:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:02.917 05:22:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:02.917 05:22:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:02.917 05:22:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:02.917 05:22:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:02.917 05:22:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:02.917 05:22:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:02.917 05:22:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:02.917 05:22:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:02.917 05:22:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:02.917 05:22:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:02.917 05:22:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:02.917 05:22:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:02.917 05:22:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:02.917 05:22:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:02.917 05:22:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:02.917 05:22:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:02.917 05:22:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:02.917 05:22:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:02.917 05:22:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:02.917 05:22:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:02.917 05:22:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:02.917 05:22:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:02.917 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:02.917 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.178 ms 00:26:02.917 00:26:02.917 --- 10.0.0.2 ping statistics --- 00:26:02.917 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:02.917 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:26:02.917 05:22:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:02.917 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:02.917 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:26:02.917 00:26:02.917 --- 10.0.0.1 ping statistics --- 00:26:02.917 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:02.917 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:26:02.917 05:22:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:02.917 05:22:04 -- nvmf/common.sh@410 -- # return 0 00:26:02.917 05:22:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:02.917 05:22:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:02.917 05:22:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:02.917 05:22:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:02.917 05:22:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:02.917 05:22:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:02.917 05:22:04 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:26:02.917 05:22:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:02.917 05:22:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:02.917 05:22:04 -- common/autotest_common.sh@10 -- # set +x 00:26:02.917 05:22:04 -- nvmf/common.sh@469 -- # nvmfpid=3386155 00:26:02.917 05:22:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:02.917 05:22:04 -- nvmf/common.sh@470 -- # waitforlisten 3386155 00:26:02.917 05:22:04 -- common/autotest_common.sh@829 -- # '[' -z 3386155 ']' 00:26:02.917 05:22:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:02.917 05:22:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:02.917 05:22:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:02.917 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:02.917 05:22:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:02.917 05:22:04 -- common/autotest_common.sh@10 -- # set +x 00:26:02.917 [2024-11-26 05:22:04.347648] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:02.917 [2024-11-26 05:22:04.347775] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:02.917 EAL: No free 2048 kB hugepages reported on node 1 00:26:02.917 [2024-11-26 05:22:04.416993] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:02.917 [2024-11-26 05:22:04.506927] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:02.917 [2024-11-26 05:22:04.507080] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:02.917 [2024-11-26 05:22:04.507113] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:02.917 [2024-11-26 05:22:04.507126] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:02.917 [2024-11-26 05:22:04.507184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:02.917 [2024-11-26 05:22:04.507312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:02.917 [2024-11-26 05:22:04.507335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:02.917 [2024-11-26 05:22:04.507339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:03.855 05:22:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:03.855 05:22:05 -- common/autotest_common.sh@862 -- # return 0 00:26:03.855 05:22:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:03.855 05:22:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:03.855 05:22:05 -- common/autotest_common.sh@10 -- # set +x 00:26:03.855 05:22:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:03.855 05:22:05 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:03.855 05:22:05 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:26:07.205 05:22:08 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:26:07.205 05:22:08 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:26:07.205 05:22:08 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:26:07.205 05:22:08 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:26:07.463 05:22:09 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:26:07.463 05:22:09 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:26:07.463 05:22:09 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:26:07.463 05:22:09 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:26:07.463 05:22:09 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:26:07.720 [2024-11-26 05:22:09.366132] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:07.720 05:22:09 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:07.978 05:22:09 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:07.978 05:22:09 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:08.236 05:22:09 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:08.236 05:22:09 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:26:08.494 05:22:10 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:08.752 [2024-11-26 05:22:10.406124] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:08.752 05:22:10 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:09.019 05:22:10 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:26:09.019 05:22:10 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:09.019 05:22:10 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:26:09.019 05:22:10 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:10.394 Initializing NVMe Controllers 00:26:10.394 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:26:10.394 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:26:10.394 Initialization complete. Launching workers. 00:26:10.394 ======================================================== 00:26:10.394 Latency(us) 00:26:10.394 Device Information : IOPS MiB/s Average min max 00:26:10.394 PCIE (0000:88:00.0) NSID 1 from core 0: 87771.70 342.86 364.15 42.03 6284.64 00:26:10.394 ======================================================== 00:26:10.394 Total : 87771.70 342.86 364.15 42.03 6284.64 00:26:10.394 00:26:10.394 05:22:11 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:10.394 EAL: No free 2048 kB hugepages reported on node 1 00:26:11.774 Initializing NVMe Controllers 00:26:11.774 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:11.774 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:11.774 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:11.774 Initialization complete. Launching workers. 00:26:11.774 ======================================================== 00:26:11.774 Latency(us) 00:26:11.774 Device Information : IOPS MiB/s Average min max 00:26:11.774 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 103.94 0.41 9938.09 167.19 45092.83 00:26:11.774 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 55.97 0.22 18008.53 6109.53 50868.85 00:26:11.774 ======================================================== 00:26:11.774 Total : 159.91 0.62 12762.74 167.19 50868.85 00:26:11.774 00:26:11.774 05:22:13 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:11.774 EAL: No free 2048 kB hugepages reported on node 1 00:26:13.152 Initializing NVMe Controllers 00:26:13.152 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:13.152 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:13.152 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:13.152 Initialization complete. Launching workers. 00:26:13.152 ======================================================== 00:26:13.152 Latency(us) 00:26:13.152 Device Information : IOPS MiB/s Average min max 00:26:13.152 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8570.99 33.48 3735.57 613.68 7693.72 00:26:13.152 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3897.00 15.22 8254.17 5432.54 17557.12 00:26:13.152 ======================================================== 00:26:13.152 Total : 12467.99 48.70 5147.91 613.68 17557.12 00:26:13.152 00:26:13.152 05:22:14 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:26:13.152 05:22:14 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:26:13.152 05:22:14 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:13.152 EAL: No free 2048 kB hugepages reported on node 1 00:26:15.684 Initializing NVMe Controllers 00:26:15.684 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:15.684 Controller IO queue size 128, less than required. 00:26:15.684 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:15.684 Controller IO queue size 128, less than required. 00:26:15.684 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:15.684 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:15.684 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:15.684 Initialization complete. Launching workers. 00:26:15.684 ======================================================== 00:26:15.684 Latency(us) 00:26:15.684 Device Information : IOPS MiB/s Average min max 00:26:15.684 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1423.07 355.77 91763.38 53774.47 159549.65 00:26:15.684 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 603.97 150.99 221157.66 79583.24 339134.35 00:26:15.684 ======================================================== 00:26:15.684 Total : 2027.04 506.76 130317.20 53774.47 339134.35 00:26:15.684 00:26:15.684 05:22:16 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:15.684 EAL: No free 2048 kB hugepages reported on node 1 00:26:15.684 No valid NVMe controllers or AIO or URING devices found 00:26:15.684 Initializing NVMe Controllers 00:26:15.684 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:15.684 Controller IO queue size 128, less than required. 00:26:15.684 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:15.684 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:15.684 Controller IO queue size 128, less than required. 00:26:15.684 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:15.684 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:15.684 WARNING: Some requested NVMe devices were skipped 00:26:15.684 05:22:17 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:15.684 EAL: No free 2048 kB hugepages reported on node 1 00:26:18.219 Initializing NVMe Controllers 00:26:18.219 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:18.219 Controller IO queue size 128, less than required. 00:26:18.219 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:18.219 Controller IO queue size 128, less than required. 00:26:18.219 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:18.219 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:18.219 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:18.219 Initialization complete. Launching workers. 00:26:18.219 00:26:18.219 ==================== 00:26:18.219 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:18.219 TCP transport: 00:26:18.219 polls: 9791 00:26:18.219 idle_polls: 5368 00:26:18.219 sock_completions: 4423 00:26:18.219 nvme_completions: 5297 00:26:18.219 submitted_requests: 8109 00:26:18.219 queued_requests: 1 00:26:18.219 00:26:18.219 ==================== 00:26:18.219 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:18.219 TCP transport: 00:26:18.219 polls: 10313 00:26:18.219 idle_polls: 6573 00:26:18.219 sock_completions: 3740 00:26:18.219 nvme_completions: 5897 00:26:18.219 submitted_requests: 8965 00:26:18.219 queued_requests: 1 00:26:18.219 ======================================================== 00:26:18.219 Latency(us) 00:26:18.219 Device Information : IOPS MiB/s Average min max 00:26:18.219 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1387.84 346.96 95454.82 56240.55 144421.29 00:26:18.219 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1537.82 384.46 84187.73 35755.48 128961.13 00:26:18.219 ======================================================== 00:26:18.219 Total : 2925.67 731.42 89532.47 35755.48 144421.29 00:26:18.219 00:26:18.219 05:22:19 -- host/perf.sh@66 -- # sync 00:26:18.219 05:22:19 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:18.479 05:22:20 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:18.479 05:22:20 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:18.479 05:22:20 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:21.767 05:22:23 -- host/perf.sh@72 -- # ls_guid=08cf02d5-3d4b-4eda-9f37-3041b06e6514 00:26:21.767 05:22:23 -- host/perf.sh@73 -- # get_lvs_free_mb 08cf02d5-3d4b-4eda-9f37-3041b06e6514 00:26:21.767 05:22:23 -- common/autotest_common.sh@1353 -- # local lvs_uuid=08cf02d5-3d4b-4eda-9f37-3041b06e6514 00:26:21.767 05:22:23 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:21.767 05:22:23 -- common/autotest_common.sh@1355 -- # local fc 00:26:21.767 05:22:23 -- common/autotest_common.sh@1356 -- # local cs 00:26:21.768 05:22:23 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:22.026 05:22:23 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:22.026 { 00:26:22.026 "uuid": "08cf02d5-3d4b-4eda-9f37-3041b06e6514", 00:26:22.026 "name": "lvs_0", 00:26:22.026 "base_bdev": "Nvme0n1", 00:26:22.026 "total_data_clusters": 238234, 00:26:22.026 "free_clusters": 238234, 00:26:22.026 "block_size": 512, 00:26:22.026 "cluster_size": 4194304 00:26:22.026 } 00:26:22.026 ]' 00:26:22.026 05:22:23 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="08cf02d5-3d4b-4eda-9f37-3041b06e6514") .free_clusters' 00:26:22.026 05:22:23 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:22.026 05:22:23 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="08cf02d5-3d4b-4eda-9f37-3041b06e6514") .cluster_size' 00:26:22.026 05:22:23 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:22.026 05:22:23 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:22.026 05:22:23 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:22.026 952936 00:26:22.027 05:22:23 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:22.027 05:22:23 -- host/perf.sh@78 -- # free_mb=20480 00:26:22.027 05:22:23 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 08cf02d5-3d4b-4eda-9f37-3041b06e6514 lbd_0 20480 00:26:22.593 05:22:24 -- host/perf.sh@80 -- # lb_guid=1ab24e99-133d-4831-994f-5f1518468c0b 00:26:22.593 05:22:24 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 1ab24e99-133d-4831-994f-5f1518468c0b lvs_n_0 00:26:23.159 05:22:24 -- host/perf.sh@83 -- # ls_nested_guid=0459013b-4d77-454b-92f6-d7dfd69e1234 00:26:23.159 05:22:24 -- host/perf.sh@84 -- # get_lvs_free_mb 0459013b-4d77-454b-92f6-d7dfd69e1234 00:26:23.159 05:22:24 -- common/autotest_common.sh@1353 -- # local lvs_uuid=0459013b-4d77-454b-92f6-d7dfd69e1234 00:26:23.159 05:22:24 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:23.159 05:22:24 -- common/autotest_common.sh@1355 -- # local fc 00:26:23.159 05:22:24 -- common/autotest_common.sh@1356 -- # local cs 00:26:23.159 05:22:24 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:23.726 05:22:25 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:23.726 { 00:26:23.726 "uuid": "08cf02d5-3d4b-4eda-9f37-3041b06e6514", 00:26:23.726 "name": "lvs_0", 00:26:23.726 "base_bdev": "Nvme0n1", 00:26:23.726 "total_data_clusters": 238234, 00:26:23.726 "free_clusters": 233114, 00:26:23.726 "block_size": 512, 00:26:23.726 "cluster_size": 4194304 00:26:23.726 }, 00:26:23.726 { 00:26:23.726 "uuid": "0459013b-4d77-454b-92f6-d7dfd69e1234", 00:26:23.726 "name": "lvs_n_0", 00:26:23.726 "base_bdev": "1ab24e99-133d-4831-994f-5f1518468c0b", 00:26:23.726 "total_data_clusters": 5114, 00:26:23.726 "free_clusters": 5114, 00:26:23.726 "block_size": 512, 00:26:23.726 "cluster_size": 4194304 00:26:23.726 } 00:26:23.726 ]' 00:26:23.726 05:22:25 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="0459013b-4d77-454b-92f6-d7dfd69e1234") .free_clusters' 00:26:23.726 05:22:25 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:23.726 05:22:25 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="0459013b-4d77-454b-92f6-d7dfd69e1234") .cluster_size' 00:26:23.726 05:22:25 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:23.726 05:22:25 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:23.726 05:22:25 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:23.726 20456 00:26:23.726 05:22:25 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:23.726 05:22:25 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 0459013b-4d77-454b-92f6-d7dfd69e1234 lbd_nest_0 20456 00:26:23.984 05:22:25 -- host/perf.sh@88 -- # lb_nested_guid=ff951c2b-b5f5-429e-923b-c17e288007aa 00:26:23.984 05:22:25 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:24.242 05:22:25 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:24.242 05:22:25 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 ff951c2b-b5f5-429e-923b-c17e288007aa 00:26:24.500 05:22:26 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:24.760 05:22:26 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:24.760 05:22:26 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:24.760 05:22:26 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:24.760 05:22:26 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:24.760 05:22:26 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:24.760 EAL: No free 2048 kB hugepages reported on node 1 00:26:36.971 Initializing NVMe Controllers 00:26:36.971 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:36.971 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:36.971 Initialization complete. Launching workers. 00:26:36.971 ======================================================== 00:26:36.971 Latency(us) 00:26:36.971 Device Information : IOPS MiB/s Average min max 00:26:36.971 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 45.49 0.02 22057.87 176.38 47865.57 00:26:36.971 ======================================================== 00:26:36.971 Total : 45.49 0.02 22057.87 176.38 47865.57 00:26:36.971 00:26:36.971 05:22:36 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:36.971 05:22:36 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:36.971 EAL: No free 2048 kB hugepages reported on node 1 00:26:46.954 Initializing NVMe Controllers 00:26:46.954 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:46.954 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:46.954 Initialization complete. Launching workers. 00:26:46.954 ======================================================== 00:26:46.954 Latency(us) 00:26:46.954 Device Information : IOPS MiB/s Average min max 00:26:46.954 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 78.69 9.84 12707.91 6020.89 47901.63 00:26:46.954 ======================================================== 00:26:46.954 Total : 78.69 9.84 12707.91 6020.89 47901.63 00:26:46.954 00:26:46.954 05:22:46 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:46.954 05:22:46 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:46.954 05:22:46 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:46.954 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.965 [2024-11-26 05:22:57.091034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x145af50 is same with the state(5) to be set 00:26:56.965 [2024-11-26 05:22:57.091118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x145af50 is same with the state(5) to be set 00:26:56.965 [2024-11-26 05:22:57.091134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x145af50 is same with the state(5) to be set 00:26:56.965 [2024-11-26 05:22:57.091147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x145af50 is same with the state(5) to be set 00:26:56.965 [2024-11-26 05:22:57.091160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x145af50 is same with the state(5) to be set 00:26:56.965 [2024-11-26 05:22:57.091172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x145af50 is same with the state(5) to be set 00:26:56.965 Initializing NVMe Controllers 00:26:56.965 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:56.965 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:56.965 Initialization complete. Launching workers. 00:26:56.965 ======================================================== 00:26:56.965 Latency(us) 00:26:56.965 Device Information : IOPS MiB/s Average min max 00:26:56.965 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7703.60 3.76 4153.60 319.93 11625.45 00:26:56.965 ======================================================== 00:26:56.965 Total : 7703.60 3.76 4153.60 319.93 11625.45 00:26:56.965 00:26:56.965 05:22:57 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:56.965 05:22:57 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:56.965 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.945 Initializing NVMe Controllers 00:27:06.945 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:06.945 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:06.945 Initialization complete. Launching workers. 00:27:06.945 ======================================================== 00:27:06.945 Latency(us) 00:27:06.945 Device Information : IOPS MiB/s Average min max 00:27:06.945 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3904.50 488.06 8196.77 705.27 19423.24 00:27:06.945 ======================================================== 00:27:06.945 Total : 3904.50 488.06 8196.77 705.27 19423.24 00:27:06.945 00:27:06.945 05:23:07 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:06.945 05:23:07 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:06.945 05:23:07 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:06.945 EAL: No free 2048 kB hugepages reported on node 1 00:27:16.936 Initializing NVMe Controllers 00:27:16.936 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:16.936 Controller IO queue size 128, less than required. 00:27:16.936 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:16.936 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:16.936 Initialization complete. Launching workers. 00:27:16.936 ======================================================== 00:27:16.936 Latency(us) 00:27:16.936 Device Information : IOPS MiB/s Average min max 00:27:16.936 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11954.40 5.84 10715.06 1743.74 29790.41 00:27:16.936 ======================================================== 00:27:16.936 Total : 11954.40 5.84 10715.06 1743.74 29790.41 00:27:16.936 00:27:16.936 05:23:17 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:16.936 05:23:17 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:16.936 EAL: No free 2048 kB hugepages reported on node 1 00:27:26.921 Initializing NVMe Controllers 00:27:26.921 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:26.921 Controller IO queue size 128, less than required. 00:27:26.921 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:26.921 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:26.921 Initialization complete. Launching workers. 00:27:26.921 ======================================================== 00:27:26.921 Latency(us) 00:27:26.922 Device Information : IOPS MiB/s Average min max 00:27:26.922 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1212.73 151.59 106208.12 23663.27 222433.72 00:27:26.922 ======================================================== 00:27:26.922 Total : 1212.73 151.59 106208.12 23663.27 222433.72 00:27:26.922 00:27:26.922 05:23:28 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:26.922 05:23:28 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ff951c2b-b5f5-429e-923b-c17e288007aa 00:27:27.856 05:23:29 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:27.856 05:23:29 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 1ab24e99-133d-4831-994f-5f1518468c0b 00:27:28.114 05:23:29 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:28.372 05:23:30 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:28.372 05:23:30 -- host/perf.sh@114 -- # nvmftestfini 00:27:28.372 05:23:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:28.372 05:23:30 -- nvmf/common.sh@116 -- # sync 00:27:28.372 05:23:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:28.372 05:23:30 -- nvmf/common.sh@119 -- # set +e 00:27:28.372 05:23:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:28.372 05:23:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:28.372 rmmod nvme_tcp 00:27:28.372 rmmod nvme_fabrics 00:27:28.631 rmmod nvme_keyring 00:27:28.631 05:23:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:28.631 05:23:30 -- nvmf/common.sh@123 -- # set -e 00:27:28.631 05:23:30 -- nvmf/common.sh@124 -- # return 0 00:27:28.631 05:23:30 -- nvmf/common.sh@477 -- # '[' -n 3386155 ']' 00:27:28.631 05:23:30 -- nvmf/common.sh@478 -- # killprocess 3386155 00:27:28.631 05:23:30 -- common/autotest_common.sh@936 -- # '[' -z 3386155 ']' 00:27:28.631 05:23:30 -- common/autotest_common.sh@940 -- # kill -0 3386155 00:27:28.631 05:23:30 -- common/autotest_common.sh@941 -- # uname 00:27:28.631 05:23:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:28.631 05:23:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3386155 00:27:28.631 05:23:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:28.631 05:23:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:28.631 05:23:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3386155' 00:27:28.631 killing process with pid 3386155 00:27:28.631 05:23:30 -- common/autotest_common.sh@955 -- # kill 3386155 00:27:28.631 05:23:30 -- common/autotest_common.sh@960 -- # wait 3386155 00:27:30.539 05:23:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:30.539 05:23:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:30.539 05:23:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:30.539 05:23:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:30.539 05:23:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:30.539 05:23:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:30.539 05:23:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:30.539 05:23:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:32.449 05:23:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:32.449 00:27:32.449 real 1m31.971s 00:27:32.449 user 5m38.376s 00:27:32.449 sys 0m16.626s 00:27:32.449 05:23:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:32.449 05:23:33 -- common/autotest_common.sh@10 -- # set +x 00:27:32.449 ************************************ 00:27:32.449 END TEST nvmf_perf 00:27:32.449 ************************************ 00:27:32.449 05:23:33 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:32.449 05:23:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:32.449 05:23:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:32.449 05:23:33 -- common/autotest_common.sh@10 -- # set +x 00:27:32.449 ************************************ 00:27:32.449 START TEST nvmf_fio_host 00:27:32.449 ************************************ 00:27:32.449 05:23:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:32.449 * Looking for test storage... 00:27:32.449 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:32.449 05:23:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:32.449 05:23:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:32.449 05:23:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:32.449 05:23:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:32.449 05:23:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:32.449 05:23:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:32.449 05:23:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:32.449 05:23:33 -- scripts/common.sh@335 -- # IFS=.-: 00:27:32.449 05:23:33 -- scripts/common.sh@335 -- # read -ra ver1 00:27:32.449 05:23:33 -- scripts/common.sh@336 -- # IFS=.-: 00:27:32.449 05:23:33 -- scripts/common.sh@336 -- # read -ra ver2 00:27:32.449 05:23:33 -- scripts/common.sh@337 -- # local 'op=<' 00:27:32.449 05:23:33 -- scripts/common.sh@339 -- # ver1_l=2 00:27:32.449 05:23:33 -- scripts/common.sh@340 -- # ver2_l=1 00:27:32.449 05:23:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:32.449 05:23:33 -- scripts/common.sh@343 -- # case "$op" in 00:27:32.449 05:23:33 -- scripts/common.sh@344 -- # : 1 00:27:32.449 05:23:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:32.449 05:23:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:32.449 05:23:33 -- scripts/common.sh@364 -- # decimal 1 00:27:32.449 05:23:33 -- scripts/common.sh@352 -- # local d=1 00:27:32.449 05:23:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:32.449 05:23:33 -- scripts/common.sh@354 -- # echo 1 00:27:32.449 05:23:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:32.449 05:23:33 -- scripts/common.sh@365 -- # decimal 2 00:27:32.449 05:23:33 -- scripts/common.sh@352 -- # local d=2 00:27:32.449 05:23:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:32.449 05:23:33 -- scripts/common.sh@354 -- # echo 2 00:27:32.450 05:23:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:32.450 05:23:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:32.450 05:23:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:32.450 05:23:33 -- scripts/common.sh@367 -- # return 0 00:27:32.450 05:23:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:32.450 05:23:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:32.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:32.450 --rc genhtml_branch_coverage=1 00:27:32.450 --rc genhtml_function_coverage=1 00:27:32.450 --rc genhtml_legend=1 00:27:32.450 --rc geninfo_all_blocks=1 00:27:32.450 --rc geninfo_unexecuted_blocks=1 00:27:32.450 00:27:32.450 ' 00:27:32.450 05:23:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:32.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:32.450 --rc genhtml_branch_coverage=1 00:27:32.450 --rc genhtml_function_coverage=1 00:27:32.450 --rc genhtml_legend=1 00:27:32.450 --rc geninfo_all_blocks=1 00:27:32.450 --rc geninfo_unexecuted_blocks=1 00:27:32.450 00:27:32.450 ' 00:27:32.450 05:23:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:32.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:32.450 --rc genhtml_branch_coverage=1 00:27:32.450 --rc genhtml_function_coverage=1 00:27:32.450 --rc genhtml_legend=1 00:27:32.450 --rc geninfo_all_blocks=1 00:27:32.450 --rc geninfo_unexecuted_blocks=1 00:27:32.450 00:27:32.450 ' 00:27:32.450 05:23:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:32.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:32.450 --rc genhtml_branch_coverage=1 00:27:32.450 --rc genhtml_function_coverage=1 00:27:32.450 --rc genhtml_legend=1 00:27:32.450 --rc geninfo_all_blocks=1 00:27:32.450 --rc geninfo_unexecuted_blocks=1 00:27:32.450 00:27:32.450 ' 00:27:32.450 05:23:33 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:32.450 05:23:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:32.450 05:23:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:32.450 05:23:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:32.450 05:23:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.450 05:23:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.450 05:23:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.450 05:23:33 -- paths/export.sh@5 -- # export PATH 00:27:32.450 05:23:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.450 05:23:33 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:32.450 05:23:33 -- nvmf/common.sh@7 -- # uname -s 00:27:32.450 05:23:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:32.450 05:23:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:32.450 05:23:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:32.450 05:23:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:32.450 05:23:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:32.450 05:23:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:32.450 05:23:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:32.450 05:23:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:32.450 05:23:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:32.450 05:23:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:32.450 05:23:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:32.450 05:23:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:32.450 05:23:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:32.450 05:23:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:32.450 05:23:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:32.450 05:23:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:32.450 05:23:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:32.450 05:23:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:32.450 05:23:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:32.450 05:23:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.450 05:23:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.450 05:23:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.450 05:23:33 -- paths/export.sh@5 -- # export PATH 00:27:32.450 05:23:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.450 05:23:33 -- nvmf/common.sh@46 -- # : 0 00:27:32.450 05:23:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:32.450 05:23:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:32.450 05:23:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:32.450 05:23:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:32.450 05:23:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:32.450 05:23:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:32.450 05:23:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:32.450 05:23:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:32.450 05:23:34 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:32.450 05:23:34 -- host/fio.sh@14 -- # nvmftestinit 00:27:32.450 05:23:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:32.450 05:23:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:32.450 05:23:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:32.450 05:23:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:32.450 05:23:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:32.450 05:23:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:32.450 05:23:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:32.450 05:23:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:32.450 05:23:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:32.450 05:23:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:32.450 05:23:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:32.450 05:23:34 -- common/autotest_common.sh@10 -- # set +x 00:27:34.355 05:23:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:34.355 05:23:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:34.355 05:23:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:34.355 05:23:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:34.355 05:23:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:34.355 05:23:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:34.355 05:23:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:34.355 05:23:36 -- nvmf/common.sh@294 -- # net_devs=() 00:27:34.355 05:23:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:34.355 05:23:36 -- nvmf/common.sh@295 -- # e810=() 00:27:34.355 05:23:36 -- nvmf/common.sh@295 -- # local -ga e810 00:27:34.355 05:23:36 -- nvmf/common.sh@296 -- # x722=() 00:27:34.355 05:23:36 -- nvmf/common.sh@296 -- # local -ga x722 00:27:34.355 05:23:36 -- nvmf/common.sh@297 -- # mlx=() 00:27:34.355 05:23:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:34.355 05:23:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:34.355 05:23:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:34.355 05:23:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:34.355 05:23:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:34.355 05:23:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:34.355 05:23:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:34.355 05:23:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:34.355 05:23:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:34.355 05:23:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:34.355 05:23:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:34.355 05:23:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:34.355 05:23:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:34.355 05:23:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:34.355 05:23:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:34.355 05:23:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:34.355 05:23:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:34.355 05:23:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:34.355 05:23:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:34.355 05:23:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:34.355 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:34.355 05:23:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:34.355 05:23:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:34.355 05:23:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:34.355 05:23:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:34.355 05:23:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:34.355 05:23:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:34.355 05:23:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:34.355 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:34.355 05:23:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:34.355 05:23:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:34.355 05:23:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:34.355 05:23:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:34.356 05:23:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:34.356 05:23:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:34.356 05:23:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:34.356 05:23:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:34.356 05:23:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:34.356 05:23:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:34.356 05:23:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:34.356 05:23:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:34.356 05:23:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:34.356 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:34.356 05:23:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:34.356 05:23:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:34.356 05:23:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:34.356 05:23:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:34.356 05:23:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:34.356 05:23:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:34.356 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:34.356 05:23:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:34.356 05:23:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:34.356 05:23:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:34.356 05:23:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:34.356 05:23:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:34.356 05:23:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:34.356 05:23:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:34.356 05:23:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:34.356 05:23:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:34.356 05:23:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:34.356 05:23:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:34.356 05:23:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:34.356 05:23:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:34.356 05:23:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:34.356 05:23:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:34.356 05:23:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:34.356 05:23:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:34.356 05:23:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:34.356 05:23:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:34.615 05:23:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:34.615 05:23:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:34.615 05:23:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:34.615 05:23:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:34.615 05:23:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:34.615 05:23:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:34.615 05:23:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:34.615 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:34.615 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.331 ms 00:27:34.615 00:27:34.615 --- 10.0.0.2 ping statistics --- 00:27:34.615 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:34.615 rtt min/avg/max/mdev = 0.331/0.331/0.331/0.000 ms 00:27:34.615 05:23:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:34.615 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:34.615 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.186 ms 00:27:34.615 00:27:34.615 --- 10.0.0.1 ping statistics --- 00:27:34.615 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:34.615 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:27:34.615 05:23:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:34.615 05:23:36 -- nvmf/common.sh@410 -- # return 0 00:27:34.615 05:23:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:34.615 05:23:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:34.615 05:23:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:34.615 05:23:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:34.615 05:23:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:34.615 05:23:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:34.615 05:23:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:34.615 05:23:36 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:34.615 05:23:36 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:34.615 05:23:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:34.615 05:23:36 -- common/autotest_common.sh@10 -- # set +x 00:27:34.615 05:23:36 -- host/fio.sh@24 -- # nvmfpid=3398660 00:27:34.615 05:23:36 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:34.615 05:23:36 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:34.615 05:23:36 -- host/fio.sh@28 -- # waitforlisten 3398660 00:27:34.615 05:23:36 -- common/autotest_common.sh@829 -- # '[' -z 3398660 ']' 00:27:34.615 05:23:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:34.615 05:23:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:34.615 05:23:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:34.615 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:34.615 05:23:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:34.615 05:23:36 -- common/autotest_common.sh@10 -- # set +x 00:27:34.615 [2024-11-26 05:23:36.333834] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:34.615 [2024-11-26 05:23:36.333926] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:34.615 EAL: No free 2048 kB hugepages reported on node 1 00:27:34.875 [2024-11-26 05:23:36.405025] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:34.875 [2024-11-26 05:23:36.494442] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:34.875 [2024-11-26 05:23:36.494609] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:34.875 [2024-11-26 05:23:36.494630] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:34.875 [2024-11-26 05:23:36.494645] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:34.875 [2024-11-26 05:23:36.494730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:34.875 [2024-11-26 05:23:36.494774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:34.875 [2024-11-26 05:23:36.494862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:34.875 [2024-11-26 05:23:36.494864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:35.812 05:23:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:35.812 05:23:37 -- common/autotest_common.sh@862 -- # return 0 00:27:35.812 05:23:37 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:36.070 [2024-11-26 05:23:37.595230] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:36.070 05:23:37 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:36.070 05:23:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:36.070 05:23:37 -- common/autotest_common.sh@10 -- # set +x 00:27:36.070 05:23:37 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:36.328 Malloc1 00:27:36.328 05:23:37 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:36.586 05:23:38 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:36.844 05:23:38 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:37.102 [2024-11-26 05:23:38.669360] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:37.102 05:23:38 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:37.361 05:23:38 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:37.361 05:23:38 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:37.361 05:23:38 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:37.361 05:23:38 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:37.361 05:23:38 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:37.361 05:23:38 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:37.361 05:23:38 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:37.361 05:23:38 -- common/autotest_common.sh@1330 -- # shift 00:27:37.361 05:23:38 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:37.361 05:23:38 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:37.361 05:23:38 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:37.361 05:23:38 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:37.361 05:23:38 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:37.361 05:23:38 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:37.361 05:23:38 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:37.361 05:23:38 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:37.361 05:23:38 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:37.361 05:23:38 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:37.361 05:23:38 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:37.361 05:23:38 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:37.361 05:23:38 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:37.361 05:23:38 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:37.361 05:23:38 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:37.619 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:37.619 fio-3.35 00:27:37.619 Starting 1 thread 00:27:37.619 EAL: No free 2048 kB hugepages reported on node 1 00:27:40.150 00:27:40.150 test: (groupid=0, jobs=1): err= 0: pid=3399042: Tue Nov 26 05:23:41 2024 00:27:40.150 read: IOPS=9490, BW=37.1MiB/s (38.9MB/s)(74.4MiB/2007msec) 00:27:40.150 slat (nsec): min=1971, max=139541, avg=2537.91, stdev=1777.35 00:27:40.150 clat (usec): min=2419, max=12566, avg=7429.03, stdev=721.73 00:27:40.150 lat (usec): min=2442, max=12569, avg=7431.57, stdev=721.66 00:27:40.150 clat percentiles (usec): 00:27:40.150 | 1.00th=[ 6128], 5.00th=[ 6521], 10.00th=[ 6718], 20.00th=[ 6915], 00:27:40.150 | 30.00th=[ 7111], 40.00th=[ 7242], 50.00th=[ 7373], 60.00th=[ 7504], 00:27:40.150 | 70.00th=[ 7635], 80.00th=[ 7832], 90.00th=[ 8094], 95.00th=[ 8356], 00:27:40.150 | 99.00th=[10552], 99.50th=[11207], 99.90th=[11994], 99.95th=[12256], 00:27:40.150 | 99.99th=[12518] 00:27:40.150 bw ( KiB/s): min=37144, max=38632, per=100.00%, avg=37968.00, stdev=758.19, samples=4 00:27:40.150 iops : min= 9286, max= 9658, avg=9492.00, stdev=189.55, samples=4 00:27:40.150 write: IOPS=9499, BW=37.1MiB/s (38.9MB/s)(74.5MiB/2007msec); 0 zone resets 00:27:40.150 slat (usec): min=2, max=121, avg= 2.66, stdev= 1.41 00:27:40.150 clat (usec): min=1327, max=11810, avg=5996.32, stdev=623.50 00:27:40.150 lat (usec): min=1336, max=11812, avg=5998.98, stdev=623.46 00:27:40.150 clat percentiles (usec): 00:27:40.150 | 1.00th=[ 4883], 5.00th=[ 5211], 10.00th=[ 5407], 20.00th=[ 5604], 00:27:40.150 | 30.00th=[ 5735], 40.00th=[ 5866], 50.00th=[ 5932], 60.00th=[ 6063], 00:27:40.150 | 70.00th=[ 6194], 80.00th=[ 6325], 90.00th=[ 6587], 95.00th=[ 6783], 00:27:40.150 | 99.00th=[ 8455], 99.50th=[ 9110], 99.90th=[10159], 99.95th=[11076], 00:27:40.150 | 99.99th=[11731] 00:27:40.150 bw ( KiB/s): min=36480, max=38672, per=100.00%, avg=38006.00, stdev=1036.86, samples=4 00:27:40.150 iops : min= 9120, max= 9668, avg=9501.50, stdev=259.22, samples=4 00:27:40.150 lat (msec) : 2=0.03%, 4=0.11%, 10=99.01%, 20=0.85% 00:27:40.150 cpu : usr=62.51%, sys=34.25%, ctx=84, majf=0, minf=42 00:27:40.150 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:40.150 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:40.150 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:40.150 issued rwts: total=19048,19066,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:40.150 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:40.150 00:27:40.150 Run status group 0 (all jobs): 00:27:40.150 READ: bw=37.1MiB/s (38.9MB/s), 37.1MiB/s-37.1MiB/s (38.9MB/s-38.9MB/s), io=74.4MiB (78.0MB), run=2007-2007msec 00:27:40.150 WRITE: bw=37.1MiB/s (38.9MB/s), 37.1MiB/s-37.1MiB/s (38.9MB/s-38.9MB/s), io=74.5MiB (78.1MB), run=2007-2007msec 00:27:40.150 05:23:41 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:40.150 05:23:41 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:40.150 05:23:41 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:40.150 05:23:41 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:40.150 05:23:41 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:40.150 05:23:41 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:40.150 05:23:41 -- common/autotest_common.sh@1330 -- # shift 00:27:40.150 05:23:41 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:40.150 05:23:41 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:40.150 05:23:41 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:40.150 05:23:41 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:40.150 05:23:41 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:40.150 05:23:41 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:40.150 05:23:41 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:40.150 05:23:41 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:40.150 05:23:41 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:40.150 05:23:41 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:40.150 05:23:41 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:40.150 05:23:41 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:40.150 05:23:41 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:40.150 05:23:41 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:40.150 05:23:41 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:40.150 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:40.150 fio-3.35 00:27:40.150 Starting 1 thread 00:27:40.150 EAL: No free 2048 kB hugepages reported on node 1 00:27:41.087 [2024-11-26 05:23:42.543550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f4d0 is same with the state(5) to be set 00:27:41.087 [2024-11-26 05:23:42.543642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f4d0 is same with the state(5) to be set 00:27:42.465 00:27:42.465 test: (groupid=0, jobs=1): err= 0: pid=3399504: Tue Nov 26 05:23:43 2024 00:27:42.465 read: IOPS=8824, BW=138MiB/s (145MB/s)(277MiB/2006msec) 00:27:42.465 slat (usec): min=2, max=128, avg= 3.65, stdev= 2.06 00:27:42.465 clat (usec): min=2105, max=15873, avg=8584.61, stdev=2038.98 00:27:42.465 lat (usec): min=2109, max=15875, avg=8588.26, stdev=2039.09 00:27:42.465 clat percentiles (usec): 00:27:42.465 | 1.00th=[ 4490], 5.00th=[ 5276], 10.00th=[ 5932], 20.00th=[ 6849], 00:27:42.465 | 30.00th=[ 7439], 40.00th=[ 7963], 50.00th=[ 8455], 60.00th=[ 9110], 00:27:42.465 | 70.00th=[ 9765], 80.00th=[10290], 90.00th=[11076], 95.00th=[11863], 00:27:42.465 | 99.00th=[14091], 99.50th=[14615], 99.90th=[15401], 99.95th=[15664], 00:27:42.465 | 99.99th=[15795] 00:27:42.465 bw ( KiB/s): min=60704, max=74912, per=49.49%, avg=69872.00, stdev=6427.70, samples=4 00:27:42.465 iops : min= 3794, max= 4682, avg=4367.00, stdev=401.73, samples=4 00:27:42.465 write: IOPS=5046, BW=78.8MiB/s (82.7MB/s)(142MiB/1795msec); 0 zone resets 00:27:42.465 slat (usec): min=30, max=180, avg=33.52, stdev= 5.62 00:27:42.465 clat (usec): min=2625, max=18948, avg=10542.76, stdev=1908.27 00:27:42.465 lat (usec): min=2661, max=18984, avg=10576.28, stdev=1908.44 00:27:42.465 clat percentiles (usec): 00:27:42.465 | 1.00th=[ 6980], 5.00th=[ 7832], 10.00th=[ 8356], 20.00th=[ 8979], 00:27:42.465 | 30.00th=[ 9503], 40.00th=[ 9896], 50.00th=[10290], 60.00th=[10683], 00:27:42.465 | 70.00th=[11207], 80.00th=[11994], 90.00th=[13304], 95.00th=[14353], 00:27:42.465 | 99.00th=[15401], 99.50th=[15926], 99.90th=[17957], 99.95th=[18744], 00:27:42.465 | 99.99th=[19006] 00:27:42.465 bw ( KiB/s): min=64000, max=78848, per=89.75%, avg=72464.00, stdev=6208.63, samples=4 00:27:42.465 iops : min= 4000, max= 4928, avg=4529.00, stdev=388.04, samples=4 00:27:42.465 lat (msec) : 4=0.28%, 10=63.48%, 20=36.24% 00:27:42.465 cpu : usr=74.93%, sys=23.18%, ctx=40, majf=0, minf=64 00:27:42.465 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:27:42.465 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:42.465 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:42.465 issued rwts: total=17702,9058,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:42.465 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:42.465 00:27:42.465 Run status group 0 (all jobs): 00:27:42.465 READ: bw=138MiB/s (145MB/s), 138MiB/s-138MiB/s (145MB/s-145MB/s), io=277MiB (290MB), run=2006-2006msec 00:27:42.465 WRITE: bw=78.8MiB/s (82.7MB/s), 78.8MiB/s-78.8MiB/s (82.7MB/s-82.7MB/s), io=142MiB (148MB), run=1795-1795msec 00:27:42.465 05:23:43 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:42.725 05:23:44 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:27:42.725 05:23:44 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:27:42.725 05:23:44 -- host/fio.sh@51 -- # get_nvme_bdfs 00:27:42.725 05:23:44 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:42.725 05:23:44 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:42.725 05:23:44 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:42.725 05:23:44 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:42.725 05:23:44 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:42.725 05:23:44 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:42.725 05:23:44 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:42.725 05:23:44 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:27:46.023 Nvme0n1 00:27:46.023 05:23:47 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:48.556 05:23:50 -- host/fio.sh@53 -- # ls_guid=82573d1c-4cf1-4c04-9442-49a6a3842b27 00:27:48.556 05:23:50 -- host/fio.sh@54 -- # get_lvs_free_mb 82573d1c-4cf1-4c04-9442-49a6a3842b27 00:27:48.556 05:23:50 -- common/autotest_common.sh@1353 -- # local lvs_uuid=82573d1c-4cf1-4c04-9442-49a6a3842b27 00:27:48.556 05:23:50 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:48.556 05:23:50 -- common/autotest_common.sh@1355 -- # local fc 00:27:48.556 05:23:50 -- common/autotest_common.sh@1356 -- # local cs 00:27:48.556 05:23:50 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:48.814 05:23:50 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:48.814 { 00:27:48.814 "uuid": "82573d1c-4cf1-4c04-9442-49a6a3842b27", 00:27:48.814 "name": "lvs_0", 00:27:48.814 "base_bdev": "Nvme0n1", 00:27:48.814 "total_data_clusters": 930, 00:27:48.814 "free_clusters": 930, 00:27:48.814 "block_size": 512, 00:27:48.814 "cluster_size": 1073741824 00:27:48.814 } 00:27:48.814 ]' 00:27:48.814 05:23:50 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="82573d1c-4cf1-4c04-9442-49a6a3842b27") .free_clusters' 00:27:48.814 05:23:50 -- common/autotest_common.sh@1358 -- # fc=930 00:27:48.814 05:23:50 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="82573d1c-4cf1-4c04-9442-49a6a3842b27") .cluster_size' 00:27:49.073 05:23:50 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:27:49.073 05:23:50 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:27:49.073 05:23:50 -- common/autotest_common.sh@1363 -- # echo 952320 00:27:49.073 952320 00:27:49.073 05:23:50 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:49.331 f68d9a32-5c1d-45c0-8051-0528d8f552bf 00:27:49.331 05:23:51 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:49.589 05:23:51 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:49.847 05:23:51 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:50.105 05:23:51 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:50.105 05:23:51 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:50.105 05:23:51 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:50.105 05:23:51 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:50.105 05:23:51 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:50.105 05:23:51 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:50.105 05:23:51 -- common/autotest_common.sh@1330 -- # shift 00:27:50.105 05:23:51 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:50.105 05:23:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:50.105 05:23:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:50.105 05:23:51 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:50.105 05:23:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:50.105 05:23:51 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:50.105 05:23:51 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:50.105 05:23:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:50.105 05:23:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:50.105 05:23:51 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:50.105 05:23:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:50.105 05:23:51 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:50.105 05:23:51 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:50.105 05:23:51 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:50.105 05:23:51 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:50.364 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:50.364 fio-3.35 00:27:50.364 Starting 1 thread 00:27:50.364 EAL: No free 2048 kB hugepages reported on node 1 00:27:52.892 00:27:52.892 test: (groupid=0, jobs=1): err= 0: pid=3400822: Tue Nov 26 05:23:54 2024 00:27:52.892 read: IOPS=6358, BW=24.8MiB/s (26.0MB/s)(49.9MiB/2008msec) 00:27:52.892 slat (nsec): min=1947, max=122727, avg=2501.37, stdev=1738.86 00:27:52.892 clat (usec): min=973, max=170595, avg=11069.19, stdev=11329.65 00:27:52.892 lat (usec): min=975, max=170629, avg=11071.69, stdev=11329.86 00:27:52.892 clat percentiles (msec): 00:27:52.892 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:27:52.892 | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:27:52.892 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:27:52.892 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:27:52.892 | 99.99th=[ 171] 00:27:52.892 bw ( KiB/s): min=17944, max=27984, per=99.83%, avg=25390.00, stdev=4965.15, samples=4 00:27:52.892 iops : min= 4486, max= 6996, avg=6347.50, stdev=1241.29, samples=4 00:27:52.892 write: IOPS=6352, BW=24.8MiB/s (26.0MB/s)(49.8MiB/2008msec); 0 zone resets 00:27:52.892 slat (nsec): min=2050, max=92200, avg=2619.15, stdev=1454.60 00:27:52.892 clat (usec): min=378, max=169020, avg=8917.74, stdev=10640.09 00:27:52.892 lat (usec): min=381, max=169025, avg=8920.36, stdev=10640.27 00:27:52.892 clat percentiles (msec): 00:27:52.892 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:27:52.892 | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:27:52.892 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:27:52.892 | 99.00th=[ 11], 99.50th=[ 16], 99.90th=[ 169], 99.95th=[ 169], 00:27:52.892 | 99.99th=[ 169] 00:27:52.892 bw ( KiB/s): min=18920, max=27712, per=99.97%, avg=25402.00, stdev=4323.33, samples=4 00:27:52.892 iops : min= 4730, max= 6928, avg=6350.50, stdev=1080.83, samples=4 00:27:52.892 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:27:52.892 lat (msec) : 2=0.03%, 4=0.17%, 10=67.80%, 20=31.48%, 250=0.50% 00:27:52.892 cpu : usr=62.03%, sys=35.48%, ctx=106, majf=0, minf=42 00:27:52.892 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:52.892 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:52.892 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:52.892 issued rwts: total=12767,12756,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:52.892 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:52.892 00:27:52.892 Run status group 0 (all jobs): 00:27:52.892 READ: bw=24.8MiB/s (26.0MB/s), 24.8MiB/s-24.8MiB/s (26.0MB/s-26.0MB/s), io=49.9MiB (52.3MB), run=2008-2008msec 00:27:52.892 WRITE: bw=24.8MiB/s (26.0MB/s), 24.8MiB/s-24.8MiB/s (26.0MB/s-26.0MB/s), io=49.8MiB (52.2MB), run=2008-2008msec 00:27:52.892 05:23:54 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:52.892 05:23:54 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:27:54.267 05:23:55 -- host/fio.sh@64 -- # ls_nested_guid=c2ac1625-c362-4aeb-b35c-dbcea0525cc1 00:27:54.267 05:23:55 -- host/fio.sh@65 -- # get_lvs_free_mb c2ac1625-c362-4aeb-b35c-dbcea0525cc1 00:27:54.267 05:23:55 -- common/autotest_common.sh@1353 -- # local lvs_uuid=c2ac1625-c362-4aeb-b35c-dbcea0525cc1 00:27:54.267 05:23:55 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:54.267 05:23:55 -- common/autotest_common.sh@1355 -- # local fc 00:27:54.267 05:23:55 -- common/autotest_common.sh@1356 -- # local cs 00:27:54.267 05:23:55 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:54.267 05:23:56 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:54.267 { 00:27:54.267 "uuid": "82573d1c-4cf1-4c04-9442-49a6a3842b27", 00:27:54.267 "name": "lvs_0", 00:27:54.267 "base_bdev": "Nvme0n1", 00:27:54.267 "total_data_clusters": 930, 00:27:54.267 "free_clusters": 0, 00:27:54.267 "block_size": 512, 00:27:54.267 "cluster_size": 1073741824 00:27:54.267 }, 00:27:54.267 { 00:27:54.267 "uuid": "c2ac1625-c362-4aeb-b35c-dbcea0525cc1", 00:27:54.268 "name": "lvs_n_0", 00:27:54.268 "base_bdev": "f68d9a32-5c1d-45c0-8051-0528d8f552bf", 00:27:54.268 "total_data_clusters": 237847, 00:27:54.268 "free_clusters": 237847, 00:27:54.268 "block_size": 512, 00:27:54.268 "cluster_size": 4194304 00:27:54.268 } 00:27:54.268 ]' 00:27:54.268 05:23:56 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="c2ac1625-c362-4aeb-b35c-dbcea0525cc1") .free_clusters' 00:27:54.525 05:23:56 -- common/autotest_common.sh@1358 -- # fc=237847 00:27:54.525 05:23:56 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="c2ac1625-c362-4aeb-b35c-dbcea0525cc1") .cluster_size' 00:27:54.525 05:23:56 -- common/autotest_common.sh@1359 -- # cs=4194304 00:27:54.525 05:23:56 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:27:54.525 05:23:56 -- common/autotest_common.sh@1363 -- # echo 951388 00:27:54.525 951388 00:27:54.525 05:23:56 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:27:55.093 532383c7-44a2-4a43-9293-2daa7afda951 00:27:55.093 05:23:56 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:27:55.351 05:23:57 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:27:55.609 05:23:57 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:27:55.867 05:23:57 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:55.867 05:23:57 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:55.867 05:23:57 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:55.867 05:23:57 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:55.867 05:23:57 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:55.867 05:23:57 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:55.867 05:23:57 -- common/autotest_common.sh@1330 -- # shift 00:27:55.867 05:23:57 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:55.867 05:23:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:55.867 05:23:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:55.867 05:23:57 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:55.867 05:23:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:55.867 05:23:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:55.867 05:23:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:55.867 05:23:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:55.867 05:23:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:55.867 05:23:57 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:55.867 05:23:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:55.867 05:23:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:55.867 05:23:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:55.867 05:23:57 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:55.867 05:23:57 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:56.126 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:56.126 fio-3.35 00:27:56.126 Starting 1 thread 00:27:56.126 EAL: No free 2048 kB hugepages reported on node 1 00:27:58.655 00:27:58.655 test: (groupid=0, jobs=1): err= 0: pid=3401576: Tue Nov 26 05:24:00 2024 00:27:58.655 read: IOPS=6271, BW=24.5MiB/s (25.7MB/s)(49.2MiB/2008msec) 00:27:58.655 slat (nsec): min=1910, max=218823, avg=2603.38, stdev=2887.12 00:27:58.655 clat (usec): min=4368, max=19971, avg=11276.31, stdev=977.73 00:27:58.655 lat (usec): min=4387, max=19974, avg=11278.91, stdev=977.58 00:27:58.655 clat percentiles (usec): 00:27:58.655 | 1.00th=[ 8979], 5.00th=[ 9765], 10.00th=[10028], 20.00th=[10552], 00:27:58.655 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11338], 60.00th=[11469], 00:27:58.655 | 70.00th=[11731], 80.00th=[11994], 90.00th=[12387], 95.00th=[12780], 00:27:58.655 | 99.00th=[13435], 99.50th=[13698], 99.90th=[18220], 99.95th=[18482], 00:27:58.655 | 99.99th=[19792] 00:27:58.655 bw ( KiB/s): min=23960, max=25592, per=99.77%, avg=25030.00, stdev=745.34, samples=4 00:27:58.655 iops : min= 5990, max= 6398, avg=6257.50, stdev=186.34, samples=4 00:27:58.655 write: IOPS=6255, BW=24.4MiB/s (25.6MB/s)(49.1MiB/2008msec); 0 zone resets 00:27:58.655 slat (usec): min=2, max=195, avg= 2.71, stdev= 2.13 00:27:58.655 clat (usec): min=2301, max=16819, avg=9027.65, stdev=830.01 00:27:58.655 lat (usec): min=2308, max=16822, avg=9030.35, stdev=829.96 00:27:58.655 clat percentiles (usec): 00:27:58.655 | 1.00th=[ 7046], 5.00th=[ 7767], 10.00th=[ 8029], 20.00th=[ 8455], 00:27:58.655 | 30.00th=[ 8586], 40.00th=[ 8848], 50.00th=[ 8979], 60.00th=[ 9241], 00:27:58.655 | 70.00th=[ 9372], 80.00th=[ 9634], 90.00th=[10028], 95.00th=[10290], 00:27:58.655 | 99.00th=[10814], 99.50th=[11076], 99.90th=[13960], 99.95th=[15401], 00:27:58.655 | 99.99th=[16909] 00:27:58.655 bw ( KiB/s): min=24896, max=25088, per=100.00%, avg=25028.00, stdev=90.86, samples=4 00:27:58.655 iops : min= 6224, max= 6272, avg=6257.00, stdev=22.72, samples=4 00:27:58.655 lat (msec) : 4=0.04%, 10=49.21%, 20=50.75% 00:27:58.655 cpu : usr=61.53%, sys=36.12%, ctx=117, majf=0, minf=42 00:27:58.655 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:27:58.655 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:58.655 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:58.655 issued rwts: total=12594,12562,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:58.655 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:58.655 00:27:58.655 Run status group 0 (all jobs): 00:27:58.655 READ: bw=24.5MiB/s (25.7MB/s), 24.5MiB/s-24.5MiB/s (25.7MB/s-25.7MB/s), io=49.2MiB (51.6MB), run=2008-2008msec 00:27:58.655 WRITE: bw=24.4MiB/s (25.6MB/s), 24.4MiB/s-24.4MiB/s (25.6MB/s-25.6MB/s), io=49.1MiB (51.5MB), run=2008-2008msec 00:27:58.655 05:24:00 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:27:58.655 05:24:00 -- host/fio.sh@74 -- # sync 00:27:58.655 05:24:00 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:28:02.841 05:24:04 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:02.841 05:24:04 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:28:06.131 05:24:07 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:06.131 05:24:07 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:28:08.031 05:24:09 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:28:08.031 05:24:09 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:28:08.031 05:24:09 -- host/fio.sh@86 -- # nvmftestfini 00:28:08.031 05:24:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:08.031 05:24:09 -- nvmf/common.sh@116 -- # sync 00:28:08.031 05:24:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:08.031 05:24:09 -- nvmf/common.sh@119 -- # set +e 00:28:08.031 05:24:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:08.031 05:24:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:08.031 rmmod nvme_tcp 00:28:08.031 rmmod nvme_fabrics 00:28:08.031 rmmod nvme_keyring 00:28:08.031 05:24:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:08.031 05:24:09 -- nvmf/common.sh@123 -- # set -e 00:28:08.031 05:24:09 -- nvmf/common.sh@124 -- # return 0 00:28:08.031 05:24:09 -- nvmf/common.sh@477 -- # '[' -n 3398660 ']' 00:28:08.031 05:24:09 -- nvmf/common.sh@478 -- # killprocess 3398660 00:28:08.031 05:24:09 -- common/autotest_common.sh@936 -- # '[' -z 3398660 ']' 00:28:08.031 05:24:09 -- common/autotest_common.sh@940 -- # kill -0 3398660 00:28:08.031 05:24:09 -- common/autotest_common.sh@941 -- # uname 00:28:08.031 05:24:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:08.031 05:24:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3398660 00:28:08.031 05:24:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:08.031 05:24:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:08.031 05:24:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3398660' 00:28:08.031 killing process with pid 3398660 00:28:08.031 05:24:09 -- common/autotest_common.sh@955 -- # kill 3398660 00:28:08.031 05:24:09 -- common/autotest_common.sh@960 -- # wait 3398660 00:28:08.295 05:24:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:08.295 05:24:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:08.295 05:24:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:08.295 05:24:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:08.295 05:24:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:08.295 05:24:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:08.295 05:24:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:08.295 05:24:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:10.216 05:24:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:10.216 00:28:10.216 real 0m38.028s 00:28:10.216 user 2m25.778s 00:28:10.216 sys 0m6.811s 00:28:10.216 05:24:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:10.216 05:24:11 -- common/autotest_common.sh@10 -- # set +x 00:28:10.216 ************************************ 00:28:10.216 END TEST nvmf_fio_host 00:28:10.216 ************************************ 00:28:10.216 05:24:11 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:10.216 05:24:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:10.216 05:24:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:10.216 05:24:11 -- common/autotest_common.sh@10 -- # set +x 00:28:10.216 ************************************ 00:28:10.216 START TEST nvmf_failover 00:28:10.216 ************************************ 00:28:10.216 05:24:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:10.216 * Looking for test storage... 00:28:10.216 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:10.216 05:24:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:10.216 05:24:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:10.216 05:24:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:10.475 05:24:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:10.475 05:24:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:10.475 05:24:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:10.475 05:24:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:10.475 05:24:12 -- scripts/common.sh@335 -- # IFS=.-: 00:28:10.475 05:24:12 -- scripts/common.sh@335 -- # read -ra ver1 00:28:10.475 05:24:12 -- scripts/common.sh@336 -- # IFS=.-: 00:28:10.475 05:24:12 -- scripts/common.sh@336 -- # read -ra ver2 00:28:10.475 05:24:12 -- scripts/common.sh@337 -- # local 'op=<' 00:28:10.475 05:24:12 -- scripts/common.sh@339 -- # ver1_l=2 00:28:10.475 05:24:12 -- scripts/common.sh@340 -- # ver2_l=1 00:28:10.475 05:24:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:10.475 05:24:12 -- scripts/common.sh@343 -- # case "$op" in 00:28:10.475 05:24:12 -- scripts/common.sh@344 -- # : 1 00:28:10.475 05:24:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:10.475 05:24:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:10.475 05:24:12 -- scripts/common.sh@364 -- # decimal 1 00:28:10.475 05:24:12 -- scripts/common.sh@352 -- # local d=1 00:28:10.475 05:24:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:10.475 05:24:12 -- scripts/common.sh@354 -- # echo 1 00:28:10.475 05:24:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:10.475 05:24:12 -- scripts/common.sh@365 -- # decimal 2 00:28:10.475 05:24:12 -- scripts/common.sh@352 -- # local d=2 00:28:10.475 05:24:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:10.475 05:24:12 -- scripts/common.sh@354 -- # echo 2 00:28:10.475 05:24:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:10.475 05:24:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:10.475 05:24:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:10.475 05:24:12 -- scripts/common.sh@367 -- # return 0 00:28:10.475 05:24:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:10.475 05:24:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:10.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:10.475 --rc genhtml_branch_coverage=1 00:28:10.475 --rc genhtml_function_coverage=1 00:28:10.475 --rc genhtml_legend=1 00:28:10.475 --rc geninfo_all_blocks=1 00:28:10.475 --rc geninfo_unexecuted_blocks=1 00:28:10.475 00:28:10.475 ' 00:28:10.475 05:24:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:10.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:10.475 --rc genhtml_branch_coverage=1 00:28:10.475 --rc genhtml_function_coverage=1 00:28:10.475 --rc genhtml_legend=1 00:28:10.475 --rc geninfo_all_blocks=1 00:28:10.475 --rc geninfo_unexecuted_blocks=1 00:28:10.475 00:28:10.475 ' 00:28:10.475 05:24:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:10.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:10.475 --rc genhtml_branch_coverage=1 00:28:10.475 --rc genhtml_function_coverage=1 00:28:10.475 --rc genhtml_legend=1 00:28:10.475 --rc geninfo_all_blocks=1 00:28:10.475 --rc geninfo_unexecuted_blocks=1 00:28:10.475 00:28:10.475 ' 00:28:10.475 05:24:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:10.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:10.475 --rc genhtml_branch_coverage=1 00:28:10.475 --rc genhtml_function_coverage=1 00:28:10.475 --rc genhtml_legend=1 00:28:10.475 --rc geninfo_all_blocks=1 00:28:10.475 --rc geninfo_unexecuted_blocks=1 00:28:10.475 00:28:10.475 ' 00:28:10.475 05:24:12 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:10.475 05:24:12 -- nvmf/common.sh@7 -- # uname -s 00:28:10.475 05:24:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:10.475 05:24:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:10.475 05:24:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:10.475 05:24:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:10.475 05:24:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:10.475 05:24:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:10.475 05:24:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:10.475 05:24:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:10.475 05:24:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:10.475 05:24:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:10.475 05:24:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:10.475 05:24:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:10.489 05:24:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:10.489 05:24:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:10.489 05:24:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:10.489 05:24:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:10.489 05:24:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:10.489 05:24:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:10.489 05:24:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:10.489 05:24:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:10.489 05:24:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:10.490 05:24:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:10.490 05:24:12 -- paths/export.sh@5 -- # export PATH 00:28:10.490 05:24:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:10.490 05:24:12 -- nvmf/common.sh@46 -- # : 0 00:28:10.490 05:24:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:10.490 05:24:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:10.490 05:24:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:10.490 05:24:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:10.490 05:24:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:10.490 05:24:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:10.490 05:24:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:10.490 05:24:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:10.490 05:24:12 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:10.490 05:24:12 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:10.490 05:24:12 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:10.490 05:24:12 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:28:10.490 05:24:12 -- host/failover.sh@18 -- # nvmftestinit 00:28:10.490 05:24:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:10.490 05:24:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:10.490 05:24:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:10.490 05:24:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:10.490 05:24:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:10.490 05:24:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:10.490 05:24:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:10.490 05:24:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:10.490 05:24:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:10.490 05:24:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:10.490 05:24:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:10.490 05:24:12 -- common/autotest_common.sh@10 -- # set +x 00:28:12.393 05:24:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:12.393 05:24:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:12.393 05:24:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:12.393 05:24:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:12.393 05:24:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:12.393 05:24:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:12.393 05:24:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:12.393 05:24:14 -- nvmf/common.sh@294 -- # net_devs=() 00:28:12.393 05:24:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:12.393 05:24:14 -- nvmf/common.sh@295 -- # e810=() 00:28:12.393 05:24:14 -- nvmf/common.sh@295 -- # local -ga e810 00:28:12.393 05:24:14 -- nvmf/common.sh@296 -- # x722=() 00:28:12.393 05:24:14 -- nvmf/common.sh@296 -- # local -ga x722 00:28:12.393 05:24:14 -- nvmf/common.sh@297 -- # mlx=() 00:28:12.393 05:24:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:12.393 05:24:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:12.393 05:24:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:12.393 05:24:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:12.393 05:24:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:12.393 05:24:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:12.393 05:24:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:12.393 05:24:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:12.393 05:24:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:12.393 05:24:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:12.393 05:24:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:12.393 05:24:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:12.393 05:24:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:12.393 05:24:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:12.393 05:24:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:12.393 05:24:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:12.393 05:24:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:12.393 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:12.393 05:24:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:12.393 05:24:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:12.393 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:12.393 05:24:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:12.393 05:24:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:12.393 05:24:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:12.393 05:24:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:12.393 05:24:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:12.393 05:24:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:12.393 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:12.393 05:24:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:12.393 05:24:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:12.393 05:24:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:12.393 05:24:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:12.393 05:24:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:12.393 05:24:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:12.393 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:12.393 05:24:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:12.393 05:24:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:12.393 05:24:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:12.393 05:24:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:12.393 05:24:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:12.393 05:24:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:12.393 05:24:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:12.393 05:24:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:12.393 05:24:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:12.393 05:24:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:12.393 05:24:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:12.393 05:24:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:12.393 05:24:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:12.393 05:24:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:12.393 05:24:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:12.393 05:24:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:12.393 05:24:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:12.393 05:24:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:12.652 05:24:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:12.652 05:24:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:12.653 05:24:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:12.653 05:24:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:12.653 05:24:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:12.653 05:24:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:12.653 05:24:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:12.653 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:12.653 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:28:12.653 00:28:12.653 --- 10.0.0.2 ping statistics --- 00:28:12.653 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:12.653 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:28:12.653 05:24:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:12.653 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:12.653 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.145 ms 00:28:12.653 00:28:12.653 --- 10.0.0.1 ping statistics --- 00:28:12.653 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:12.653 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:28:12.653 05:24:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:12.653 05:24:14 -- nvmf/common.sh@410 -- # return 0 00:28:12.653 05:24:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:12.653 05:24:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:12.653 05:24:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:12.653 05:24:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:12.653 05:24:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:12.653 05:24:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:12.653 05:24:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:12.653 05:24:14 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:12.653 05:24:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:12.653 05:24:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:12.653 05:24:14 -- common/autotest_common.sh@10 -- # set +x 00:28:12.653 05:24:14 -- nvmf/common.sh@469 -- # nvmfpid=3405584 00:28:12.653 05:24:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:12.653 05:24:14 -- nvmf/common.sh@470 -- # waitforlisten 3405584 00:28:12.653 05:24:14 -- common/autotest_common.sh@829 -- # '[' -z 3405584 ']' 00:28:12.653 05:24:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:12.653 05:24:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:12.653 05:24:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:12.653 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:12.653 05:24:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:12.653 05:24:14 -- common/autotest_common.sh@10 -- # set +x 00:28:12.653 [2024-11-26 05:24:14.353874] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:12.653 [2024-11-26 05:24:14.353949] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:12.653 EAL: No free 2048 kB hugepages reported on node 1 00:28:12.912 [2024-11-26 05:24:14.425540] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:12.912 [2024-11-26 05:24:14.513899] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:12.912 [2024-11-26 05:24:14.514065] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:12.912 [2024-11-26 05:24:14.514085] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:12.912 [2024-11-26 05:24:14.514101] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:12.912 [2024-11-26 05:24:14.514203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:12.912 [2024-11-26 05:24:14.514301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:12.912 [2024-11-26 05:24:14.514304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:13.847 05:24:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:13.847 05:24:15 -- common/autotest_common.sh@862 -- # return 0 00:28:13.847 05:24:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:13.847 05:24:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:13.847 05:24:15 -- common/autotest_common.sh@10 -- # set +x 00:28:13.847 05:24:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:13.847 05:24:15 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:13.847 [2024-11-26 05:24:15.576770] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:13.847 05:24:15 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:14.106 Malloc0 00:28:14.106 05:24:15 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:14.364 05:24:16 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:14.622 05:24:16 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:14.880 [2024-11-26 05:24:16.610783] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:14.880 05:24:16 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:15.138 [2024-11-26 05:24:16.855421] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:15.138 05:24:16 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:15.396 [2024-11-26 05:24:17.100298] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:15.396 05:24:17 -- host/failover.sh@31 -- # bdevperf_pid=3405931 00:28:15.396 05:24:17 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:15.396 05:24:17 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:15.396 05:24:17 -- host/failover.sh@34 -- # waitforlisten 3405931 /var/tmp/bdevperf.sock 00:28:15.396 05:24:17 -- common/autotest_common.sh@829 -- # '[' -z 3405931 ']' 00:28:15.396 05:24:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:15.396 05:24:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:15.396 05:24:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:15.396 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:15.396 05:24:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:15.396 05:24:17 -- common/autotest_common.sh@10 -- # set +x 00:28:16.778 05:24:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:16.778 05:24:18 -- common/autotest_common.sh@862 -- # return 0 00:28:16.778 05:24:18 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:16.778 NVMe0n1 00:28:16.778 05:24:18 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:17.036 00:28:17.036 05:24:18 -- host/failover.sh@39 -- # run_test_pid=3406139 00:28:17.036 05:24:18 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:17.036 05:24:18 -- host/failover.sh@41 -- # sleep 1 00:28:18.031 05:24:19 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:18.290 [2024-11-26 05:24:20.036131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.290 [2024-11-26 05:24:20.036708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1137930 is same with the state(5) to be set 00:28:18.549 05:24:20 -- host/failover.sh@45 -- # sleep 3 00:28:21.837 05:24:23 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:21.837 00:28:21.838 05:24:23 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:22.096 [2024-11-26 05:24:23.752401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.096 [2024-11-26 05:24:23.752787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 [2024-11-26 05:24:23.752996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11387c0 is same with the state(5) to be set 00:28:22.097 05:24:23 -- host/failover.sh@50 -- # sleep 3 00:28:25.391 05:24:26 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:25.391 [2024-11-26 05:24:27.060410] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:25.391 05:24:27 -- host/failover.sh@55 -- # sleep 1 00:28:26.327 05:24:28 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:26.587 [2024-11-26 05:24:28.317583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.317988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.318000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.318024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.318036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 [2024-11-26 05:24:28.318047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1139310 is same with the state(5) to be set 00:28:26.587 05:24:28 -- host/failover.sh@59 -- # wait 3406139 00:28:33.165 0 00:28:33.165 05:24:33 -- host/failover.sh@61 -- # killprocess 3405931 00:28:33.165 05:24:33 -- common/autotest_common.sh@936 -- # '[' -z 3405931 ']' 00:28:33.165 05:24:33 -- common/autotest_common.sh@940 -- # kill -0 3405931 00:28:33.165 05:24:33 -- common/autotest_common.sh@941 -- # uname 00:28:33.165 05:24:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:33.165 05:24:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3405931 00:28:33.165 05:24:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:33.165 05:24:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:33.165 05:24:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3405931' 00:28:33.165 killing process with pid 3405931 00:28:33.165 05:24:33 -- common/autotest_common.sh@955 -- # kill 3405931 00:28:33.165 05:24:33 -- common/autotest_common.sh@960 -- # wait 3405931 00:28:33.165 05:24:34 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:33.165 [2024-11-26 05:24:17.155814] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:33.165 [2024-11-26 05:24:17.155911] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3405931 ] 00:28:33.165 EAL: No free 2048 kB hugepages reported on node 1 00:28:33.165 [2024-11-26 05:24:17.219254] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:33.165 [2024-11-26 05:24:17.302680] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:33.165 Running I/O for 15 seconds... 00:28:33.165 [2024-11-26 05:24:20.037034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:117928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:117952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:117992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:118000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:118008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:118024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:118048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:118056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:118064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:118080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:118096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:118104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:118112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:117352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:117360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:117368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:117376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.037964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:117384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.037985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.038009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:117392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.038031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.038057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:117448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.038089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.038113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:117456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.038135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.038160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:117464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.038179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.038204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:117472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.038227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.038265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:117480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.038291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.038330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:117488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.038353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.038385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:117496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.038406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.038434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:117504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.038464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.165 [2024-11-26 05:24:20.038487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:117512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.165 [2024-11-26 05:24:20.038508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.038531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:117528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.038553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.038578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:118120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.038597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.038621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:118160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.038644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.038669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:118168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.038727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.038754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:118176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.038779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.038805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:118184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.038827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.038850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:118192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.038873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.038899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:118200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.038918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.038946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:118208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.038970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:118216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.039037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:118224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.039094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:118232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.039144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:118240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.039196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:118248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.039243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:118256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.039287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:118264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.039331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:118272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.039379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:118280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.039435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:118288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.039482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:118296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.039534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:118304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.039591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:118312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.039637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:118320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.039709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:118328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.166 [2024-11-26 05:24:20.039767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:118336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.039816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:117576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.039858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:117592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.039907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:117616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.039951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.039977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:117632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.040011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.040033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.040055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.040080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:117664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.040102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.040125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:117688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.040147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.040173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:117712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.040196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.040223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:117736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.040245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.040270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:117760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.040293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.040315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:117768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.040335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.040361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:117776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.040385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.040410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:117816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.040428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.040452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:117824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.040488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.040514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:117832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.040535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.166 [2024-11-26 05:24:20.040555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:117848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.166 [2024-11-26 05:24:20.040577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.040603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:118344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.040624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.040644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:118352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.040679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.040727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:118360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.040751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.040775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:118368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.040796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.040820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:118376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.040848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.040872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:118384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.040895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.040921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:118392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.040943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.040965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:118400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.040993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:118408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.041042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:118416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.041089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:118424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.041136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:118432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.041182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:118440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.041229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:118448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.041273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:118456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.041323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:118464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.041375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:118472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.041432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:118480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.041481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:118488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.041531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:118496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.041590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:117856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.041638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:117864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.041707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:117872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.041764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:117880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.041807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:117888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.041855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:117896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.041897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:117904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.041947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.041983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:117912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.042016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:117920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.042063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:117936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.042108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:117944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.042158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:117960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.042203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:117968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.042243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:117976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.042289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:117984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.042345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:118016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.042391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:118504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.042436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:118512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.042489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:118520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.042547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:118528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.167 [2024-11-26 05:24:20.042589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:118536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.042637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:118544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.167 [2024-11-26 05:24:20.042680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.167 [2024-11-26 05:24:20.042714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:118552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.168 [2024-11-26 05:24:20.042750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.042775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:118560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:20.042797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.042821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:118568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.168 [2024-11-26 05:24:20.042845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.042868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:118576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:20.042888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.042912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:118584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.168 [2024-11-26 05:24:20.042936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.042965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:118592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:20.042987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:118600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:20.043054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:118608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:20.043096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:118616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:20.043145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:118032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:20.043188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:118040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:20.043235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:118072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:20.043276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:118088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:20.043322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:118128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:20.043375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:118136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:20.043419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:118144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:20.043483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1166c60 is same with the state(5) to be set 00:28:33.168 [2024-11-26 05:24:20.043531] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:33.168 [2024-11-26 05:24:20.043553] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:33.168 [2024-11-26 05:24:20.043572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118152 len:8 PRP1 0x0 PRP2 0x0 00:28:33.168 [2024-11-26 05:24:20.043591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043676] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1166c60 was disconnected and freed. reset controller. 00:28:33.168 [2024-11-26 05:24:20.043735] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:33.168 [2024-11-26 05:24:20.043790] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.168 [2024-11-26 05:24:20.043819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043843] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.168 [2024-11-26 05:24:20.043864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043886] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.168 [2024-11-26 05:24:20.043908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043931] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.168 [2024-11-26 05:24:20.043954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:20.043977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:33.168 [2024-11-26 05:24:20.044045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1148000 (9): Bad file descriptor 00:28:33.168 [2024-11-26 05:24:20.047102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:33.168 [2024-11-26 05:24:20.196152] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:33.168 [2024-11-26 05:24:23.753165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:26608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:26616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:26648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:26672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:26680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:26696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:26720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:26728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:26736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:26752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.168 [2024-11-26 05:24:23.753656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.168 [2024-11-26 05:24:23.753680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.753720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.753735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.753750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:26776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.753764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.753779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.753792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.753806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.753819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.753834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:26056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.753847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.753861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:26064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.753875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.753889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:26072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.753902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.753916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:26104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.753929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.753944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:26112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.753956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.753976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.753989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:26808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:26832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:26840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:26848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:26856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:26864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:26872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:26208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:26272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:26280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:26288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:26296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:26312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:26896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.169 [2024-11-26 05:24:23.754478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:26904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:26912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:26920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.169 [2024-11-26 05:24:23.754557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.169 [2024-11-26 05:24:23.754583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.169 [2024-11-26 05:24:23.754610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.169 [2024-11-26 05:24:23.754624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:26944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.754636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.754651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:26952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.170 [2024-11-26 05:24:23.754663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.754701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:26960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.754716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.754745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:26968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.754760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.754776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:26336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.754793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.754809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:26344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.754823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.754838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.754851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.754866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:26400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.754879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.754895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:26408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.754908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.754923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:26416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.754937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.754952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.754965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.754980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:26432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:26976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.170 [2024-11-26 05:24:23.755036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:26984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.170 [2024-11-26 05:24:23.755078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:26992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:27000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.170 [2024-11-26 05:24:23.755131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:27008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.170 [2024-11-26 05:24:23.755158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:27016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.170 [2024-11-26 05:24:23.755189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:27024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.170 [2024-11-26 05:24:23.755215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:27032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.170 [2024-11-26 05:24:23.755242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:26448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:26456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:26464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:26472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:26480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:26496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:26528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:26560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:27040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:27048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.170 [2024-11-26 05:24:23.755511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:27056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:27064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:27072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:27080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:27088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.170 [2024-11-26 05:24:23.755645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:27096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.170 [2024-11-26 05:24:23.755679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:27104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.170 [2024-11-26 05:24:23.755731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:27112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:27120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:27128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.170 [2024-11-26 05:24:23.755815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.170 [2024-11-26 05:24:23.755829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.755842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.755857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:27144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.171 [2024-11-26 05:24:23.755870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.755884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:26568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.755901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.755917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:26576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.755930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.755946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:26584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.755959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.755973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:26592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.755995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:26600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:26640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:26688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:26704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:27152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.171 [2024-11-26 05:24:23.756145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.171 [2024-11-26 05:24:23.756171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:27168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:27176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.171 [2024-11-26 05:24:23.756240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:27184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.171 [2024-11-26 05:24:23.756268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:27192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:27200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.171 [2024-11-26 05:24:23.756327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:27208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:27216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:27224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:27232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:27240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:27248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.171 [2024-11-26 05:24:23.756492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:27256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.171 [2024-11-26 05:24:23.756520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:27264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:27272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:27280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:27288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.171 [2024-11-26 05:24:23.756634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:27296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:27304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.171 [2024-11-26 05:24:23.756713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:27312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.171 [2024-11-26 05:24:23.756744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:27328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:26744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:26784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:26800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:26816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.756970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.756985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:26880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.171 [2024-11-26 05:24:23.757014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.171 [2024-11-26 05:24:23.757039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11544b0 is same with the state(5) to be set 00:28:33.172 [2024-11-26 05:24:23.757057] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:33.172 [2024-11-26 05:24:23.757068] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:33.172 [2024-11-26 05:24:23.757080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:26888 len:8 PRP1 0x0 PRP2 0x0 00:28:33.172 [2024-11-26 05:24:23.757093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:23.757152] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x11544b0 was disconnected and freed. reset controller. 00:28:33.172 [2024-11-26 05:24:23.757171] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:33.172 [2024-11-26 05:24:23.757204] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.172 [2024-11-26 05:24:23.757238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:23.757253] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.172 [2024-11-26 05:24:23.757267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:23.757281] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.172 [2024-11-26 05:24:23.757294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:23.757307] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.172 [2024-11-26 05:24:23.757320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:23.757334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:33.172 [2024-11-26 05:24:23.757385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1148000 (9): Bad file descriptor 00:28:33.172 [2024-11-26 05:24:23.759453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:33.172 [2024-11-26 05:24:23.908238] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:33.172 [2024-11-26 05:24:28.318203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:96912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:96928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:96936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:96944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:96952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:96968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:97000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:96400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:96416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:96448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:96464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:96472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:96480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:96488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:96528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:97032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:97040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:97080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:97088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:97112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:97128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.172 [2024-11-26 05:24:28.318896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:97136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.318925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:97144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.172 [2024-11-26 05:24:28.318953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.318968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:97152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.172 [2024-11-26 05:24:28.318995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.319022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:97160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.319050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.319065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:97168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.319077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.319091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:97176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.319104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.319118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:97184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.172 [2024-11-26 05:24:28.319131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.319145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:97192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.172 [2024-11-26 05:24:28.319158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.319172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:97200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.172 [2024-11-26 05:24:28.319188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.319204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:97208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.172 [2024-11-26 05:24:28.319217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.172 [2024-11-26 05:24:28.319231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:97216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.173 [2024-11-26 05:24:28.319244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:97224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.173 [2024-11-26 05:24:28.319272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:97232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:97240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.173 [2024-11-26 05:24:28.319326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:97248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:97256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:97264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:97272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.173 [2024-11-26 05:24:28.319432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:97280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:97288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:97296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.173 [2024-11-26 05:24:28.319511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:96536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:96544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:96560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:96568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:96584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:96600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:96608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:96624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:96632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:96640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:96664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:96696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:96712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:96728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.319970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:96744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.319998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.320013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:96752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.320026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.320041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:97304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.173 [2024-11-26 05:24:28.320053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.320067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:97312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.173 [2024-11-26 05:24:28.320081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.320095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:97320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.320108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.320122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:97328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.173 [2024-11-26 05:24:28.320134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.320149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:97336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.173 [2024-11-26 05:24:28.320161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.320175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:97344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.173 [2024-11-26 05:24:28.320187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.320201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:97352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.173 [2024-11-26 05:24:28.320214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.320229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:97360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.320241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.320257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:97368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.320270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.320287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:97376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.173 [2024-11-26 05:24:28.320301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.173 [2024-11-26 05:24:28.320316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:97384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:97392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.320355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:96768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:96776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:96800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:96808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:96816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:96872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:96880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:96896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:97400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:97408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.320628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:97416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.320660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:97424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:97432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.320742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:97440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:97448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:97456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:97464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.320853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:97472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:97480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.320909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:97488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.320937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:97496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.320965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.320994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:97504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.321007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:97512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.321038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:97520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.321066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:97528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.321093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:97536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.321121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:97544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.321149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:97552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.321176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:97560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.321203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:97568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.321230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:97576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.321256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:97584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.174 [2024-11-26 05:24:28.321283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:97592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.321309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:97600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.321336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:97608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.321362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:97616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.174 [2024-11-26 05:24:28.321394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.174 [2024-11-26 05:24:28.321409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:97624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.175 [2024-11-26 05:24:28.321422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:97632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.175 [2024-11-26 05:24:28.321454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:97640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.175 [2024-11-26 05:24:28.321481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:97648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:33.175 [2024-11-26 05:24:28.321511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:97656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:97664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:96904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:96920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:96960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:96976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:96984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:96992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:97008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:97016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:97024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:97048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:97056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:97064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.321957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:97072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.321986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.322001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:97096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.322024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.322039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:97104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:33.175 [2024-11-26 05:24:28.322052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.322067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1168c10 is same with the state(5) to be set 00:28:33.175 [2024-11-26 05:24:28.322084] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:33.175 [2024-11-26 05:24:28.322097] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:33.175 [2024-11-26 05:24:28.322109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:97120 len:8 PRP1 0x0 PRP2 0x0 00:28:33.175 [2024-11-26 05:24:28.322136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.322204] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1168c10 was disconnected and freed. reset controller. 00:28:33.175 [2024-11-26 05:24:28.322223] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:33.175 [2024-11-26 05:24:28.322257] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.175 [2024-11-26 05:24:28.322297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.322314] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.175 [2024-11-26 05:24:28.322328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.322342] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.175 [2024-11-26 05:24:28.322356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.322371] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.175 [2024-11-26 05:24:28.322385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.175 [2024-11-26 05:24:28.322400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:33.175 [2024-11-26 05:24:28.322441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1148000 (9): Bad file descriptor 00:28:33.175 [2024-11-26 05:24:28.324784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:33.175 [2024-11-26 05:24:28.349979] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:33.175 00:28:33.175 Latency(us) 00:28:33.175 [2024-11-26T04:24:34.943Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:33.175 [2024-11-26T04:24:34.943Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:33.175 Verification LBA range: start 0x0 length 0x4000 00:28:33.175 NVMe0n1 : 15.01 12063.18 47.12 1220.99 0.00 9618.63 606.81 14660.65 00:28:33.175 [2024-11-26T04:24:34.943Z] =================================================================================================================== 00:28:33.175 [2024-11-26T04:24:34.943Z] Total : 12063.18 47.12 1220.99 0.00 9618.63 606.81 14660.65 00:28:33.175 Received shutdown signal, test time was about 15.000000 seconds 00:28:33.175 00:28:33.175 Latency(us) 00:28:33.175 [2024-11-26T04:24:34.943Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:33.175 [2024-11-26T04:24:34.943Z] =================================================================================================================== 00:28:33.175 [2024-11-26T04:24:34.943Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:33.175 05:24:34 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:33.175 05:24:34 -- host/failover.sh@65 -- # count=3 00:28:33.175 05:24:34 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:33.175 05:24:34 -- host/failover.sh@73 -- # bdevperf_pid=3407978 00:28:33.175 05:24:34 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:33.175 05:24:34 -- host/failover.sh@75 -- # waitforlisten 3407978 /var/tmp/bdevperf.sock 00:28:33.175 05:24:34 -- common/autotest_common.sh@829 -- # '[' -z 3407978 ']' 00:28:33.175 05:24:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:33.175 05:24:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:33.175 05:24:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:33.175 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:33.175 05:24:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:33.175 05:24:34 -- common/autotest_common.sh@10 -- # set +x 00:28:33.740 05:24:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:33.740 05:24:35 -- common/autotest_common.sh@862 -- # return 0 00:28:33.741 05:24:35 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:33.741 [2024-11-26 05:24:35.449661] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:33.741 05:24:35 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:33.998 [2024-11-26 05:24:35.702368] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:33.998 05:24:35 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:34.566 NVMe0n1 00:28:34.566 05:24:36 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:34.831 00:28:34.831 05:24:36 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:35.088 00:28:35.088 05:24:36 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:35.088 05:24:36 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:35.346 05:24:37 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:35.604 05:24:37 -- host/failover.sh@87 -- # sleep 3 00:28:38.901 05:24:40 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:38.901 05:24:40 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:38.901 05:24:40 -- host/failover.sh@90 -- # run_test_pid=3408803 00:28:38.901 05:24:40 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:38.901 05:24:40 -- host/failover.sh@92 -- # wait 3408803 00:28:40.276 0 00:28:40.276 05:24:41 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:40.276 [2024-11-26 05:24:34.262239] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:40.276 [2024-11-26 05:24:34.262322] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3407978 ] 00:28:40.276 EAL: No free 2048 kB hugepages reported on node 1 00:28:40.276 [2024-11-26 05:24:34.321386] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:40.276 [2024-11-26 05:24:34.402491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:40.276 [2024-11-26 05:24:37.308472] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:40.276 [2024-11-26 05:24:37.308566] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.276 [2024-11-26 05:24:37.308589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.276 [2024-11-26 05:24:37.308605] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.276 [2024-11-26 05:24:37.308618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.276 [2024-11-26 05:24:37.308631] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.276 [2024-11-26 05:24:37.308645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.276 [2024-11-26 05:24:37.308683] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.276 [2024-11-26 05:24:37.308721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.276 [2024-11-26 05:24:37.308739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:40.276 [2024-11-26 05:24:37.308779] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:40.276 [2024-11-26 05:24:37.308811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2272000 (9): Bad file descriptor 00:28:40.276 [2024-11-26 05:24:37.441873] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:40.276 Running I/O for 1 seconds... 00:28:40.276 00:28:40.276 Latency(us) 00:28:40.276 [2024-11-26T04:24:42.044Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:40.276 [2024-11-26T04:24:42.044Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:40.276 Verification LBA range: start 0x0 length 0x4000 00:28:40.276 NVMe0n1 : 1.01 12684.53 49.55 0.00 0.00 10040.69 1225.77 17767.54 00:28:40.276 [2024-11-26T04:24:42.044Z] =================================================================================================================== 00:28:40.276 [2024-11-26T04:24:42.044Z] Total : 12684.53 49.55 0.00 0.00 10040.69 1225.77 17767.54 00:28:40.276 05:24:41 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:40.276 05:24:41 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:40.276 05:24:42 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:40.534 05:24:42 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:40.534 05:24:42 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:40.793 05:24:42 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:41.052 05:24:42 -- host/failover.sh@101 -- # sleep 3 00:28:44.342 05:24:45 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:44.342 05:24:45 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:44.342 05:24:46 -- host/failover.sh@108 -- # killprocess 3407978 00:28:44.342 05:24:46 -- common/autotest_common.sh@936 -- # '[' -z 3407978 ']' 00:28:44.342 05:24:46 -- common/autotest_common.sh@940 -- # kill -0 3407978 00:28:44.342 05:24:46 -- common/autotest_common.sh@941 -- # uname 00:28:44.342 05:24:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:44.342 05:24:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3407978 00:28:44.342 05:24:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:44.342 05:24:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:44.342 05:24:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3407978' 00:28:44.342 killing process with pid 3407978 00:28:44.342 05:24:46 -- common/autotest_common.sh@955 -- # kill 3407978 00:28:44.342 05:24:46 -- common/autotest_common.sh@960 -- # wait 3407978 00:28:44.600 05:24:46 -- host/failover.sh@110 -- # sync 00:28:44.600 05:24:46 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:44.859 05:24:46 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:44.859 05:24:46 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:44.859 05:24:46 -- host/failover.sh@116 -- # nvmftestfini 00:28:44.859 05:24:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:44.859 05:24:46 -- nvmf/common.sh@116 -- # sync 00:28:44.859 05:24:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:44.859 05:24:46 -- nvmf/common.sh@119 -- # set +e 00:28:44.859 05:24:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:44.859 05:24:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:44.859 rmmod nvme_tcp 00:28:44.859 rmmod nvme_fabrics 00:28:44.859 rmmod nvme_keyring 00:28:44.859 05:24:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:44.859 05:24:46 -- nvmf/common.sh@123 -- # set -e 00:28:44.859 05:24:46 -- nvmf/common.sh@124 -- # return 0 00:28:44.859 05:24:46 -- nvmf/common.sh@477 -- # '[' -n 3405584 ']' 00:28:44.859 05:24:46 -- nvmf/common.sh@478 -- # killprocess 3405584 00:28:44.859 05:24:46 -- common/autotest_common.sh@936 -- # '[' -z 3405584 ']' 00:28:44.859 05:24:46 -- common/autotest_common.sh@940 -- # kill -0 3405584 00:28:44.859 05:24:46 -- common/autotest_common.sh@941 -- # uname 00:28:44.859 05:24:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:44.859 05:24:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3405584 00:28:45.118 05:24:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:45.118 05:24:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:45.118 05:24:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3405584' 00:28:45.118 killing process with pid 3405584 00:28:45.118 05:24:46 -- common/autotest_common.sh@955 -- # kill 3405584 00:28:45.118 05:24:46 -- common/autotest_common.sh@960 -- # wait 3405584 00:28:45.377 05:24:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:45.377 05:24:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:45.377 05:24:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:45.377 05:24:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:45.377 05:24:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:45.377 05:24:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:45.377 05:24:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:45.377 05:24:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:47.282 05:24:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:47.282 00:28:47.282 real 0m37.030s 00:28:47.282 user 2m9.424s 00:28:47.282 sys 0m6.624s 00:28:47.282 05:24:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:47.282 05:24:48 -- common/autotest_common.sh@10 -- # set +x 00:28:47.282 ************************************ 00:28:47.282 END TEST nvmf_failover 00:28:47.282 ************************************ 00:28:47.282 05:24:48 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:47.282 05:24:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:47.282 05:24:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:47.282 05:24:48 -- common/autotest_common.sh@10 -- # set +x 00:28:47.282 ************************************ 00:28:47.282 START TEST nvmf_discovery 00:28:47.282 ************************************ 00:28:47.282 05:24:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:47.282 * Looking for test storage... 00:28:47.282 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:47.282 05:24:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:47.282 05:24:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:47.282 05:24:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:47.541 05:24:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:47.541 05:24:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:47.541 05:24:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:47.541 05:24:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:47.541 05:24:49 -- scripts/common.sh@335 -- # IFS=.-: 00:28:47.541 05:24:49 -- scripts/common.sh@335 -- # read -ra ver1 00:28:47.541 05:24:49 -- scripts/common.sh@336 -- # IFS=.-: 00:28:47.541 05:24:49 -- scripts/common.sh@336 -- # read -ra ver2 00:28:47.541 05:24:49 -- scripts/common.sh@337 -- # local 'op=<' 00:28:47.541 05:24:49 -- scripts/common.sh@339 -- # ver1_l=2 00:28:47.541 05:24:49 -- scripts/common.sh@340 -- # ver2_l=1 00:28:47.541 05:24:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:47.541 05:24:49 -- scripts/common.sh@343 -- # case "$op" in 00:28:47.541 05:24:49 -- scripts/common.sh@344 -- # : 1 00:28:47.541 05:24:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:47.541 05:24:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:47.541 05:24:49 -- scripts/common.sh@364 -- # decimal 1 00:28:47.541 05:24:49 -- scripts/common.sh@352 -- # local d=1 00:28:47.541 05:24:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:47.541 05:24:49 -- scripts/common.sh@354 -- # echo 1 00:28:47.541 05:24:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:47.541 05:24:49 -- scripts/common.sh@365 -- # decimal 2 00:28:47.541 05:24:49 -- scripts/common.sh@352 -- # local d=2 00:28:47.541 05:24:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:47.541 05:24:49 -- scripts/common.sh@354 -- # echo 2 00:28:47.541 05:24:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:47.541 05:24:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:47.541 05:24:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:47.541 05:24:49 -- scripts/common.sh@367 -- # return 0 00:28:47.541 05:24:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:47.541 05:24:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:47.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:47.541 --rc genhtml_branch_coverage=1 00:28:47.541 --rc genhtml_function_coverage=1 00:28:47.541 --rc genhtml_legend=1 00:28:47.541 --rc geninfo_all_blocks=1 00:28:47.541 --rc geninfo_unexecuted_blocks=1 00:28:47.541 00:28:47.541 ' 00:28:47.541 05:24:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:47.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:47.541 --rc genhtml_branch_coverage=1 00:28:47.541 --rc genhtml_function_coverage=1 00:28:47.541 --rc genhtml_legend=1 00:28:47.541 --rc geninfo_all_blocks=1 00:28:47.541 --rc geninfo_unexecuted_blocks=1 00:28:47.541 00:28:47.541 ' 00:28:47.541 05:24:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:47.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:47.541 --rc genhtml_branch_coverage=1 00:28:47.541 --rc genhtml_function_coverage=1 00:28:47.541 --rc genhtml_legend=1 00:28:47.541 --rc geninfo_all_blocks=1 00:28:47.541 --rc geninfo_unexecuted_blocks=1 00:28:47.541 00:28:47.541 ' 00:28:47.541 05:24:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:47.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:47.541 --rc genhtml_branch_coverage=1 00:28:47.541 --rc genhtml_function_coverage=1 00:28:47.541 --rc genhtml_legend=1 00:28:47.541 --rc geninfo_all_blocks=1 00:28:47.541 --rc geninfo_unexecuted_blocks=1 00:28:47.541 00:28:47.541 ' 00:28:47.541 05:24:49 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:47.541 05:24:49 -- nvmf/common.sh@7 -- # uname -s 00:28:47.541 05:24:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:47.541 05:24:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:47.542 05:24:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:47.542 05:24:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:47.542 05:24:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:47.542 05:24:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:47.542 05:24:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:47.542 05:24:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:47.542 05:24:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:47.542 05:24:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:47.542 05:24:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:47.542 05:24:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:47.542 05:24:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:47.542 05:24:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:47.542 05:24:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:47.542 05:24:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:47.542 05:24:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:47.542 05:24:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:47.542 05:24:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:47.542 05:24:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:47.542 05:24:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:47.542 05:24:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:47.542 05:24:49 -- paths/export.sh@5 -- # export PATH 00:28:47.542 05:24:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:47.542 05:24:49 -- nvmf/common.sh@46 -- # : 0 00:28:47.542 05:24:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:47.542 05:24:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:47.542 05:24:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:47.542 05:24:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:47.542 05:24:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:47.542 05:24:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:47.542 05:24:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:47.542 05:24:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:47.542 05:24:49 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:47.542 05:24:49 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:47.542 05:24:49 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:47.542 05:24:49 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:47.542 05:24:49 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:47.542 05:24:49 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:47.542 05:24:49 -- host/discovery.sh@25 -- # nvmftestinit 00:28:47.542 05:24:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:47.542 05:24:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:47.542 05:24:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:47.542 05:24:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:47.542 05:24:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:47.542 05:24:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:47.542 05:24:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:47.542 05:24:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:47.542 05:24:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:47.542 05:24:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:47.542 05:24:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:47.542 05:24:49 -- common/autotest_common.sh@10 -- # set +x 00:28:49.444 05:24:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:49.444 05:24:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:49.444 05:24:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:49.444 05:24:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:49.444 05:24:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:49.444 05:24:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:49.444 05:24:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:49.444 05:24:51 -- nvmf/common.sh@294 -- # net_devs=() 00:28:49.444 05:24:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:49.444 05:24:51 -- nvmf/common.sh@295 -- # e810=() 00:28:49.444 05:24:51 -- nvmf/common.sh@295 -- # local -ga e810 00:28:49.444 05:24:51 -- nvmf/common.sh@296 -- # x722=() 00:28:49.444 05:24:51 -- nvmf/common.sh@296 -- # local -ga x722 00:28:49.444 05:24:51 -- nvmf/common.sh@297 -- # mlx=() 00:28:49.444 05:24:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:49.444 05:24:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:49.444 05:24:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:49.444 05:24:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:49.444 05:24:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:49.444 05:24:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:49.444 05:24:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:49.444 05:24:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:49.444 05:24:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:49.444 05:24:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:49.444 05:24:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:49.444 05:24:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:49.444 05:24:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:49.444 05:24:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:49.444 05:24:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:49.444 05:24:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:49.444 05:24:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:49.444 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:49.444 05:24:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:49.444 05:24:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:49.444 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:49.444 05:24:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:49.444 05:24:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:49.444 05:24:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:49.444 05:24:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:49.444 05:24:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:49.444 05:24:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:49.444 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:49.444 05:24:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:49.444 05:24:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:49.444 05:24:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:49.444 05:24:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:49.444 05:24:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:49.444 05:24:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:49.444 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:49.444 05:24:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:49.444 05:24:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:49.444 05:24:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:49.444 05:24:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:49.444 05:24:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:49.444 05:24:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:49.444 05:24:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:49.444 05:24:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:49.444 05:24:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:49.444 05:24:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:49.444 05:24:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:49.444 05:24:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:49.444 05:24:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:49.444 05:24:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:49.444 05:24:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:49.444 05:24:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:49.444 05:24:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:49.444 05:24:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:49.444 05:24:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:49.444 05:24:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:49.444 05:24:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:49.704 05:24:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:49.704 05:24:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:49.704 05:24:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:49.704 05:24:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:49.704 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:49.704 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.288 ms 00:28:49.704 00:28:49.704 --- 10.0.0.2 ping statistics --- 00:28:49.704 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:49.704 rtt min/avg/max/mdev = 0.288/0.288/0.288/0.000 ms 00:28:49.704 05:24:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:49.704 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:49.704 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:28:49.704 00:28:49.704 --- 10.0.0.1 ping statistics --- 00:28:49.704 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:49.704 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:28:49.704 05:24:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:49.704 05:24:51 -- nvmf/common.sh@410 -- # return 0 00:28:49.704 05:24:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:49.704 05:24:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:49.704 05:24:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:49.704 05:24:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:49.704 05:24:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:49.704 05:24:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:49.704 05:24:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:49.704 05:24:51 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:49.704 05:24:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:49.704 05:24:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:49.704 05:24:51 -- common/autotest_common.sh@10 -- # set +x 00:28:49.704 05:24:51 -- nvmf/common.sh@469 -- # nvmfpid=3411438 00:28:49.704 05:24:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:49.704 05:24:51 -- nvmf/common.sh@470 -- # waitforlisten 3411438 00:28:49.704 05:24:51 -- common/autotest_common.sh@829 -- # '[' -z 3411438 ']' 00:28:49.704 05:24:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:49.704 05:24:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:49.704 05:24:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:49.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:49.704 05:24:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:49.704 05:24:51 -- common/autotest_common.sh@10 -- # set +x 00:28:49.704 [2024-11-26 05:24:51.333779] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:49.704 [2024-11-26 05:24:51.333867] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:49.704 EAL: No free 2048 kB hugepages reported on node 1 00:28:49.704 [2024-11-26 05:24:51.397256] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:49.962 [2024-11-26 05:24:51.479994] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:49.962 [2024-11-26 05:24:51.480155] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:49.962 [2024-11-26 05:24:51.480173] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:49.962 [2024-11-26 05:24:51.480186] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:49.962 [2024-11-26 05:24:51.480214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:50.896 05:24:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:50.896 05:24:52 -- common/autotest_common.sh@862 -- # return 0 00:28:50.896 05:24:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:50.896 05:24:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:50.896 05:24:52 -- common/autotest_common.sh@10 -- # set +x 00:28:50.896 05:24:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:50.896 05:24:52 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:50.896 05:24:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.896 05:24:52 -- common/autotest_common.sh@10 -- # set +x 00:28:50.896 [2024-11-26 05:24:52.366888] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:50.896 05:24:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.896 05:24:52 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:28:50.896 05:24:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.896 05:24:52 -- common/autotest_common.sh@10 -- # set +x 00:28:50.896 [2024-11-26 05:24:52.375080] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:50.896 05:24:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.896 05:24:52 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:28:50.896 05:24:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.896 05:24:52 -- common/autotest_common.sh@10 -- # set +x 00:28:50.896 null0 00:28:50.896 05:24:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.896 05:24:52 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:28:50.896 05:24:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.896 05:24:52 -- common/autotest_common.sh@10 -- # set +x 00:28:50.896 null1 00:28:50.896 05:24:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.896 05:24:52 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:28:50.896 05:24:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.896 05:24:52 -- common/autotest_common.sh@10 -- # set +x 00:28:50.896 05:24:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.896 05:24:52 -- host/discovery.sh@45 -- # hostpid=3411597 00:28:50.896 05:24:52 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:28:50.896 05:24:52 -- host/discovery.sh@46 -- # waitforlisten 3411597 /tmp/host.sock 00:28:50.896 05:24:52 -- common/autotest_common.sh@829 -- # '[' -z 3411597 ']' 00:28:50.896 05:24:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:50.896 05:24:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:50.896 05:24:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:50.896 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:50.896 05:24:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:50.896 05:24:52 -- common/autotest_common.sh@10 -- # set +x 00:28:50.896 [2024-11-26 05:24:52.445593] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:50.896 [2024-11-26 05:24:52.445678] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3411597 ] 00:28:50.896 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.896 [2024-11-26 05:24:52.507680] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:50.896 [2024-11-26 05:24:52.596483] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:50.896 [2024-11-26 05:24:52.596664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:51.829 05:24:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:51.829 05:24:53 -- common/autotest_common.sh@862 -- # return 0 00:28:51.829 05:24:53 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:51.830 05:24:53 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:28:51.830 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.830 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:51.830 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:51.830 05:24:53 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:28:51.830 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.830 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:51.830 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:51.830 05:24:53 -- host/discovery.sh@72 -- # notify_id=0 00:28:51.830 05:24:53 -- host/discovery.sh@78 -- # get_subsystem_names 00:28:51.830 05:24:53 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:51.830 05:24:53 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:51.830 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.830 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:51.830 05:24:53 -- host/discovery.sh@59 -- # sort 00:28:51.830 05:24:53 -- host/discovery.sh@59 -- # xargs 00:28:51.830 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:51.830 05:24:53 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:28:51.830 05:24:53 -- host/discovery.sh@79 -- # get_bdev_list 00:28:51.830 05:24:53 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:51.830 05:24:53 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:51.830 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.830 05:24:53 -- host/discovery.sh@55 -- # sort 00:28:51.830 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:51.830 05:24:53 -- host/discovery.sh@55 -- # xargs 00:28:51.830 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:51.830 05:24:53 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:28:51.830 05:24:53 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:28:51.830 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.830 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:51.830 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:51.830 05:24:53 -- host/discovery.sh@82 -- # get_subsystem_names 00:28:51.830 05:24:53 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:51.830 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.830 05:24:53 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:51.830 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:51.830 05:24:53 -- host/discovery.sh@59 -- # sort 00:28:51.830 05:24:53 -- host/discovery.sh@59 -- # xargs 00:28:51.830 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.116 05:24:53 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:28:52.116 05:24:53 -- host/discovery.sh@83 -- # get_bdev_list 00:28:52.116 05:24:53 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:52.116 05:24:53 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:52.116 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.116 05:24:53 -- host/discovery.sh@55 -- # sort 00:28:52.116 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:52.116 05:24:53 -- host/discovery.sh@55 -- # xargs 00:28:52.116 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.116 05:24:53 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:28:52.116 05:24:53 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:28:52.116 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.116 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:52.116 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.116 05:24:53 -- host/discovery.sh@86 -- # get_subsystem_names 00:28:52.116 05:24:53 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:52.116 05:24:53 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:52.116 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.116 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:52.116 05:24:53 -- host/discovery.sh@59 -- # sort 00:28:52.116 05:24:53 -- host/discovery.sh@59 -- # xargs 00:28:52.116 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.116 05:24:53 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:28:52.116 05:24:53 -- host/discovery.sh@87 -- # get_bdev_list 00:28:52.116 05:24:53 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:52.116 05:24:53 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:52.116 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.116 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:52.116 05:24:53 -- host/discovery.sh@55 -- # sort 00:28:52.116 05:24:53 -- host/discovery.sh@55 -- # xargs 00:28:52.117 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.117 05:24:53 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:28:52.117 05:24:53 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:52.117 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.117 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:52.117 [2024-11-26 05:24:53.738922] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:52.117 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.117 05:24:53 -- host/discovery.sh@92 -- # get_subsystem_names 00:28:52.117 05:24:53 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:52.117 05:24:53 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:52.117 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.117 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:52.117 05:24:53 -- host/discovery.sh@59 -- # sort 00:28:52.117 05:24:53 -- host/discovery.sh@59 -- # xargs 00:28:52.117 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.117 05:24:53 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:28:52.117 05:24:53 -- host/discovery.sh@93 -- # get_bdev_list 00:28:52.117 05:24:53 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:52.117 05:24:53 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:52.117 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.117 05:24:53 -- host/discovery.sh@55 -- # sort 00:28:52.117 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:52.117 05:24:53 -- host/discovery.sh@55 -- # xargs 00:28:52.117 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.117 05:24:53 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:28:52.117 05:24:53 -- host/discovery.sh@94 -- # get_notification_count 00:28:52.117 05:24:53 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:52.117 05:24:53 -- host/discovery.sh@74 -- # jq '. | length' 00:28:52.117 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.117 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:52.117 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.117 05:24:53 -- host/discovery.sh@74 -- # notification_count=0 00:28:52.117 05:24:53 -- host/discovery.sh@75 -- # notify_id=0 00:28:52.117 05:24:53 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:28:52.117 05:24:53 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:28:52.117 05:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.117 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:28:52.399 05:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.399 05:24:53 -- host/discovery.sh@100 -- # sleep 1 00:28:52.964 [2024-11-26 05:24:54.516459] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:52.964 [2024-11-26 05:24:54.516505] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:52.964 [2024-11-26 05:24:54.516533] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:52.964 [2024-11-26 05:24:54.644951] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:53.222 [2024-11-26 05:24:54.868439] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:53.222 [2024-11-26 05:24:54.868468] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:53.222 05:24:54 -- host/discovery.sh@101 -- # get_subsystem_names 00:28:53.222 05:24:54 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:53.222 05:24:54 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:53.222 05:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:53.222 05:24:54 -- host/discovery.sh@59 -- # sort 00:28:53.222 05:24:54 -- common/autotest_common.sh@10 -- # set +x 00:28:53.222 05:24:54 -- host/discovery.sh@59 -- # xargs 00:28:53.222 05:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:53.222 05:24:54 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:53.222 05:24:54 -- host/discovery.sh@102 -- # get_bdev_list 00:28:53.222 05:24:54 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:53.222 05:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:53.222 05:24:54 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:53.222 05:24:54 -- common/autotest_common.sh@10 -- # set +x 00:28:53.222 05:24:54 -- host/discovery.sh@55 -- # sort 00:28:53.222 05:24:54 -- host/discovery.sh@55 -- # xargs 00:28:53.222 05:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:53.222 05:24:54 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:28:53.223 05:24:54 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:28:53.223 05:24:54 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:53.223 05:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:53.223 05:24:54 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:53.223 05:24:54 -- common/autotest_common.sh@10 -- # set +x 00:28:53.223 05:24:54 -- host/discovery.sh@63 -- # sort -n 00:28:53.223 05:24:54 -- host/discovery.sh@63 -- # xargs 00:28:53.223 05:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:53.480 05:24:54 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:28:53.480 05:24:54 -- host/discovery.sh@104 -- # get_notification_count 00:28:53.480 05:24:54 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:53.480 05:24:54 -- host/discovery.sh@74 -- # jq '. | length' 00:28:53.480 05:24:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:53.480 05:24:55 -- common/autotest_common.sh@10 -- # set +x 00:28:53.480 05:24:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:53.480 05:24:55 -- host/discovery.sh@74 -- # notification_count=1 00:28:53.480 05:24:55 -- host/discovery.sh@75 -- # notify_id=1 00:28:53.480 05:24:55 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:28:53.480 05:24:55 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:28:53.480 05:24:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:53.480 05:24:55 -- common/autotest_common.sh@10 -- # set +x 00:28:53.480 05:24:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:53.480 05:24:55 -- host/discovery.sh@109 -- # sleep 1 00:28:54.414 05:24:56 -- host/discovery.sh@110 -- # get_bdev_list 00:28:54.414 05:24:56 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:54.414 05:24:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.414 05:24:56 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:54.414 05:24:56 -- common/autotest_common.sh@10 -- # set +x 00:28:54.414 05:24:56 -- host/discovery.sh@55 -- # sort 00:28:54.414 05:24:56 -- host/discovery.sh@55 -- # xargs 00:28:54.414 05:24:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.414 05:24:56 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:54.414 05:24:56 -- host/discovery.sh@111 -- # get_notification_count 00:28:54.414 05:24:56 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:28:54.414 05:24:56 -- host/discovery.sh@74 -- # jq '. | length' 00:28:54.414 05:24:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.414 05:24:56 -- common/autotest_common.sh@10 -- # set +x 00:28:54.414 05:24:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.414 05:24:56 -- host/discovery.sh@74 -- # notification_count=1 00:28:54.414 05:24:56 -- host/discovery.sh@75 -- # notify_id=2 00:28:54.414 05:24:56 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:28:54.414 05:24:56 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:28:54.414 05:24:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.414 05:24:56 -- common/autotest_common.sh@10 -- # set +x 00:28:54.414 [2024-11-26 05:24:56.134235] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:54.414 [2024-11-26 05:24:56.135168] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:54.414 [2024-11-26 05:24:56.135205] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:54.414 05:24:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.414 05:24:56 -- host/discovery.sh@117 -- # sleep 1 00:28:54.673 [2024-11-26 05:24:56.262607] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:28:54.932 [2024-11-26 05:24:56.565076] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:54.932 [2024-11-26 05:24:56.565102] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:54.932 [2024-11-26 05:24:56.565113] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:55.498 05:24:57 -- host/discovery.sh@118 -- # get_subsystem_names 00:28:55.498 05:24:57 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:55.498 05:24:57 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:55.498 05:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.498 05:24:57 -- common/autotest_common.sh@10 -- # set +x 00:28:55.498 05:24:57 -- host/discovery.sh@59 -- # sort 00:28:55.498 05:24:57 -- host/discovery.sh@59 -- # xargs 00:28:55.498 05:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.498 05:24:57 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:55.498 05:24:57 -- host/discovery.sh@119 -- # get_bdev_list 00:28:55.498 05:24:57 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:55.498 05:24:57 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:55.498 05:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.498 05:24:57 -- host/discovery.sh@55 -- # sort 00:28:55.498 05:24:57 -- common/autotest_common.sh@10 -- # set +x 00:28:55.498 05:24:57 -- host/discovery.sh@55 -- # xargs 00:28:55.498 05:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.498 05:24:57 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:55.498 05:24:57 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:28:55.498 05:24:57 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:55.498 05:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.498 05:24:57 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:55.498 05:24:57 -- common/autotest_common.sh@10 -- # set +x 00:28:55.498 05:24:57 -- host/discovery.sh@63 -- # sort -n 00:28:55.498 05:24:57 -- host/discovery.sh@63 -- # xargs 00:28:55.498 05:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.498 05:24:57 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:28:55.498 05:24:57 -- host/discovery.sh@121 -- # get_notification_count 00:28:55.498 05:24:57 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:55.498 05:24:57 -- host/discovery.sh@74 -- # jq '. | length' 00:28:55.498 05:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.498 05:24:57 -- common/autotest_common.sh@10 -- # set +x 00:28:55.757 05:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.757 05:24:57 -- host/discovery.sh@74 -- # notification_count=0 00:28:55.757 05:24:57 -- host/discovery.sh@75 -- # notify_id=2 00:28:55.757 05:24:57 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:28:55.757 05:24:57 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:55.757 05:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.757 05:24:57 -- common/autotest_common.sh@10 -- # set +x 00:28:55.757 [2024-11-26 05:24:57.302379] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:55.757 [2024-11-26 05:24:57.302415] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:55.757 05:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.757 05:24:57 -- host/discovery.sh@127 -- # sleep 1 00:28:55.757 [2024-11-26 05:24:57.311476] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.757 [2024-11-26 05:24:57.311512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.757 [2024-11-26 05:24:57.311538] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.757 [2024-11-26 05:24:57.311553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.757 [2024-11-26 05:24:57.311569] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.757 [2024-11-26 05:24:57.311600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.757 [2024-11-26 05:24:57.311614] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.757 [2024-11-26 05:24:57.311626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.758 [2024-11-26 05:24:57.311640] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5a9410 is same with the state(5) to be set 00:28:55.758 [2024-11-26 05:24:57.321479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5a9410 (9): Bad file descriptor 00:28:55.758 [2024-11-26 05:24:57.331530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:55.758 [2024-11-26 05:24:57.331793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:55.758 [2024-11-26 05:24:57.331917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:55.758 [2024-11-26 05:24:57.331945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5a9410 with addr=10.0.0.2, port=4420 00:28:55.758 [2024-11-26 05:24:57.331962] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5a9410 is same with the state(5) to be set 00:28:55.758 [2024-11-26 05:24:57.331992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5a9410 (9): Bad file descriptor 00:28:55.758 [2024-11-26 05:24:57.332014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:55.758 [2024-11-26 05:24:57.332044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:55.758 [2024-11-26 05:24:57.332061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:55.758 [2024-11-26 05:24:57.332084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:55.758 [2024-11-26 05:24:57.341621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:55.758 [2024-11-26 05:24:57.341825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:55.758 [2024-11-26 05:24:57.341963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:55.758 [2024-11-26 05:24:57.341989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5a9410 with addr=10.0.0.2, port=4420 00:28:55.758 [2024-11-26 05:24:57.342021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5a9410 is same with the state(5) to be set 00:28:55.758 [2024-11-26 05:24:57.342052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5a9410 (9): Bad file descriptor 00:28:55.758 [2024-11-26 05:24:57.342075] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:55.758 [2024-11-26 05:24:57.342090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:55.758 [2024-11-26 05:24:57.342105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:55.758 [2024-11-26 05:24:57.342133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:55.758 [2024-11-26 05:24:57.351712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:55.758 [2024-11-26 05:24:57.351901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:55.758 [2024-11-26 05:24:57.352094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:55.758 [2024-11-26 05:24:57.352123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5a9410 with addr=10.0.0.2, port=4420 00:28:55.758 [2024-11-26 05:24:57.352142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5a9410 is same with the state(5) to be set 00:28:55.758 [2024-11-26 05:24:57.352167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5a9410 (9): Bad file descriptor 00:28:55.758 [2024-11-26 05:24:57.352190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:55.758 [2024-11-26 05:24:57.352206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:55.758 [2024-11-26 05:24:57.352221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:55.758 [2024-11-26 05:24:57.352243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:55.758 [2024-11-26 05:24:57.361799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:55.758 [2024-11-26 05:24:57.361993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:55.758 [2024-11-26 05:24:57.362183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:55.758 [2024-11-26 05:24:57.362212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5a9410 with addr=10.0.0.2, port=4420 00:28:55.758 [2024-11-26 05:24:57.362230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5a9410 is same with the state(5) to be set 00:28:55.758 [2024-11-26 05:24:57.362254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5a9410 (9): Bad file descriptor 00:28:55.758 [2024-11-26 05:24:57.362277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:55.758 [2024-11-26 05:24:57.362294] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:55.758 [2024-11-26 05:24:57.362309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:55.758 [2024-11-26 05:24:57.362341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:55.758 [2024-11-26 05:24:57.371871] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:55.758 [2024-11-26 05:24:57.372102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:55.758 [2024-11-26 05:24:57.372245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:55.758 [2024-11-26 05:24:57.372275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5a9410 with addr=10.0.0.2, port=4420 00:28:55.758 [2024-11-26 05:24:57.372293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5a9410 is same with the state(5) to be set 00:28:55.758 [2024-11-26 05:24:57.372317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5a9410 (9): Bad file descriptor 00:28:55.758 [2024-11-26 05:24:57.372340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:55.758 [2024-11-26 05:24:57.372355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:55.758 [2024-11-26 05:24:57.372370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:55.758 [2024-11-26 05:24:57.372391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:55.758 [2024-11-26 05:24:57.381954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:55.758 [2024-11-26 05:24:57.382169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:55.758 [2024-11-26 05:24:57.382305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:55.758 [2024-11-26 05:24:57.382335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5a9410 with addr=10.0.0.2, port=4420 00:28:55.758 [2024-11-26 05:24:57.382352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5a9410 is same with the state(5) to be set 00:28:55.758 [2024-11-26 05:24:57.382377] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5a9410 (9): Bad file descriptor 00:28:55.758 [2024-11-26 05:24:57.382399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:55.758 [2024-11-26 05:24:57.382414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:55.758 [2024-11-26 05:24:57.382430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:55.758 [2024-11-26 05:24:57.382450] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:55.758 [2024-11-26 05:24:57.388656] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:28:55.758 [2024-11-26 05:24:57.388696] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:56.694 05:24:58 -- host/discovery.sh@128 -- # get_subsystem_names 00:28:56.694 05:24:58 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:56.694 05:24:58 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:56.694 05:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.694 05:24:58 -- common/autotest_common.sh@10 -- # set +x 00:28:56.694 05:24:58 -- host/discovery.sh@59 -- # sort 00:28:56.694 05:24:58 -- host/discovery.sh@59 -- # xargs 00:28:56.694 05:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.694 05:24:58 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:56.694 05:24:58 -- host/discovery.sh@129 -- # get_bdev_list 00:28:56.694 05:24:58 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:56.694 05:24:58 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:56.694 05:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.694 05:24:58 -- host/discovery.sh@55 -- # sort 00:28:56.694 05:24:58 -- common/autotest_common.sh@10 -- # set +x 00:28:56.694 05:24:58 -- host/discovery.sh@55 -- # xargs 00:28:56.694 05:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.694 05:24:58 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:56.694 05:24:58 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:28:56.694 05:24:58 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:56.694 05:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.694 05:24:58 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:56.694 05:24:58 -- common/autotest_common.sh@10 -- # set +x 00:28:56.694 05:24:58 -- host/discovery.sh@63 -- # sort -n 00:28:56.694 05:24:58 -- host/discovery.sh@63 -- # xargs 00:28:56.694 05:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.694 05:24:58 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:28:56.694 05:24:58 -- host/discovery.sh@131 -- # get_notification_count 00:28:56.694 05:24:58 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:56.694 05:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.694 05:24:58 -- host/discovery.sh@74 -- # jq '. | length' 00:28:56.694 05:24:58 -- common/autotest_common.sh@10 -- # set +x 00:28:56.694 05:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.953 05:24:58 -- host/discovery.sh@74 -- # notification_count=0 00:28:56.953 05:24:58 -- host/discovery.sh@75 -- # notify_id=2 00:28:56.953 05:24:58 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:28:56.953 05:24:58 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:28:56.953 05:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.953 05:24:58 -- common/autotest_common.sh@10 -- # set +x 00:28:56.953 05:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.953 05:24:58 -- host/discovery.sh@135 -- # sleep 1 00:28:57.892 05:24:59 -- host/discovery.sh@136 -- # get_subsystem_names 00:28:57.892 05:24:59 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:57.892 05:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.892 05:24:59 -- common/autotest_common.sh@10 -- # set +x 00:28:57.892 05:24:59 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:57.892 05:24:59 -- host/discovery.sh@59 -- # sort 00:28:57.892 05:24:59 -- host/discovery.sh@59 -- # xargs 00:28:57.892 05:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.892 05:24:59 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:28:57.892 05:24:59 -- host/discovery.sh@137 -- # get_bdev_list 00:28:57.892 05:24:59 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:57.892 05:24:59 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:57.892 05:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.892 05:24:59 -- host/discovery.sh@55 -- # sort 00:28:57.892 05:24:59 -- common/autotest_common.sh@10 -- # set +x 00:28:57.892 05:24:59 -- host/discovery.sh@55 -- # xargs 00:28:57.892 05:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.892 05:24:59 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:28:57.892 05:24:59 -- host/discovery.sh@138 -- # get_notification_count 00:28:57.892 05:24:59 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:57.892 05:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.892 05:24:59 -- common/autotest_common.sh@10 -- # set +x 00:28:57.892 05:24:59 -- host/discovery.sh@74 -- # jq '. | length' 00:28:57.892 05:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.892 05:24:59 -- host/discovery.sh@74 -- # notification_count=2 00:28:57.892 05:24:59 -- host/discovery.sh@75 -- # notify_id=4 00:28:57.892 05:24:59 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:28:57.892 05:24:59 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:57.892 05:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.892 05:24:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.268 [2024-11-26 05:25:00.662834] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:59.268 [2024-11-26 05:25:00.662862] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:59.268 [2024-11-26 05:25:00.662887] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:59.268 [2024-11-26 05:25:00.750203] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:28:59.527 [2024-11-26 05:25:01.059301] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:59.527 [2024-11-26 05:25:01.059359] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:59.527 05:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.527 05:25:01 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:59.527 05:25:01 -- common/autotest_common.sh@650 -- # local es=0 00:28:59.527 05:25:01 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:59.527 05:25:01 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:59.527 05:25:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:59.527 05:25:01 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:59.527 05:25:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:59.527 05:25:01 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:59.527 05:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.527 05:25:01 -- common/autotest_common.sh@10 -- # set +x 00:28:59.527 request: 00:28:59.527 { 00:28:59.527 "name": "nvme", 00:28:59.527 "trtype": "tcp", 00:28:59.527 "traddr": "10.0.0.2", 00:28:59.527 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:59.527 "adrfam": "ipv4", 00:28:59.527 "trsvcid": "8009", 00:28:59.527 "wait_for_attach": true, 00:28:59.527 "method": "bdev_nvme_start_discovery", 00:28:59.527 "req_id": 1 00:28:59.527 } 00:28:59.527 Got JSON-RPC error response 00:28:59.527 response: 00:28:59.527 { 00:28:59.527 "code": -17, 00:28:59.527 "message": "File exists" 00:28:59.527 } 00:28:59.527 05:25:01 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:59.527 05:25:01 -- common/autotest_common.sh@653 -- # es=1 00:28:59.527 05:25:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:59.527 05:25:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:59.527 05:25:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:59.527 05:25:01 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:28:59.527 05:25:01 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:59.527 05:25:01 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:59.527 05:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.527 05:25:01 -- host/discovery.sh@67 -- # sort 00:28:59.527 05:25:01 -- common/autotest_common.sh@10 -- # set +x 00:28:59.527 05:25:01 -- host/discovery.sh@67 -- # xargs 00:28:59.527 05:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.527 05:25:01 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:28:59.527 05:25:01 -- host/discovery.sh@147 -- # get_bdev_list 00:28:59.527 05:25:01 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:59.527 05:25:01 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:59.527 05:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.527 05:25:01 -- host/discovery.sh@55 -- # sort 00:28:59.527 05:25:01 -- common/autotest_common.sh@10 -- # set +x 00:28:59.527 05:25:01 -- host/discovery.sh@55 -- # xargs 00:28:59.527 05:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.527 05:25:01 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:59.527 05:25:01 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:59.527 05:25:01 -- common/autotest_common.sh@650 -- # local es=0 00:28:59.527 05:25:01 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:59.527 05:25:01 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:59.527 05:25:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:59.527 05:25:01 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:59.527 05:25:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:59.527 05:25:01 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:59.527 05:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.527 05:25:01 -- common/autotest_common.sh@10 -- # set +x 00:28:59.527 request: 00:28:59.527 { 00:28:59.527 "name": "nvme_second", 00:28:59.527 "trtype": "tcp", 00:28:59.527 "traddr": "10.0.0.2", 00:28:59.527 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:59.527 "adrfam": "ipv4", 00:28:59.527 "trsvcid": "8009", 00:28:59.527 "wait_for_attach": true, 00:28:59.527 "method": "bdev_nvme_start_discovery", 00:28:59.527 "req_id": 1 00:28:59.527 } 00:28:59.527 Got JSON-RPC error response 00:28:59.527 response: 00:28:59.527 { 00:28:59.527 "code": -17, 00:28:59.527 "message": "File exists" 00:28:59.527 } 00:28:59.527 05:25:01 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:59.527 05:25:01 -- common/autotest_common.sh@653 -- # es=1 00:28:59.527 05:25:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:59.527 05:25:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:59.527 05:25:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:59.527 05:25:01 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:28:59.527 05:25:01 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:59.527 05:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.527 05:25:01 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:59.527 05:25:01 -- common/autotest_common.sh@10 -- # set +x 00:28:59.527 05:25:01 -- host/discovery.sh@67 -- # sort 00:28:59.528 05:25:01 -- host/discovery.sh@67 -- # xargs 00:28:59.528 05:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.528 05:25:01 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:28:59.528 05:25:01 -- host/discovery.sh@153 -- # get_bdev_list 00:28:59.528 05:25:01 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:59.528 05:25:01 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:59.528 05:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.528 05:25:01 -- host/discovery.sh@55 -- # sort 00:28:59.528 05:25:01 -- common/autotest_common.sh@10 -- # set +x 00:28:59.528 05:25:01 -- host/discovery.sh@55 -- # xargs 00:28:59.528 05:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.528 05:25:01 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:59.528 05:25:01 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:59.528 05:25:01 -- common/autotest_common.sh@650 -- # local es=0 00:28:59.528 05:25:01 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:59.528 05:25:01 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:59.528 05:25:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:59.528 05:25:01 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:59.528 05:25:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:59.528 05:25:01 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:59.528 05:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.528 05:25:01 -- common/autotest_common.sh@10 -- # set +x 00:29:00.902 [2024-11-26 05:25:02.258740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:00.902 [2024-11-26 05:25:02.258946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:00.902 [2024-11-26 05:25:02.258991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5202e0 with addr=10.0.0.2, port=8010 00:29:00.902 [2024-11-26 05:25:02.259025] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:00.902 [2024-11-26 05:25:02.259043] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:00.902 [2024-11-26 05:25:02.259058] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:01.840 [2024-11-26 05:25:03.261068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:01.840 [2024-11-26 05:25:03.261232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:01.840 [2024-11-26 05:25:03.261261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5202e0 with addr=10.0.0.2, port=8010 00:29:01.840 [2024-11-26 05:25:03.261283] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:01.840 [2024-11-26 05:25:03.261297] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:01.840 [2024-11-26 05:25:03.261312] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:02.780 [2024-11-26 05:25:04.263361] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:29:02.780 request: 00:29:02.780 { 00:29:02.780 "name": "nvme_second", 00:29:02.780 "trtype": "tcp", 00:29:02.780 "traddr": "10.0.0.2", 00:29:02.780 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:02.780 "adrfam": "ipv4", 00:29:02.780 "trsvcid": "8010", 00:29:02.780 "attach_timeout_ms": 3000, 00:29:02.780 "method": "bdev_nvme_start_discovery", 00:29:02.780 "req_id": 1 00:29:02.780 } 00:29:02.780 Got JSON-RPC error response 00:29:02.780 response: 00:29:02.780 { 00:29:02.780 "code": -110, 00:29:02.780 "message": "Connection timed out" 00:29:02.780 } 00:29:02.780 05:25:04 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:02.780 05:25:04 -- common/autotest_common.sh@653 -- # es=1 00:29:02.780 05:25:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:02.780 05:25:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:02.780 05:25:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:02.780 05:25:04 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:29:02.780 05:25:04 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:02.780 05:25:04 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:02.780 05:25:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.780 05:25:04 -- host/discovery.sh@67 -- # sort 00:29:02.780 05:25:04 -- common/autotest_common.sh@10 -- # set +x 00:29:02.780 05:25:04 -- host/discovery.sh@67 -- # xargs 00:29:02.780 05:25:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.780 05:25:04 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:29:02.780 05:25:04 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:29:02.780 05:25:04 -- host/discovery.sh@162 -- # kill 3411597 00:29:02.780 05:25:04 -- host/discovery.sh@163 -- # nvmftestfini 00:29:02.780 05:25:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:02.780 05:25:04 -- nvmf/common.sh@116 -- # sync 00:29:02.780 05:25:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:02.780 05:25:04 -- nvmf/common.sh@119 -- # set +e 00:29:02.780 05:25:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:02.780 05:25:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:02.780 rmmod nvme_tcp 00:29:02.780 rmmod nvme_fabrics 00:29:02.780 rmmod nvme_keyring 00:29:02.780 05:25:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:02.780 05:25:04 -- nvmf/common.sh@123 -- # set -e 00:29:02.780 05:25:04 -- nvmf/common.sh@124 -- # return 0 00:29:02.780 05:25:04 -- nvmf/common.sh@477 -- # '[' -n 3411438 ']' 00:29:02.780 05:25:04 -- nvmf/common.sh@478 -- # killprocess 3411438 00:29:02.780 05:25:04 -- common/autotest_common.sh@936 -- # '[' -z 3411438 ']' 00:29:02.780 05:25:04 -- common/autotest_common.sh@940 -- # kill -0 3411438 00:29:02.780 05:25:04 -- common/autotest_common.sh@941 -- # uname 00:29:02.780 05:25:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:02.780 05:25:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3411438 00:29:02.780 05:25:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:02.780 05:25:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:02.780 05:25:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3411438' 00:29:02.780 killing process with pid 3411438 00:29:02.780 05:25:04 -- common/autotest_common.sh@955 -- # kill 3411438 00:29:02.780 05:25:04 -- common/autotest_common.sh@960 -- # wait 3411438 00:29:03.038 05:25:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:03.038 05:25:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:03.038 05:25:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:03.038 05:25:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:03.038 05:25:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:03.038 05:25:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:03.038 05:25:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:03.038 05:25:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:04.946 05:25:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:04.946 00:29:04.946 real 0m17.698s 00:29:04.946 user 0m27.574s 00:29:04.946 sys 0m2.903s 00:29:04.946 05:25:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:04.946 05:25:06 -- common/autotest_common.sh@10 -- # set +x 00:29:04.946 ************************************ 00:29:04.946 END TEST nvmf_discovery 00:29:04.946 ************************************ 00:29:04.946 05:25:06 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:04.946 05:25:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:04.946 05:25:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:04.946 05:25:06 -- common/autotest_common.sh@10 -- # set +x 00:29:04.946 ************************************ 00:29:04.946 START TEST nvmf_discovery_remove_ifc 00:29:04.946 ************************************ 00:29:04.946 05:25:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:05.205 * Looking for test storage... 00:29:05.205 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:05.205 05:25:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:05.205 05:25:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:05.205 05:25:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:05.205 05:25:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:05.205 05:25:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:05.205 05:25:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:05.205 05:25:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:05.205 05:25:06 -- scripts/common.sh@335 -- # IFS=.-: 00:29:05.205 05:25:06 -- scripts/common.sh@335 -- # read -ra ver1 00:29:05.205 05:25:06 -- scripts/common.sh@336 -- # IFS=.-: 00:29:05.205 05:25:06 -- scripts/common.sh@336 -- # read -ra ver2 00:29:05.205 05:25:06 -- scripts/common.sh@337 -- # local 'op=<' 00:29:05.205 05:25:06 -- scripts/common.sh@339 -- # ver1_l=2 00:29:05.205 05:25:06 -- scripts/common.sh@340 -- # ver2_l=1 00:29:05.205 05:25:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:05.205 05:25:06 -- scripts/common.sh@343 -- # case "$op" in 00:29:05.205 05:25:06 -- scripts/common.sh@344 -- # : 1 00:29:05.205 05:25:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:05.205 05:25:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:05.205 05:25:06 -- scripts/common.sh@364 -- # decimal 1 00:29:05.205 05:25:06 -- scripts/common.sh@352 -- # local d=1 00:29:05.205 05:25:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:05.205 05:25:06 -- scripts/common.sh@354 -- # echo 1 00:29:05.205 05:25:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:05.205 05:25:06 -- scripts/common.sh@365 -- # decimal 2 00:29:05.205 05:25:06 -- scripts/common.sh@352 -- # local d=2 00:29:05.205 05:25:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:05.205 05:25:06 -- scripts/common.sh@354 -- # echo 2 00:29:05.205 05:25:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:05.205 05:25:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:05.205 05:25:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:05.205 05:25:06 -- scripts/common.sh@367 -- # return 0 00:29:05.205 05:25:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:05.205 05:25:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:05.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:05.205 --rc genhtml_branch_coverage=1 00:29:05.205 --rc genhtml_function_coverage=1 00:29:05.205 --rc genhtml_legend=1 00:29:05.205 --rc geninfo_all_blocks=1 00:29:05.205 --rc geninfo_unexecuted_blocks=1 00:29:05.205 00:29:05.205 ' 00:29:05.205 05:25:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:05.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:05.205 --rc genhtml_branch_coverage=1 00:29:05.205 --rc genhtml_function_coverage=1 00:29:05.205 --rc genhtml_legend=1 00:29:05.205 --rc geninfo_all_blocks=1 00:29:05.205 --rc geninfo_unexecuted_blocks=1 00:29:05.205 00:29:05.205 ' 00:29:05.205 05:25:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:05.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:05.205 --rc genhtml_branch_coverage=1 00:29:05.205 --rc genhtml_function_coverage=1 00:29:05.205 --rc genhtml_legend=1 00:29:05.205 --rc geninfo_all_blocks=1 00:29:05.205 --rc geninfo_unexecuted_blocks=1 00:29:05.205 00:29:05.205 ' 00:29:05.205 05:25:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:05.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:05.205 --rc genhtml_branch_coverage=1 00:29:05.205 --rc genhtml_function_coverage=1 00:29:05.205 --rc genhtml_legend=1 00:29:05.205 --rc geninfo_all_blocks=1 00:29:05.205 --rc geninfo_unexecuted_blocks=1 00:29:05.205 00:29:05.205 ' 00:29:05.205 05:25:06 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:05.205 05:25:06 -- nvmf/common.sh@7 -- # uname -s 00:29:05.205 05:25:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:05.205 05:25:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:05.205 05:25:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:05.205 05:25:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:05.205 05:25:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:05.205 05:25:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:05.205 05:25:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:05.205 05:25:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:05.205 05:25:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:05.205 05:25:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:05.205 05:25:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:05.205 05:25:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:05.205 05:25:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:05.205 05:25:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:05.205 05:25:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:05.205 05:25:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:05.205 05:25:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:05.205 05:25:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:05.205 05:25:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:05.205 05:25:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.205 05:25:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.205 05:25:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.205 05:25:06 -- paths/export.sh@5 -- # export PATH 00:29:05.206 05:25:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.206 05:25:06 -- nvmf/common.sh@46 -- # : 0 00:29:05.206 05:25:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:05.206 05:25:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:05.206 05:25:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:05.206 05:25:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:05.206 05:25:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:05.206 05:25:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:05.206 05:25:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:05.206 05:25:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:05.206 05:25:06 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:29:05.206 05:25:06 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:29:05.206 05:25:06 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:29:05.206 05:25:06 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:29:05.206 05:25:06 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:29:05.206 05:25:06 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:29:05.206 05:25:06 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:29:05.206 05:25:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:05.206 05:25:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:05.206 05:25:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:05.206 05:25:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:05.206 05:25:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:05.206 05:25:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:05.206 05:25:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:05.206 05:25:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:05.206 05:25:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:05.206 05:25:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:05.206 05:25:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:05.206 05:25:06 -- common/autotest_common.sh@10 -- # set +x 00:29:07.129 05:25:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:07.129 05:25:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:07.129 05:25:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:07.129 05:25:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:07.129 05:25:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:07.129 05:25:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:07.129 05:25:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:07.129 05:25:08 -- nvmf/common.sh@294 -- # net_devs=() 00:29:07.129 05:25:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:07.129 05:25:08 -- nvmf/common.sh@295 -- # e810=() 00:29:07.129 05:25:08 -- nvmf/common.sh@295 -- # local -ga e810 00:29:07.129 05:25:08 -- nvmf/common.sh@296 -- # x722=() 00:29:07.129 05:25:08 -- nvmf/common.sh@296 -- # local -ga x722 00:29:07.129 05:25:08 -- nvmf/common.sh@297 -- # mlx=() 00:29:07.129 05:25:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:07.129 05:25:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:07.129 05:25:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:07.129 05:25:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:07.129 05:25:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:07.129 05:25:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:07.129 05:25:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:07.129 05:25:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:07.129 05:25:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:07.129 05:25:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:07.129 05:25:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:07.129 05:25:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:07.129 05:25:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:07.129 05:25:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:07.129 05:25:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:07.129 05:25:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:07.129 05:25:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:07.129 05:25:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:07.129 05:25:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:07.129 05:25:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:07.129 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:07.129 05:25:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:07.129 05:25:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:07.129 05:25:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:07.129 05:25:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:07.129 05:25:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:07.129 05:25:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:07.129 05:25:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:07.129 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:07.130 05:25:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:07.130 05:25:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:07.130 05:25:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:07.130 05:25:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:07.130 05:25:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:07.130 05:25:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:07.130 05:25:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:07.130 05:25:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:07.130 05:25:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:07.130 05:25:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:07.130 05:25:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:07.130 05:25:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:07.130 05:25:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:07.130 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:07.130 05:25:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:07.130 05:25:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:07.130 05:25:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:07.130 05:25:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:07.130 05:25:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:07.130 05:25:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:07.130 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:07.130 05:25:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:07.130 05:25:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:07.130 05:25:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:07.130 05:25:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:07.130 05:25:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:07.130 05:25:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:07.130 05:25:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:07.130 05:25:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:07.130 05:25:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:07.130 05:25:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:07.130 05:25:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:07.130 05:25:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:07.130 05:25:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:07.130 05:25:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:07.130 05:25:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:07.130 05:25:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:07.130 05:25:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:07.130 05:25:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:07.130 05:25:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:07.130 05:25:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:07.130 05:25:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:07.130 05:25:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:07.130 05:25:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:07.389 05:25:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:07.389 05:25:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:07.389 05:25:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:07.389 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:07.389 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:29:07.389 00:29:07.389 --- 10.0.0.2 ping statistics --- 00:29:07.389 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:07.389 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:29:07.389 05:25:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:07.389 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:07.389 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:29:07.389 00:29:07.389 --- 10.0.0.1 ping statistics --- 00:29:07.389 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:07.389 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:29:07.389 05:25:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:07.389 05:25:08 -- nvmf/common.sh@410 -- # return 0 00:29:07.389 05:25:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:07.389 05:25:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:07.389 05:25:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:07.389 05:25:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:07.389 05:25:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:07.389 05:25:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:07.389 05:25:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:07.389 05:25:08 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:29:07.389 05:25:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:07.389 05:25:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:07.389 05:25:08 -- common/autotest_common.sh@10 -- # set +x 00:29:07.389 05:25:08 -- nvmf/common.sh@469 -- # nvmfpid=3415199 00:29:07.389 05:25:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:07.389 05:25:08 -- nvmf/common.sh@470 -- # waitforlisten 3415199 00:29:07.389 05:25:08 -- common/autotest_common.sh@829 -- # '[' -z 3415199 ']' 00:29:07.389 05:25:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:07.389 05:25:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:07.389 05:25:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:07.389 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:07.389 05:25:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:07.389 05:25:08 -- common/autotest_common.sh@10 -- # set +x 00:29:07.389 [2024-11-26 05:25:08.998979] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:07.389 [2024-11-26 05:25:08.999060] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:07.389 EAL: No free 2048 kB hugepages reported on node 1 00:29:07.389 [2024-11-26 05:25:09.063771] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:07.389 [2024-11-26 05:25:09.151120] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:07.389 [2024-11-26 05:25:09.151276] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:07.389 [2024-11-26 05:25:09.151299] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:07.389 [2024-11-26 05:25:09.151326] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:07.389 [2024-11-26 05:25:09.151370] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:08.328 05:25:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:08.328 05:25:10 -- common/autotest_common.sh@862 -- # return 0 00:29:08.328 05:25:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:08.328 05:25:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:08.328 05:25:10 -- common/autotest_common.sh@10 -- # set +x 00:29:08.328 05:25:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:08.328 05:25:10 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:29:08.328 05:25:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.328 05:25:10 -- common/autotest_common.sh@10 -- # set +x 00:29:08.328 [2024-11-26 05:25:10.043819] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:08.328 [2024-11-26 05:25:10.052075] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:08.328 null0 00:29:08.328 [2024-11-26 05:25:10.083931] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:08.588 05:25:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.588 05:25:10 -- host/discovery_remove_ifc.sh@59 -- # hostpid=3415356 00:29:08.588 05:25:10 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 3415356 /tmp/host.sock 00:29:08.588 05:25:10 -- common/autotest_common.sh@829 -- # '[' -z 3415356 ']' 00:29:08.588 05:25:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:08.588 05:25:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:08.588 05:25:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:08.588 05:25:10 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:29:08.588 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:08.588 05:25:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:08.588 05:25:10 -- common/autotest_common.sh@10 -- # set +x 00:29:08.588 [2024-11-26 05:25:10.148266] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:08.588 [2024-11-26 05:25:10.148352] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3415356 ] 00:29:08.588 EAL: No free 2048 kB hugepages reported on node 1 00:29:08.588 [2024-11-26 05:25:10.209642] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:08.588 [2024-11-26 05:25:10.296956] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:08.588 [2024-11-26 05:25:10.297128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:08.848 05:25:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:08.848 05:25:10 -- common/autotest_common.sh@862 -- # return 0 00:29:08.848 05:25:10 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:08.848 05:25:10 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:29:08.848 05:25:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.848 05:25:10 -- common/autotest_common.sh@10 -- # set +x 00:29:08.848 05:25:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.848 05:25:10 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:29:08.848 05:25:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.848 05:25:10 -- common/autotest_common.sh@10 -- # set +x 00:29:08.848 05:25:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.848 05:25:10 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:29:08.848 05:25:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.848 05:25:10 -- common/autotest_common.sh@10 -- # set +x 00:29:09.785 [2024-11-26 05:25:11.521869] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:09.785 [2024-11-26 05:25:11.521916] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:09.785 [2024-11-26 05:25:11.521941] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:10.044 [2024-11-26 05:25:11.608211] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:10.044 [2024-11-26 05:25:11.672006] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:10.044 [2024-11-26 05:25:11.672069] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:10.044 [2024-11-26 05:25:11.672113] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:10.044 [2024-11-26 05:25:11.672140] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:10.044 [2024-11-26 05:25:11.672178] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:10.044 05:25:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:10.044 05:25:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:10.044 05:25:11 -- common/autotest_common.sh@10 -- # set +x 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:10.044 [2024-11-26 05:25:11.679766] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x865c50 was disconnected and freed. delete nvme_qpair. 00:29:10.044 05:25:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:10.044 05:25:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:10.044 05:25:11 -- common/autotest_common.sh@10 -- # set +x 00:29:10.044 05:25:11 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:10.045 05:25:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.303 05:25:11 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:10.303 05:25:11 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:11.243 05:25:12 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:11.243 05:25:12 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:11.243 05:25:12 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:11.243 05:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.243 05:25:12 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:11.243 05:25:12 -- common/autotest_common.sh@10 -- # set +x 00:29:11.243 05:25:12 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:11.243 05:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.243 05:25:12 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:11.243 05:25:12 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:12.185 05:25:13 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:12.186 05:25:13 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:12.186 05:25:13 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:12.186 05:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:12.186 05:25:13 -- common/autotest_common.sh@10 -- # set +x 00:29:12.186 05:25:13 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:12.186 05:25:13 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:12.186 05:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:12.186 05:25:13 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:12.186 05:25:13 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:13.563 05:25:14 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:13.563 05:25:14 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:13.563 05:25:14 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:13.563 05:25:14 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:13.563 05:25:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.563 05:25:14 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:13.563 05:25:14 -- common/autotest_common.sh@10 -- # set +x 00:29:13.563 05:25:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.563 05:25:14 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:13.563 05:25:14 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:14.502 05:25:15 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:14.502 05:25:15 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:14.502 05:25:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.502 05:25:15 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:14.502 05:25:15 -- common/autotest_common.sh@10 -- # set +x 00:29:14.502 05:25:15 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:14.502 05:25:15 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:14.502 05:25:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.502 05:25:15 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:14.502 05:25:15 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:15.438 05:25:16 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:15.438 05:25:16 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:15.438 05:25:16 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:15.438 05:25:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.438 05:25:16 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:15.438 05:25:16 -- common/autotest_common.sh@10 -- # set +x 00:29:15.438 05:25:16 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:15.438 05:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.438 05:25:17 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:15.438 05:25:17 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:15.438 [2024-11-26 05:25:17.113016] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:15.438 [2024-11-26 05:25:17.113108] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:15.438 [2024-11-26 05:25:17.113135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:15.438 [2024-11-26 05:25:17.113155] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:15.438 [2024-11-26 05:25:17.113169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:15.438 [2024-11-26 05:25:17.113184] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:15.438 [2024-11-26 05:25:17.113200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:15.438 [2024-11-26 05:25:17.113215] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:15.438 [2024-11-26 05:25:17.113229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:15.438 [2024-11-26 05:25:17.113247] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:15.438 [2024-11-26 05:25:17.113261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:15.438 [2024-11-26 05:25:17.113277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x82c0b0 is same with the state(5) to be set 00:29:15.438 [2024-11-26 05:25:17.123033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x82c0b0 (9): Bad file descriptor 00:29:15.438 [2024-11-26 05:25:17.133091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:16.375 05:25:18 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:16.375 05:25:18 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:16.375 05:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.375 05:25:18 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:16.375 05:25:18 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:16.375 05:25:18 -- common/autotest_common.sh@10 -- # set +x 00:29:16.375 05:25:18 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:16.634 [2024-11-26 05:25:18.145724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:17.574 [2024-11-26 05:25:19.169729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:17.574 [2024-11-26 05:25:19.169799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x82c0b0 with addr=10.0.0.2, port=4420 00:29:17.574 [2024-11-26 05:25:19.169830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x82c0b0 is same with the state(5) to be set 00:29:17.574 [2024-11-26 05:25:19.169877] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:17.574 [2024-11-26 05:25:19.169897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:17.574 [2024-11-26 05:25:19.169912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:17.574 [2024-11-26 05:25:19.169930] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:17.574 [2024-11-26 05:25:19.170392] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x82c0b0 (9): Bad file descriptor 00:29:17.574 [2024-11-26 05:25:19.170441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:17.574 [2024-11-26 05:25:19.170490] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:17.574 [2024-11-26 05:25:19.170534] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:17.574 [2024-11-26 05:25:19.170559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:17.574 [2024-11-26 05:25:19.170581] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:17.574 [2024-11-26 05:25:19.170597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:17.574 [2024-11-26 05:25:19.170612] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:17.574 [2024-11-26 05:25:19.170627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:17.575 [2024-11-26 05:25:19.170642] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:17.575 [2024-11-26 05:25:19.170657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:17.575 [2024-11-26 05:25:19.170672] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:17.575 [2024-11-26 05:25:19.170715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:17.575 [2024-11-26 05:25:19.170745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:17.575 [2024-11-26 05:25:19.170870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x82c4c0 (9): Bad file descriptor 00:29:17.575 [2024-11-26 05:25:19.171910] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:17.575 [2024-11-26 05:25:19.171932] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:17.575 05:25:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.575 05:25:19 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:17.575 05:25:19 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:18.513 05:25:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:18.513 05:25:20 -- common/autotest_common.sh@10 -- # set +x 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:18.513 05:25:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:18.513 05:25:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.513 05:25:20 -- common/autotest_common.sh@10 -- # set +x 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:18.513 05:25:20 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:18.513 05:25:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.773 05:25:20 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:18.773 05:25:20 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:19.713 [2024-11-26 05:25:21.228856] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:19.713 [2024-11-26 05:25:21.228883] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:19.713 [2024-11-26 05:25:21.228907] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:19.713 05:25:21 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:19.713 05:25:21 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:19.713 05:25:21 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:19.713 05:25:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.713 05:25:21 -- common/autotest_common.sh@10 -- # set +x 00:29:19.713 05:25:21 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:19.713 05:25:21 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:19.713 [2024-11-26 05:25:21.315216] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:19.713 05:25:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.713 05:25:21 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:19.713 05:25:21 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:19.713 [2024-11-26 05:25:21.377023] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:19.713 [2024-11-26 05:25:21.377077] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:19.713 [2024-11-26 05:25:21.377114] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:19.713 [2024-11-26 05:25:21.377140] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:19.713 [2024-11-26 05:25:21.377155] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:19.713 [2024-11-26 05:25:21.385452] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x83aa00 was disconnected and freed. delete nvme_qpair. 00:29:20.689 05:25:22 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:20.689 05:25:22 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:20.689 05:25:22 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:20.689 05:25:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.689 05:25:22 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:20.689 05:25:22 -- common/autotest_common.sh@10 -- # set +x 00:29:20.689 05:25:22 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:20.689 05:25:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.689 05:25:22 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:20.689 05:25:22 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:20.689 05:25:22 -- host/discovery_remove_ifc.sh@90 -- # killprocess 3415356 00:29:20.689 05:25:22 -- common/autotest_common.sh@936 -- # '[' -z 3415356 ']' 00:29:20.689 05:25:22 -- common/autotest_common.sh@940 -- # kill -0 3415356 00:29:20.689 05:25:22 -- common/autotest_common.sh@941 -- # uname 00:29:20.689 05:25:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:20.689 05:25:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3415356 00:29:20.689 05:25:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:20.689 05:25:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:20.689 05:25:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3415356' 00:29:20.689 killing process with pid 3415356 00:29:20.689 05:25:22 -- common/autotest_common.sh@955 -- # kill 3415356 00:29:20.689 05:25:22 -- common/autotest_common.sh@960 -- # wait 3415356 00:29:20.948 05:25:22 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:20.948 05:25:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:20.948 05:25:22 -- nvmf/common.sh@116 -- # sync 00:29:20.948 05:25:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:20.948 05:25:22 -- nvmf/common.sh@119 -- # set +e 00:29:20.948 05:25:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:20.948 05:25:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:20.948 rmmod nvme_tcp 00:29:20.948 rmmod nvme_fabrics 00:29:20.948 rmmod nvme_keyring 00:29:21.208 05:25:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:21.208 05:25:22 -- nvmf/common.sh@123 -- # set -e 00:29:21.208 05:25:22 -- nvmf/common.sh@124 -- # return 0 00:29:21.208 05:25:22 -- nvmf/common.sh@477 -- # '[' -n 3415199 ']' 00:29:21.208 05:25:22 -- nvmf/common.sh@478 -- # killprocess 3415199 00:29:21.208 05:25:22 -- common/autotest_common.sh@936 -- # '[' -z 3415199 ']' 00:29:21.208 05:25:22 -- common/autotest_common.sh@940 -- # kill -0 3415199 00:29:21.208 05:25:22 -- common/autotest_common.sh@941 -- # uname 00:29:21.208 05:25:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:21.208 05:25:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3415199 00:29:21.208 05:25:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:21.208 05:25:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:21.209 05:25:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3415199' 00:29:21.209 killing process with pid 3415199 00:29:21.209 05:25:22 -- common/autotest_common.sh@955 -- # kill 3415199 00:29:21.209 05:25:22 -- common/autotest_common.sh@960 -- # wait 3415199 00:29:21.469 05:25:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:21.469 05:25:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:21.469 05:25:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:21.469 05:25:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:21.469 05:25:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:21.469 05:25:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:21.469 05:25:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:21.469 05:25:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:23.375 05:25:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:23.375 00:29:23.375 real 0m18.348s 00:29:23.375 user 0m25.542s 00:29:23.375 sys 0m2.879s 00:29:23.375 05:25:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:23.375 05:25:25 -- common/autotest_common.sh@10 -- # set +x 00:29:23.375 ************************************ 00:29:23.375 END TEST nvmf_discovery_remove_ifc 00:29:23.375 ************************************ 00:29:23.375 05:25:25 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:23.375 05:25:25 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:23.375 05:25:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:23.375 05:25:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:23.375 05:25:25 -- common/autotest_common.sh@10 -- # set +x 00:29:23.375 ************************************ 00:29:23.375 START TEST nvmf_digest 00:29:23.375 ************************************ 00:29:23.375 05:25:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:23.375 * Looking for test storage... 00:29:23.375 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:23.375 05:25:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:23.375 05:25:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:23.375 05:25:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:23.634 05:25:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:23.634 05:25:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:23.634 05:25:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:23.634 05:25:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:23.634 05:25:25 -- scripts/common.sh@335 -- # IFS=.-: 00:29:23.634 05:25:25 -- scripts/common.sh@335 -- # read -ra ver1 00:29:23.634 05:25:25 -- scripts/common.sh@336 -- # IFS=.-: 00:29:23.634 05:25:25 -- scripts/common.sh@336 -- # read -ra ver2 00:29:23.634 05:25:25 -- scripts/common.sh@337 -- # local 'op=<' 00:29:23.634 05:25:25 -- scripts/common.sh@339 -- # ver1_l=2 00:29:23.634 05:25:25 -- scripts/common.sh@340 -- # ver2_l=1 00:29:23.634 05:25:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:23.634 05:25:25 -- scripts/common.sh@343 -- # case "$op" in 00:29:23.634 05:25:25 -- scripts/common.sh@344 -- # : 1 00:29:23.634 05:25:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:23.634 05:25:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:23.634 05:25:25 -- scripts/common.sh@364 -- # decimal 1 00:29:23.634 05:25:25 -- scripts/common.sh@352 -- # local d=1 00:29:23.634 05:25:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:23.634 05:25:25 -- scripts/common.sh@354 -- # echo 1 00:29:23.634 05:25:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:23.634 05:25:25 -- scripts/common.sh@365 -- # decimal 2 00:29:23.634 05:25:25 -- scripts/common.sh@352 -- # local d=2 00:29:23.634 05:25:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:23.634 05:25:25 -- scripts/common.sh@354 -- # echo 2 00:29:23.634 05:25:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:23.634 05:25:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:23.634 05:25:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:23.634 05:25:25 -- scripts/common.sh@367 -- # return 0 00:29:23.634 05:25:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:23.634 05:25:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:23.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:23.634 --rc genhtml_branch_coverage=1 00:29:23.634 --rc genhtml_function_coverage=1 00:29:23.634 --rc genhtml_legend=1 00:29:23.634 --rc geninfo_all_blocks=1 00:29:23.634 --rc geninfo_unexecuted_blocks=1 00:29:23.634 00:29:23.634 ' 00:29:23.634 05:25:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:23.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:23.634 --rc genhtml_branch_coverage=1 00:29:23.634 --rc genhtml_function_coverage=1 00:29:23.634 --rc genhtml_legend=1 00:29:23.634 --rc geninfo_all_blocks=1 00:29:23.634 --rc geninfo_unexecuted_blocks=1 00:29:23.634 00:29:23.634 ' 00:29:23.634 05:25:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:23.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:23.634 --rc genhtml_branch_coverage=1 00:29:23.634 --rc genhtml_function_coverage=1 00:29:23.634 --rc genhtml_legend=1 00:29:23.634 --rc geninfo_all_blocks=1 00:29:23.634 --rc geninfo_unexecuted_blocks=1 00:29:23.634 00:29:23.634 ' 00:29:23.634 05:25:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:23.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:23.634 --rc genhtml_branch_coverage=1 00:29:23.634 --rc genhtml_function_coverage=1 00:29:23.634 --rc genhtml_legend=1 00:29:23.634 --rc geninfo_all_blocks=1 00:29:23.634 --rc geninfo_unexecuted_blocks=1 00:29:23.634 00:29:23.634 ' 00:29:23.634 05:25:25 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:23.634 05:25:25 -- nvmf/common.sh@7 -- # uname -s 00:29:23.634 05:25:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:23.634 05:25:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:23.634 05:25:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:23.634 05:25:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:23.634 05:25:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:23.634 05:25:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:23.634 05:25:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:23.634 05:25:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:23.634 05:25:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:23.634 05:25:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:23.634 05:25:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:23.634 05:25:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:23.634 05:25:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:23.634 05:25:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:23.634 05:25:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:23.634 05:25:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:23.634 05:25:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:23.634 05:25:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:23.634 05:25:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:23.634 05:25:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:23.635 05:25:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:23.635 05:25:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:23.635 05:25:25 -- paths/export.sh@5 -- # export PATH 00:29:23.635 05:25:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:23.635 05:25:25 -- nvmf/common.sh@46 -- # : 0 00:29:23.635 05:25:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:23.635 05:25:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:23.635 05:25:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:23.635 05:25:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:23.635 05:25:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:23.635 05:25:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:23.635 05:25:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:23.635 05:25:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:23.635 05:25:25 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:23.635 05:25:25 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:23.635 05:25:25 -- host/digest.sh@16 -- # runtime=2 00:29:23.635 05:25:25 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:23.635 05:25:25 -- host/digest.sh@132 -- # nvmftestinit 00:29:23.635 05:25:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:23.635 05:25:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:23.635 05:25:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:23.635 05:25:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:23.635 05:25:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:23.635 05:25:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:23.635 05:25:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:23.635 05:25:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:23.635 05:25:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:23.635 05:25:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:23.635 05:25:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:23.635 05:25:25 -- common/autotest_common.sh@10 -- # set +x 00:29:25.542 05:25:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:25.542 05:25:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:25.542 05:25:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:25.542 05:25:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:25.542 05:25:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:25.542 05:25:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:25.542 05:25:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:25.542 05:25:27 -- nvmf/common.sh@294 -- # net_devs=() 00:29:25.542 05:25:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:25.542 05:25:27 -- nvmf/common.sh@295 -- # e810=() 00:29:25.542 05:25:27 -- nvmf/common.sh@295 -- # local -ga e810 00:29:25.542 05:25:27 -- nvmf/common.sh@296 -- # x722=() 00:29:25.542 05:25:27 -- nvmf/common.sh@296 -- # local -ga x722 00:29:25.542 05:25:27 -- nvmf/common.sh@297 -- # mlx=() 00:29:25.542 05:25:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:25.542 05:25:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:25.542 05:25:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:25.542 05:25:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:25.542 05:25:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:25.542 05:25:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:25.542 05:25:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:25.542 05:25:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:25.542 05:25:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:25.542 05:25:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:25.542 05:25:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:25.542 05:25:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:25.542 05:25:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:25.542 05:25:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:25.542 05:25:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:25.542 05:25:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:25.542 05:25:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:25.542 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:25.542 05:25:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:25.542 05:25:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:25.542 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:25.542 05:25:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:25.542 05:25:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:25.542 05:25:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:25.542 05:25:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:25.542 05:25:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:25.542 05:25:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:25.542 05:25:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:25.542 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:25.542 05:25:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:25.543 05:25:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:25.543 05:25:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:25.543 05:25:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:25.543 05:25:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:25.543 05:25:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:25.543 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:25.543 05:25:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:25.543 05:25:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:25.543 05:25:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:25.543 05:25:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:25.543 05:25:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:25.543 05:25:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:25.543 05:25:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:25.543 05:25:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:25.543 05:25:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:25.543 05:25:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:25.543 05:25:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:25.543 05:25:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:25.543 05:25:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:25.543 05:25:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:25.543 05:25:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:25.543 05:25:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:25.543 05:25:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:25.543 05:25:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:25.543 05:25:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:25.543 05:25:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:25.543 05:25:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:25.543 05:25:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:25.543 05:25:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:25.543 05:25:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:25.543 05:25:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:25.543 05:25:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:25.543 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:25.543 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:29:25.543 00:29:25.543 --- 10.0.0.2 ping statistics --- 00:29:25.543 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:25.543 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:29:25.543 05:25:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:25.801 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:25.802 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:29:25.802 00:29:25.802 --- 10.0.0.1 ping statistics --- 00:29:25.802 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:25.802 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:29:25.802 05:25:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:25.802 05:25:27 -- nvmf/common.sh@410 -- # return 0 00:29:25.802 05:25:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:25.802 05:25:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:25.802 05:25:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:25.802 05:25:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:25.802 05:25:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:25.802 05:25:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:25.802 05:25:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:25.802 05:25:27 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:25.802 05:25:27 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:25.802 05:25:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:25.802 05:25:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:25.802 05:25:27 -- common/autotest_common.sh@10 -- # set +x 00:29:25.802 ************************************ 00:29:25.802 START TEST nvmf_digest_clean 00:29:25.802 ************************************ 00:29:25.802 05:25:27 -- common/autotest_common.sh@1114 -- # run_digest 00:29:25.802 05:25:27 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:25.802 05:25:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:25.802 05:25:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:25.802 05:25:27 -- common/autotest_common.sh@10 -- # set +x 00:29:25.802 05:25:27 -- nvmf/common.sh@469 -- # nvmfpid=3418875 00:29:25.802 05:25:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:25.802 05:25:27 -- nvmf/common.sh@470 -- # waitforlisten 3418875 00:29:25.802 05:25:27 -- common/autotest_common.sh@829 -- # '[' -z 3418875 ']' 00:29:25.802 05:25:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:25.802 05:25:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:25.802 05:25:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:25.802 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:25.802 05:25:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:25.802 05:25:27 -- common/autotest_common.sh@10 -- # set +x 00:29:25.802 [2024-11-26 05:25:27.379388] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:25.802 [2024-11-26 05:25:27.379469] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:25.802 EAL: No free 2048 kB hugepages reported on node 1 00:29:25.802 [2024-11-26 05:25:27.449246] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:25.802 [2024-11-26 05:25:27.537722] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:25.802 [2024-11-26 05:25:27.537908] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:25.802 [2024-11-26 05:25:27.537926] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:25.802 [2024-11-26 05:25:27.537938] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:25.802 [2024-11-26 05:25:27.537981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:26.060 05:25:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:26.060 05:25:27 -- common/autotest_common.sh@862 -- # return 0 00:29:26.060 05:25:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:26.060 05:25:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:26.060 05:25:27 -- common/autotest_common.sh@10 -- # set +x 00:29:26.060 05:25:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:26.060 05:25:27 -- host/digest.sh@120 -- # common_target_config 00:29:26.060 05:25:27 -- host/digest.sh@43 -- # rpc_cmd 00:29:26.060 05:25:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.060 05:25:27 -- common/autotest_common.sh@10 -- # set +x 00:29:26.060 null0 00:29:26.060 [2024-11-26 05:25:27.777221] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:26.060 [2024-11-26 05:25:27.801500] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:26.060 05:25:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.060 05:25:27 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:26.060 05:25:27 -- host/digest.sh@77 -- # local rw bs qd 00:29:26.060 05:25:27 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:26.060 05:25:27 -- host/digest.sh@80 -- # rw=randread 00:29:26.060 05:25:27 -- host/digest.sh@80 -- # bs=4096 00:29:26.060 05:25:27 -- host/digest.sh@80 -- # qd=128 00:29:26.060 05:25:27 -- host/digest.sh@82 -- # bperfpid=3418901 00:29:26.060 05:25:27 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:26.060 05:25:27 -- host/digest.sh@83 -- # waitforlisten 3418901 /var/tmp/bperf.sock 00:29:26.060 05:25:27 -- common/autotest_common.sh@829 -- # '[' -z 3418901 ']' 00:29:26.060 05:25:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:26.060 05:25:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:26.060 05:25:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:26.060 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:26.060 05:25:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:26.060 05:25:27 -- common/autotest_common.sh@10 -- # set +x 00:29:26.317 [2024-11-26 05:25:27.849596] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:26.317 [2024-11-26 05:25:27.849684] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3418901 ] 00:29:26.317 EAL: No free 2048 kB hugepages reported on node 1 00:29:26.317 [2024-11-26 05:25:27.917470] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:26.317 [2024-11-26 05:25:28.009142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:26.317 05:25:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:26.317 05:25:28 -- common/autotest_common.sh@862 -- # return 0 00:29:26.317 05:25:28 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:26.317 05:25:28 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:26.318 05:25:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:26.886 05:25:28 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:26.886 05:25:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:27.455 nvme0n1 00:29:27.455 05:25:28 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:27.455 05:25:28 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:27.455 Running I/O for 2 seconds... 00:29:29.365 00:29:29.365 Latency(us) 00:29:29.365 [2024-11-26T04:25:31.133Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:29.365 [2024-11-26T04:25:31.133Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:29.365 nvme0n1 : 2.01 17476.63 68.27 0.00 0.00 7317.23 3398.16 18252.99 00:29:29.365 [2024-11-26T04:25:31.133Z] =================================================================================================================== 00:29:29.365 [2024-11-26T04:25:31.133Z] Total : 17476.63 68.27 0.00 0.00 7317.23 3398.16 18252.99 00:29:29.365 0 00:29:29.365 05:25:31 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:29.365 05:25:31 -- host/digest.sh@92 -- # get_accel_stats 00:29:29.365 05:25:31 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:29.365 05:25:31 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:29.365 | select(.opcode=="crc32c") 00:29:29.365 | "\(.module_name) \(.executed)"' 00:29:29.365 05:25:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:29.624 05:25:31 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:29.624 05:25:31 -- host/digest.sh@93 -- # exp_module=software 00:29:29.624 05:25:31 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:29.624 05:25:31 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:29.624 05:25:31 -- host/digest.sh@97 -- # killprocess 3418901 00:29:29.624 05:25:31 -- common/autotest_common.sh@936 -- # '[' -z 3418901 ']' 00:29:29.624 05:25:31 -- common/autotest_common.sh@940 -- # kill -0 3418901 00:29:29.624 05:25:31 -- common/autotest_common.sh@941 -- # uname 00:29:29.624 05:25:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:29.624 05:25:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3418901 00:29:29.882 05:25:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:29.882 05:25:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:29.882 05:25:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3418901' 00:29:29.882 killing process with pid 3418901 00:29:29.882 05:25:31 -- common/autotest_common.sh@955 -- # kill 3418901 00:29:29.882 Received shutdown signal, test time was about 2.000000 seconds 00:29:29.882 00:29:29.882 Latency(us) 00:29:29.882 [2024-11-26T04:25:31.650Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:29.882 [2024-11-26T04:25:31.650Z] =================================================================================================================== 00:29:29.882 [2024-11-26T04:25:31.650Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:29.882 05:25:31 -- common/autotest_common.sh@960 -- # wait 3418901 00:29:29.882 05:25:31 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:29.882 05:25:31 -- host/digest.sh@77 -- # local rw bs qd 00:29:29.882 05:25:31 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:29.882 05:25:31 -- host/digest.sh@80 -- # rw=randread 00:29:29.882 05:25:31 -- host/digest.sh@80 -- # bs=131072 00:29:29.882 05:25:31 -- host/digest.sh@80 -- # qd=16 00:29:29.882 05:25:31 -- host/digest.sh@82 -- # bperfpid=3419442 00:29:29.882 05:25:31 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:29.882 05:25:31 -- host/digest.sh@83 -- # waitforlisten 3419442 /var/tmp/bperf.sock 00:29:29.882 05:25:31 -- common/autotest_common.sh@829 -- # '[' -z 3419442 ']' 00:29:29.882 05:25:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:29.882 05:25:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:29.882 05:25:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:29.882 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:29.882 05:25:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:29.882 05:25:31 -- common/autotest_common.sh@10 -- # set +x 00:29:29.882 [2024-11-26 05:25:31.639207] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:29.882 [2024-11-26 05:25:31.639295] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3419442 ] 00:29:29.882 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:29.882 Zero copy mechanism will not be used. 00:29:30.140 EAL: No free 2048 kB hugepages reported on node 1 00:29:30.140 [2024-11-26 05:25:31.702967] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:30.140 [2024-11-26 05:25:31.788748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:30.140 05:25:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:30.140 05:25:31 -- common/autotest_common.sh@862 -- # return 0 00:29:30.140 05:25:31 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:30.140 05:25:31 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:30.140 05:25:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:30.706 05:25:32 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:30.706 05:25:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:30.966 nvme0n1 00:29:30.966 05:25:32 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:30.966 05:25:32 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:30.966 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:30.966 Zero copy mechanism will not be used. 00:29:30.966 Running I/O for 2 seconds... 00:29:32.875 00:29:32.875 Latency(us) 00:29:32.875 [2024-11-26T04:25:34.643Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:32.875 [2024-11-26T04:25:34.643Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:32.875 nvme0n1 : 2.00 5674.06 709.26 0.00 0.00 2816.03 910.22 5437.06 00:29:32.875 [2024-11-26T04:25:34.643Z] =================================================================================================================== 00:29:32.875 [2024-11-26T04:25:34.643Z] Total : 5674.06 709.26 0.00 0.00 2816.03 910.22 5437.06 00:29:32.875 0 00:29:33.133 05:25:34 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:33.134 05:25:34 -- host/digest.sh@92 -- # get_accel_stats 00:29:33.134 05:25:34 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:33.134 05:25:34 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:33.134 | select(.opcode=="crc32c") 00:29:33.134 | "\(.module_name) \(.executed)"' 00:29:33.134 05:25:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:33.392 05:25:34 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:33.392 05:25:34 -- host/digest.sh@93 -- # exp_module=software 00:29:33.392 05:25:34 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:33.392 05:25:34 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:33.392 05:25:34 -- host/digest.sh@97 -- # killprocess 3419442 00:29:33.392 05:25:34 -- common/autotest_common.sh@936 -- # '[' -z 3419442 ']' 00:29:33.392 05:25:34 -- common/autotest_common.sh@940 -- # kill -0 3419442 00:29:33.392 05:25:34 -- common/autotest_common.sh@941 -- # uname 00:29:33.392 05:25:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:33.392 05:25:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3419442 00:29:33.392 05:25:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:33.392 05:25:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:33.392 05:25:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3419442' 00:29:33.392 killing process with pid 3419442 00:29:33.392 05:25:34 -- common/autotest_common.sh@955 -- # kill 3419442 00:29:33.392 Received shutdown signal, test time was about 2.000000 seconds 00:29:33.392 00:29:33.392 Latency(us) 00:29:33.392 [2024-11-26T04:25:35.160Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:33.392 [2024-11-26T04:25:35.160Z] =================================================================================================================== 00:29:33.392 [2024-11-26T04:25:35.160Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:33.392 05:25:34 -- common/autotest_common.sh@960 -- # wait 3419442 00:29:33.392 05:25:35 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:33.392 05:25:35 -- host/digest.sh@77 -- # local rw bs qd 00:29:33.392 05:25:35 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:33.392 05:25:35 -- host/digest.sh@80 -- # rw=randwrite 00:29:33.392 05:25:35 -- host/digest.sh@80 -- # bs=4096 00:29:33.392 05:25:35 -- host/digest.sh@80 -- # qd=128 00:29:33.392 05:25:35 -- host/digest.sh@82 -- # bperfpid=3419857 00:29:33.392 05:25:35 -- host/digest.sh@83 -- # waitforlisten 3419857 /var/tmp/bperf.sock 00:29:33.392 05:25:35 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:33.392 05:25:35 -- common/autotest_common.sh@829 -- # '[' -z 3419857 ']' 00:29:33.392 05:25:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:33.392 05:25:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:33.392 05:25:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:33.392 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:33.392 05:25:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:33.392 05:25:35 -- common/autotest_common.sh@10 -- # set +x 00:29:33.650 [2024-11-26 05:25:35.181645] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:33.650 [2024-11-26 05:25:35.181752] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3419857 ] 00:29:33.650 EAL: No free 2048 kB hugepages reported on node 1 00:29:33.650 [2024-11-26 05:25:35.242034] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:33.650 [2024-11-26 05:25:35.325124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:33.650 05:25:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:33.650 05:25:35 -- common/autotest_common.sh@862 -- # return 0 00:29:33.650 05:25:35 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:33.650 05:25:35 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:33.650 05:25:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:34.216 05:25:35 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:34.216 05:25:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:34.474 nvme0n1 00:29:34.474 05:25:36 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:34.474 05:25:36 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:34.731 Running I/O for 2 seconds... 00:29:36.633 00:29:36.634 Latency(us) 00:29:36.634 [2024-11-26T04:25:38.402Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:36.634 [2024-11-26T04:25:38.402Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:36.634 nvme0n1 : 2.00 18885.81 73.77 0.00 0.00 6770.66 3810.80 16990.81 00:29:36.634 [2024-11-26T04:25:38.402Z] =================================================================================================================== 00:29:36.634 [2024-11-26T04:25:38.402Z] Total : 18885.81 73.77 0.00 0.00 6770.66 3810.80 16990.81 00:29:36.634 0 00:29:36.634 05:25:38 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:36.634 05:25:38 -- host/digest.sh@92 -- # get_accel_stats 00:29:36.634 05:25:38 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:36.634 05:25:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:36.634 05:25:38 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:36.634 | select(.opcode=="crc32c") 00:29:36.634 | "\(.module_name) \(.executed)"' 00:29:36.892 05:25:38 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:36.892 05:25:38 -- host/digest.sh@93 -- # exp_module=software 00:29:36.892 05:25:38 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:36.892 05:25:38 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:36.892 05:25:38 -- host/digest.sh@97 -- # killprocess 3419857 00:29:36.892 05:25:38 -- common/autotest_common.sh@936 -- # '[' -z 3419857 ']' 00:29:36.892 05:25:38 -- common/autotest_common.sh@940 -- # kill -0 3419857 00:29:36.892 05:25:38 -- common/autotest_common.sh@941 -- # uname 00:29:36.892 05:25:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:36.892 05:25:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3419857 00:29:36.892 05:25:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:36.892 05:25:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:36.892 05:25:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3419857' 00:29:36.892 killing process with pid 3419857 00:29:36.892 05:25:38 -- common/autotest_common.sh@955 -- # kill 3419857 00:29:36.892 Received shutdown signal, test time was about 2.000000 seconds 00:29:36.892 00:29:36.892 Latency(us) 00:29:36.892 [2024-11-26T04:25:38.660Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:36.892 [2024-11-26T04:25:38.660Z] =================================================================================================================== 00:29:36.892 [2024-11-26T04:25:38.660Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:36.892 05:25:38 -- common/autotest_common.sh@960 -- # wait 3419857 00:29:37.150 05:25:38 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:37.150 05:25:38 -- host/digest.sh@77 -- # local rw bs qd 00:29:37.150 05:25:38 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:37.150 05:25:38 -- host/digest.sh@80 -- # rw=randwrite 00:29:37.150 05:25:38 -- host/digest.sh@80 -- # bs=131072 00:29:37.150 05:25:38 -- host/digest.sh@80 -- # qd=16 00:29:37.150 05:25:38 -- host/digest.sh@82 -- # bperfpid=3420281 00:29:37.150 05:25:38 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:37.150 05:25:38 -- host/digest.sh@83 -- # waitforlisten 3420281 /var/tmp/bperf.sock 00:29:37.150 05:25:38 -- common/autotest_common.sh@829 -- # '[' -z 3420281 ']' 00:29:37.150 05:25:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:37.150 05:25:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:37.150 05:25:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:37.150 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:37.150 05:25:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:37.150 05:25:38 -- common/autotest_common.sh@10 -- # set +x 00:29:37.150 [2024-11-26 05:25:38.868299] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:37.150 [2024-11-26 05:25:38.868385] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3420281 ] 00:29:37.150 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:37.150 Zero copy mechanism will not be used. 00:29:37.150 EAL: No free 2048 kB hugepages reported on node 1 00:29:37.408 [2024-11-26 05:25:38.927269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:37.408 [2024-11-26 05:25:39.010457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:37.408 05:25:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:37.408 05:25:39 -- common/autotest_common.sh@862 -- # return 0 00:29:37.408 05:25:39 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:37.408 05:25:39 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:37.408 05:25:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:37.977 05:25:39 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:37.977 05:25:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:38.237 nvme0n1 00:29:38.237 05:25:39 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:38.237 05:25:39 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:38.237 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:38.237 Zero copy mechanism will not be used. 00:29:38.237 Running I/O for 2 seconds... 00:29:40.769 00:29:40.769 Latency(us) 00:29:40.769 [2024-11-26T04:25:42.537Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:40.769 [2024-11-26T04:25:42.537Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:40.769 nvme0n1 : 2.00 5570.68 696.33 0.00 0.00 2865.05 2002.49 10922.67 00:29:40.769 [2024-11-26T04:25:42.537Z] =================================================================================================================== 00:29:40.769 [2024-11-26T04:25:42.537Z] Total : 5570.68 696.33 0.00 0.00 2865.05 2002.49 10922.67 00:29:40.769 0 00:29:40.769 05:25:42 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:40.769 05:25:42 -- host/digest.sh@92 -- # get_accel_stats 00:29:40.769 05:25:42 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:40.769 05:25:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:40.769 05:25:42 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:40.769 | select(.opcode=="crc32c") 00:29:40.769 | "\(.module_name) \(.executed)"' 00:29:40.769 05:25:42 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:40.769 05:25:42 -- host/digest.sh@93 -- # exp_module=software 00:29:40.769 05:25:42 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:40.769 05:25:42 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:40.769 05:25:42 -- host/digest.sh@97 -- # killprocess 3420281 00:29:40.769 05:25:42 -- common/autotest_common.sh@936 -- # '[' -z 3420281 ']' 00:29:40.769 05:25:42 -- common/autotest_common.sh@940 -- # kill -0 3420281 00:29:40.770 05:25:42 -- common/autotest_common.sh@941 -- # uname 00:29:40.770 05:25:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:40.770 05:25:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3420281 00:29:40.770 05:25:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:40.770 05:25:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:40.770 05:25:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3420281' 00:29:40.770 killing process with pid 3420281 00:29:40.770 05:25:42 -- common/autotest_common.sh@955 -- # kill 3420281 00:29:40.770 Received shutdown signal, test time was about 2.000000 seconds 00:29:40.770 00:29:40.770 Latency(us) 00:29:40.770 [2024-11-26T04:25:42.538Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:40.770 [2024-11-26T04:25:42.538Z] =================================================================================================================== 00:29:40.770 [2024-11-26T04:25:42.538Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:40.770 05:25:42 -- common/autotest_common.sh@960 -- # wait 3420281 00:29:40.770 05:25:42 -- host/digest.sh@126 -- # killprocess 3418875 00:29:40.770 05:25:42 -- common/autotest_common.sh@936 -- # '[' -z 3418875 ']' 00:29:40.770 05:25:42 -- common/autotest_common.sh@940 -- # kill -0 3418875 00:29:40.770 05:25:42 -- common/autotest_common.sh@941 -- # uname 00:29:40.770 05:25:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:40.770 05:25:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3418875 00:29:41.030 05:25:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:41.030 05:25:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:41.030 05:25:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3418875' 00:29:41.030 killing process with pid 3418875 00:29:41.030 05:25:42 -- common/autotest_common.sh@955 -- # kill 3418875 00:29:41.030 05:25:42 -- common/autotest_common.sh@960 -- # wait 3418875 00:29:41.030 00:29:41.030 real 0m15.417s 00:29:41.030 user 0m30.373s 00:29:41.030 sys 0m4.366s 00:29:41.030 05:25:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:41.030 05:25:42 -- common/autotest_common.sh@10 -- # set +x 00:29:41.030 ************************************ 00:29:41.030 END TEST nvmf_digest_clean 00:29:41.030 ************************************ 00:29:41.030 05:25:42 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:41.030 05:25:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:41.030 05:25:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:41.030 05:25:42 -- common/autotest_common.sh@10 -- # set +x 00:29:41.030 ************************************ 00:29:41.030 START TEST nvmf_digest_error 00:29:41.030 ************************************ 00:29:41.030 05:25:42 -- common/autotest_common.sh@1114 -- # run_digest_error 00:29:41.030 05:25:42 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:41.030 05:25:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:41.030 05:25:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:41.030 05:25:42 -- common/autotest_common.sh@10 -- # set +x 00:29:41.030 05:25:42 -- nvmf/common.sh@469 -- # nvmfpid=3420851 00:29:41.030 05:25:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:41.030 05:25:42 -- nvmf/common.sh@470 -- # waitforlisten 3420851 00:29:41.030 05:25:42 -- common/autotest_common.sh@829 -- # '[' -z 3420851 ']' 00:29:41.030 05:25:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:41.030 05:25:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:41.030 05:25:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:41.030 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:41.030 05:25:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:41.030 05:25:42 -- common/autotest_common.sh@10 -- # set +x 00:29:41.289 [2024-11-26 05:25:42.832605] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:41.289 [2024-11-26 05:25:42.832720] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:41.289 EAL: No free 2048 kB hugepages reported on node 1 00:29:41.289 [2024-11-26 05:25:42.896878] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:41.289 [2024-11-26 05:25:42.982477] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:41.289 [2024-11-26 05:25:42.982631] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:41.289 [2024-11-26 05:25:42.982647] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:41.289 [2024-11-26 05:25:42.982683] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:41.289 [2024-11-26 05:25:42.982724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:41.289 05:25:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:41.289 05:25:43 -- common/autotest_common.sh@862 -- # return 0 00:29:41.289 05:25:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:41.289 05:25:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:41.289 05:25:43 -- common/autotest_common.sh@10 -- # set +x 00:29:41.547 05:25:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:41.547 05:25:43 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:41.547 05:25:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:41.547 05:25:43 -- common/autotest_common.sh@10 -- # set +x 00:29:41.547 [2024-11-26 05:25:43.075408] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:41.547 05:25:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:41.547 05:25:43 -- host/digest.sh@104 -- # common_target_config 00:29:41.548 05:25:43 -- host/digest.sh@43 -- # rpc_cmd 00:29:41.548 05:25:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:41.548 05:25:43 -- common/autotest_common.sh@10 -- # set +x 00:29:41.548 null0 00:29:41.548 [2024-11-26 05:25:43.194112] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:41.548 [2024-11-26 05:25:43.218405] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:41.548 05:25:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:41.548 05:25:43 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:41.548 05:25:43 -- host/digest.sh@54 -- # local rw bs qd 00:29:41.548 05:25:43 -- host/digest.sh@56 -- # rw=randread 00:29:41.548 05:25:43 -- host/digest.sh@56 -- # bs=4096 00:29:41.548 05:25:43 -- host/digest.sh@56 -- # qd=128 00:29:41.548 05:25:43 -- host/digest.sh@58 -- # bperfpid=3420870 00:29:41.548 05:25:43 -- host/digest.sh@60 -- # waitforlisten 3420870 /var/tmp/bperf.sock 00:29:41.548 05:25:43 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:41.548 05:25:43 -- common/autotest_common.sh@829 -- # '[' -z 3420870 ']' 00:29:41.548 05:25:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:41.548 05:25:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:41.548 05:25:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:41.548 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:41.548 05:25:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:41.548 05:25:43 -- common/autotest_common.sh@10 -- # set +x 00:29:41.548 [2024-11-26 05:25:43.264071] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:41.548 [2024-11-26 05:25:43.264134] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3420870 ] 00:29:41.548 EAL: No free 2048 kB hugepages reported on node 1 00:29:41.805 [2024-11-26 05:25:43.326170] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:41.805 [2024-11-26 05:25:43.415335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:41.805 05:25:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:41.805 05:25:43 -- common/autotest_common.sh@862 -- # return 0 00:29:41.805 05:25:43 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:41.805 05:25:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:42.064 05:25:43 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:42.064 05:25:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:42.064 05:25:43 -- common/autotest_common.sh@10 -- # set +x 00:29:42.064 05:25:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:42.064 05:25:43 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:42.064 05:25:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:42.630 nvme0n1 00:29:42.630 05:25:44 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:42.630 05:25:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:42.630 05:25:44 -- common/autotest_common.sh@10 -- # set +x 00:29:42.630 05:25:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:42.630 05:25:44 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:42.630 05:25:44 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:42.630 Running I/O for 2 seconds... 00:29:42.630 [2024-11-26 05:25:44.313388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.630 [2024-11-26 05:25:44.313451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15986 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.630 [2024-11-26 05:25:44.313474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.630 [2024-11-26 05:25:44.329146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.630 [2024-11-26 05:25:44.329184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1847 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.630 [2024-11-26 05:25:44.329209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.630 [2024-11-26 05:25:44.340909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.630 [2024-11-26 05:25:44.340940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:15822 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.630 [2024-11-26 05:25:44.340961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.630 [2024-11-26 05:25:44.358896] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.630 [2024-11-26 05:25:44.358942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:4532 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.630 [2024-11-26 05:25:44.358963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.630 [2024-11-26 05:25:44.375104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.630 [2024-11-26 05:25:44.375139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:18591 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.630 [2024-11-26 05:25:44.375161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.630 [2024-11-26 05:25:44.390611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.630 [2024-11-26 05:25:44.390646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:10373 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.630 [2024-11-26 05:25:44.390668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.402899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.402931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:17680 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.402955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.419086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.419120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:8906 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.419139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.436463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.436497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:11661 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.436516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.452250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.452285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:15985 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.452304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.463869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.463897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:5289 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.463913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.480600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.480635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:13230 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.480654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.497598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.497633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:8212 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.497652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.508804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.508832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:15209 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.508851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.524515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.524549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:7816 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.524569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.541571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.541605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:16557 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.541636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.558923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.558952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:24764 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.558969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.569798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.569827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:5397 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.569847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.585866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.585895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:9551 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.585912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.602736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.602764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:4162 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.602780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.619454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.619489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:21437 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.619508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.636704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.636751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:5702 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.636767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.891 [2024-11-26 05:25:44.653851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:42.891 [2024-11-26 05:25:44.653897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:6732 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:42.891 [2024-11-26 05:25:44.653915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.669654] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.669697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17688 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.669735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.681657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.681706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:8957 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.681728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.697313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.697348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21761 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.697367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.714325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.714360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:7037 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.714380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.725404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.725438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:7179 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.725457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.741136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.741170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:3092 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.741189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.758153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.758188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:19575 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.758207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.775656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.775699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:2452 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.775721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.790819] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.790851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:15910 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.790868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.802850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.802895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19019 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.802912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.819202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.819236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:6926 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.819255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.836540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.836575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:18928 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.836594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.852286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.852321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:17062 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.852341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.868011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.151 [2024-11-26 05:25:44.868068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:3223 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.151 [2024-11-26 05:25:44.868087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.151 [2024-11-26 05:25:44.879844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.152 [2024-11-26 05:25:44.879876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:8281 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.152 [2024-11-26 05:25:44.879893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.152 [2024-11-26 05:25:44.897812] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.152 [2024-11-26 05:25:44.897841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:18592 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.152 [2024-11-26 05:25:44.897858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.152 [2024-11-26 05:25:44.914872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.152 [2024-11-26 05:25:44.914903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9461 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.152 [2024-11-26 05:25:44.914920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:44.931679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:44.931739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:8097 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:44.931758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:44.946963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:44.947006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:11035 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:44.947027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:44.958134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:44.958168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:3683 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:44.958188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:44.975368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:44.975405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:17071 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:44.975425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:44.990897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:44.990928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:9154 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:44.990946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:45.002836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:45.002864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:6983 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:45.002879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:45.020860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:45.020906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:15017 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:45.020922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:45.036837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:45.036877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:9631 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:45.036893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:45.053746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:45.053792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:20222 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:45.053821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:45.064938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:45.064968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:5123 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:45.064984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:45.081133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:45.081169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:10642 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:45.081188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:45.098889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:45.098917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:6594 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:45.098933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:45.114394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:45.114428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:19215 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:45.114448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:45.126713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:45.126761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15775 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:45.126777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:45.142340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:45.142374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:12780 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:45.142393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:45.159863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:45.159892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:4929 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:45.159907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.412 [2024-11-26 05:25:45.175469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.412 [2024-11-26 05:25:45.175505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5980 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.412 [2024-11-26 05:25:45.175524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.672 [2024-11-26 05:25:45.187036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.672 [2024-11-26 05:25:45.187072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:20384 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.672 [2024-11-26 05:25:45.187091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.672 [2024-11-26 05:25:45.204975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.672 [2024-11-26 05:25:45.205022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:10041 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.672 [2024-11-26 05:25:45.205048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.672 [2024-11-26 05:25:45.221304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.672 [2024-11-26 05:25:45.221338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1145 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.672 [2024-11-26 05:25:45.221357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.672 [2024-11-26 05:25:45.238139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.672 [2024-11-26 05:25:45.238174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:11004 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.673 [2024-11-26 05:25:45.238194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.673 [2024-11-26 05:25:45.254878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.673 [2024-11-26 05:25:45.254907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:19131 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.673 [2024-11-26 05:25:45.254923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.673 [2024-11-26 05:25:45.271501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.673 [2024-11-26 05:25:45.271535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:4006 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.673 [2024-11-26 05:25:45.271554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.673 [2024-11-26 05:25:45.288121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.673 [2024-11-26 05:25:45.288157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:3063 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.673 [2024-11-26 05:25:45.288177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.673 [2024-11-26 05:25:45.304900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.673 [2024-11-26 05:25:45.304930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:8886 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.673 [2024-11-26 05:25:45.304947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.673 [2024-11-26 05:25:45.321526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.673 [2024-11-26 05:25:45.321562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:20177 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.673 [2024-11-26 05:25:45.321582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.673 [2024-11-26 05:25:45.338526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.673 [2024-11-26 05:25:45.338561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23060 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.673 [2024-11-26 05:25:45.338580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.673 [2024-11-26 05:25:45.353818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.673 [2024-11-26 05:25:45.353864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:6771 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.673 [2024-11-26 05:25:45.353881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.673 [2024-11-26 05:25:45.365528] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.673 [2024-11-26 05:25:45.365563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:4867 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.673 [2024-11-26 05:25:45.365581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.673 [2024-11-26 05:25:45.382823] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.673 [2024-11-26 05:25:45.382852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:12536 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.673 [2024-11-26 05:25:45.382867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.673 [2024-11-26 05:25:45.399713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.673 [2024-11-26 05:25:45.399759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:9234 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.673 [2024-11-26 05:25:45.399776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.673 [2024-11-26 05:25:45.417449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.673 [2024-11-26 05:25:45.417483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:11484 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.673 [2024-11-26 05:25:45.417502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.932 [2024-11-26 05:25:45.440614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.932 [2024-11-26 05:25:45.440650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:3594 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.932 [2024-11-26 05:25:45.440670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.932 [2024-11-26 05:25:45.457350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.932 [2024-11-26 05:25:45.457384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:6512 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.932 [2024-11-26 05:25:45.457403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.932 [2024-11-26 05:25:45.474138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.932 [2024-11-26 05:25:45.474173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:11231 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.932 [2024-11-26 05:25:45.474193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.932 [2024-11-26 05:25:45.490961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.932 [2024-11-26 05:25:45.491006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19019 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.932 [2024-11-26 05:25:45.491026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.932 [2024-11-26 05:25:45.507645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.932 [2024-11-26 05:25:45.507679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:16802 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.932 [2024-11-26 05:25:45.507708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.932 [2024-11-26 05:25:45.524337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.932 [2024-11-26 05:25:45.524371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21937 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.932 [2024-11-26 05:25:45.524390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.932 [2024-11-26 05:25:45.539783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.933 [2024-11-26 05:25:45.539815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:17005 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.933 [2024-11-26 05:25:45.539833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.933 [2024-11-26 05:25:45.551522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.933 [2024-11-26 05:25:45.551558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:21005 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.933 [2024-11-26 05:25:45.551578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.933 [2024-11-26 05:25:45.567716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.933 [2024-11-26 05:25:45.567763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5459 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.933 [2024-11-26 05:25:45.567779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.933 [2024-11-26 05:25:45.585196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.933 [2024-11-26 05:25:45.585232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:16987 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.933 [2024-11-26 05:25:45.585252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.933 [2024-11-26 05:25:45.601933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.933 [2024-11-26 05:25:45.601969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:3416 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.933 [2024-11-26 05:25:45.601999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.933 [2024-11-26 05:25:45.618959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.933 [2024-11-26 05:25:45.619002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:5532 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.933 [2024-11-26 05:25:45.619018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.933 [2024-11-26 05:25:45.636436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.933 [2024-11-26 05:25:45.636470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:16468 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.933 [2024-11-26 05:25:45.636495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.933 [2024-11-26 05:25:45.653513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.933 [2024-11-26 05:25:45.653547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:21826 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.933 [2024-11-26 05:25:45.653566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.933 [2024-11-26 05:25:45.669900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.933 [2024-11-26 05:25:45.669933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:16624 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.933 [2024-11-26 05:25:45.669953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.933 [2024-11-26 05:25:45.686851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:43.933 [2024-11-26 05:25:45.686884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:20133 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.933 [2024-11-26 05:25:45.686903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.703928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.703958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:15245 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.703974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.720884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.720912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:17260 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.720928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.738524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.738558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:25143 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.738577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.754672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.754714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:4355 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.754746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.771711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.771755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14230 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.771770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.788889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.788923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22282 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.788939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.805763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.805793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15579 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.805810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.823028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.823062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:11458 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.823082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.839922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.839950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:12981 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.839966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.850893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.850923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:6528 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.850939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.866888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.866916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:19772 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.866931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.884486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.884520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:15388 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.884550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.900323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.900357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:19170 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.900378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.912486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.912521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:21857 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.912548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.929940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.929993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17000 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.930009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.192 [2024-11-26 05:25:45.946845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.192 [2024-11-26 05:25:45.946877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:6525 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.192 [2024-11-26 05:25:45.946901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:45.957923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:45.957952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:10181 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:45.957968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:45.974075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:45.974110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:18545 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:45.974136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:45.990030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:45.990066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:1056 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:45.990085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.005587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.005621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:5506 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:46.005639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.017859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.017887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:10422 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:46.017907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.033175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.033211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16804 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:46.033230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.050598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.050640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17619 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:46.050661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.067559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.067594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:2292 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:46.067613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.084439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.084473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:5819 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:46.084492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.100531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.100565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:1822 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:46.100586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.115988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.116038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:18336 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:46.116059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.127832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.127876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:16082 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:46.127892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.143771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.143800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:18061 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:46.143817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.161162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.161196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:5170 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:46.161215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.185543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.185577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:599 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:46.185596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.202172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.202205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:5700 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.557 [2024-11-26 05:25:46.202224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.557 [2024-11-26 05:25:46.219055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.557 [2024-11-26 05:25:46.219091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20114 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.558 [2024-11-26 05:25:46.219118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.558 [2024-11-26 05:25:46.236073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.558 [2024-11-26 05:25:46.236108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:21346 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.558 [2024-11-26 05:25:46.236127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.558 [2024-11-26 05:25:46.252775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.558 [2024-11-26 05:25:46.252804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:14200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.558 [2024-11-26 05:25:46.252821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.558 [2024-11-26 05:25:46.264005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.558 [2024-11-26 05:25:46.264057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23719 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.558 [2024-11-26 05:25:46.264078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.841 [2024-11-26 05:25:46.280448] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.841 [2024-11-26 05:25:46.280484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:16611 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.841 [2024-11-26 05:25:46.280514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.841 [2024-11-26 05:25:46.295854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1797300) 00:29:44.841 [2024-11-26 05:25:46.295883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:21603 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.841 [2024-11-26 05:25:46.295907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.841 00:29:44.841 Latency(us) 00:29:44.841 [2024-11-26T04:25:46.609Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:44.841 [2024-11-26T04:25:46.609Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:44.841 nvme0n1 : 2.00 16040.45 62.66 0.00 0.00 7972.38 3737.98 25437.68 00:29:44.841 [2024-11-26T04:25:46.610Z] =================================================================================================================== 00:29:44.842 [2024-11-26T04:25:46.610Z] Total : 16040.45 62.66 0.00 0.00 7972.38 3737.98 25437.68 00:29:44.842 0 00:29:44.842 05:25:46 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:44.842 05:25:46 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:44.842 05:25:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:44.842 05:25:46 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:44.842 | .driver_specific 00:29:44.842 | .nvme_error 00:29:44.842 | .status_code 00:29:44.842 | .command_transient_transport_error' 00:29:44.842 05:25:46 -- host/digest.sh@71 -- # (( 126 > 0 )) 00:29:44.842 05:25:46 -- host/digest.sh@73 -- # killprocess 3420870 00:29:44.842 05:25:46 -- common/autotest_common.sh@936 -- # '[' -z 3420870 ']' 00:29:44.842 05:25:46 -- common/autotest_common.sh@940 -- # kill -0 3420870 00:29:44.842 05:25:46 -- common/autotest_common.sh@941 -- # uname 00:29:44.842 05:25:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:44.842 05:25:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3420870 00:29:45.100 05:25:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:45.100 05:25:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:45.100 05:25:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3420870' 00:29:45.100 killing process with pid 3420870 00:29:45.100 05:25:46 -- common/autotest_common.sh@955 -- # kill 3420870 00:29:45.100 Received shutdown signal, test time was about 2.000000 seconds 00:29:45.100 00:29:45.100 Latency(us) 00:29:45.100 [2024-11-26T04:25:46.868Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:45.100 [2024-11-26T04:25:46.868Z] =================================================================================================================== 00:29:45.100 [2024-11-26T04:25:46.868Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:45.100 05:25:46 -- common/autotest_common.sh@960 -- # wait 3420870 00:29:45.100 05:25:46 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:45.100 05:25:46 -- host/digest.sh@54 -- # local rw bs qd 00:29:45.100 05:25:46 -- host/digest.sh@56 -- # rw=randread 00:29:45.100 05:25:46 -- host/digest.sh@56 -- # bs=131072 00:29:45.100 05:25:46 -- host/digest.sh@56 -- # qd=16 00:29:45.100 05:25:46 -- host/digest.sh@58 -- # bperfpid=3421296 00:29:45.100 05:25:46 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:45.100 05:25:46 -- host/digest.sh@60 -- # waitforlisten 3421296 /var/tmp/bperf.sock 00:29:45.100 05:25:46 -- common/autotest_common.sh@829 -- # '[' -z 3421296 ']' 00:29:45.100 05:25:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:45.100 05:25:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:45.100 05:25:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:45.100 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:45.100 05:25:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:45.100 05:25:46 -- common/autotest_common.sh@10 -- # set +x 00:29:45.359 [2024-11-26 05:25:46.874655] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:45.359 [2024-11-26 05:25:46.874747] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3421296 ] 00:29:45.360 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:45.360 Zero copy mechanism will not be used. 00:29:45.360 EAL: No free 2048 kB hugepages reported on node 1 00:29:45.360 [2024-11-26 05:25:46.936054] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:45.360 [2024-11-26 05:25:47.022009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:46.297 05:25:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:46.297 05:25:47 -- common/autotest_common.sh@862 -- # return 0 00:29:46.297 05:25:47 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:46.297 05:25:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:46.555 05:25:48 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:46.555 05:25:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.555 05:25:48 -- common/autotest_common.sh@10 -- # set +x 00:29:46.555 05:25:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:46.555 05:25:48 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:46.555 05:25:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:46.816 nvme0n1 00:29:46.816 05:25:48 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:46.816 05:25:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.816 05:25:48 -- common/autotest_common.sh@10 -- # set +x 00:29:46.816 05:25:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:46.816 05:25:48 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:46.816 05:25:48 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:46.816 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:46.816 Zero copy mechanism will not be used. 00:29:46.816 Running I/O for 2 seconds... 00:29:46.816 [2024-11-26 05:25:48.568601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:46.816 [2024-11-26 05:25:48.568665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.816 [2024-11-26 05:25:48.568698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.816 [2024-11-26 05:25:48.577317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:46.816 [2024-11-26 05:25:48.577359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.816 [2024-11-26 05:25:48.577381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.078 [2024-11-26 05:25:48.585682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.078 [2024-11-26 05:25:48.585727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.078 [2024-11-26 05:25:48.585761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.078 [2024-11-26 05:25:48.593881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.078 [2024-11-26 05:25:48.593912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.078 [2024-11-26 05:25:48.593930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.078 [2024-11-26 05:25:48.602028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.078 [2024-11-26 05:25:48.602065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.078 [2024-11-26 05:25:48.602085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.078 [2024-11-26 05:25:48.609076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.078 [2024-11-26 05:25:48.609113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.078 [2024-11-26 05:25:48.609132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.078 [2024-11-26 05:25:48.616236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.078 [2024-11-26 05:25:48.616283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.078 [2024-11-26 05:25:48.616303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.078 [2024-11-26 05:25:48.624058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.078 [2024-11-26 05:25:48.624094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.078 [2024-11-26 05:25:48.624114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.078 [2024-11-26 05:25:48.631325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.078 [2024-11-26 05:25:48.631362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.078 [2024-11-26 05:25:48.631381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.078 [2024-11-26 05:25:48.639669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.078 [2024-11-26 05:25:48.639714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.078 [2024-11-26 05:25:48.639747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.078 [2024-11-26 05:25:48.647649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.078 [2024-11-26 05:25:48.647692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.078 [2024-11-26 05:25:48.647714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.078 [2024-11-26 05:25:48.654623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.078 [2024-11-26 05:25:48.654659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.078 [2024-11-26 05:25:48.654678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.078 [2024-11-26 05:25:48.661452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.661488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.661507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.668428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.668464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.668483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.675028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.675064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.675083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.681847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.681879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.681895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.688250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.688286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.688305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.694844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.694877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.694895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.701954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.702002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.702019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.708388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.708424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.708444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.715393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.715430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.715449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.722494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.722530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.722549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.729344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.729381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.729400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.735962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.736012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.736039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.742670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.742717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.742738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.749088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.749124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.749143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.755977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.756025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.756046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.762694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.762730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.762764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.769587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.769623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.769643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.776771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.776803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.776822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.782897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.782929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.782947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.790034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.790070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.790090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.796672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.079 [2024-11-26 05:25:48.796731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.079 [2024-11-26 05:25:48.796750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.079 [2024-11-26 05:25:48.803763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.080 [2024-11-26 05:25:48.803794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.080 [2024-11-26 05:25:48.803811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.080 [2024-11-26 05:25:48.810350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.080 [2024-11-26 05:25:48.810385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.080 [2024-11-26 05:25:48.810405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.080 [2024-11-26 05:25:48.817255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.080 [2024-11-26 05:25:48.817291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.080 [2024-11-26 05:25:48.817310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.080 [2024-11-26 05:25:48.823558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.080 [2024-11-26 05:25:48.823594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.080 [2024-11-26 05:25:48.823613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.080 [2024-11-26 05:25:48.830340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.080 [2024-11-26 05:25:48.830376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.080 [2024-11-26 05:25:48.830396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.080 [2024-11-26 05:25:48.837099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.080 [2024-11-26 05:25:48.837135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.080 [2024-11-26 05:25:48.837154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.341 [2024-11-26 05:25:48.845234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.341 [2024-11-26 05:25:48.845271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.341 [2024-11-26 05:25:48.845291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.853469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.853506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.853532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.861203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.861239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.861259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.868980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.869026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.869046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.876914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.876946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.876964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.884456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.884491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.884510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.892118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.892154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.892173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.900330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.900366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.900385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.907613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.907649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.907669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.915229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.915266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.915286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.923420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.923463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.923484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.931358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.931394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.931414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.939124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.939160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.939180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.946886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.946933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.946949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.954844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.954875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.954907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.963088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.963125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.963145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.970382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.970417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.970436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.976661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.976705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.976727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.983477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.983513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.983532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.991151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.991187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.991207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:48.997923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:48.997955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:48.997973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:49.005212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:49.005248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:49.005267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:49.012511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:49.012546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:49.012566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:49.020397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:49.020433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.342 [2024-11-26 05:25:49.020452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.342 [2024-11-26 05:25:49.028436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.342 [2024-11-26 05:25:49.028472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.343 [2024-11-26 05:25:49.028491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.343 [2024-11-26 05:25:49.036560] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.343 [2024-11-26 05:25:49.036596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.343 [2024-11-26 05:25:49.036615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.343 [2024-11-26 05:25:49.044155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.343 [2024-11-26 05:25:49.044191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.343 [2024-11-26 05:25:49.044211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.343 [2024-11-26 05:25:49.050982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.343 [2024-11-26 05:25:49.051033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.343 [2024-11-26 05:25:49.051074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.343 [2024-11-26 05:25:49.058044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.343 [2024-11-26 05:25:49.058080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.343 [2024-11-26 05:25:49.058099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.343 [2024-11-26 05:25:49.065929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.343 [2024-11-26 05:25:49.065962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.343 [2024-11-26 05:25:49.065995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.343 [2024-11-26 05:25:49.074429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.343 [2024-11-26 05:25:49.074465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.343 [2024-11-26 05:25:49.074485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.343 [2024-11-26 05:25:49.083006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.343 [2024-11-26 05:25:49.083054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.343 [2024-11-26 05:25:49.083074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.343 [2024-11-26 05:25:49.091486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.343 [2024-11-26 05:25:49.091521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.343 [2024-11-26 05:25:49.091542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.343 [2024-11-26 05:25:49.099160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.343 [2024-11-26 05:25:49.099196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.343 [2024-11-26 05:25:49.099216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.343 [2024-11-26 05:25:49.104610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.343 [2024-11-26 05:25:49.104646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.343 [2024-11-26 05:25:49.104665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.114143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.114180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.114200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.122398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.122440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.122460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.129224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.129260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.129279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.136132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.136168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.136187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.143135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.143170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.143188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.149991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.150040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.150060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.157159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.157195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.157214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.163703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.163751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.163767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.171429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.171464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.171483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.179733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.179781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.179799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.187858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.187890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.187907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.196027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.196063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.196083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.202653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.202696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.202732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.209346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.209381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.601 [2024-11-26 05:25:49.209400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.601 [2024-11-26 05:25:49.215779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.601 [2024-11-26 05:25:49.215811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.215829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.221924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.221955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.221972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.228614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.228649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.228669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.235882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.235913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.235931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.243927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.243958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.243995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.252075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.252112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.252131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.260572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.260609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.260629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.268868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.268899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.268917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.276745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.276776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.276807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.284747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.284778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.284811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.292294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.292329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.292348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.300285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.300322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.300342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.308008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.308058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.308076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.315873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.315912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.315944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.323896] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.323928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.323964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.331866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.331897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.331913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.340168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.340216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.340236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.348065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.348102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.348120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.355953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.356001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.356021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.602 [2024-11-26 05:25:49.363734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.602 [2024-11-26 05:25:49.363784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.602 [2024-11-26 05:25:49.363804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.862 [2024-11-26 05:25:49.371676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.862 [2024-11-26 05:25:49.371738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.862 [2024-11-26 05:25:49.371758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.862 [2024-11-26 05:25:49.379664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.862 [2024-11-26 05:25:49.379710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.379754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.387896] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.387929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.387946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.395288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.395323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.395342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.402946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.402979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.402996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.410641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.410675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.410703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.418101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.418133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.418149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.425838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.425869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.425887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.433622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.433653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.433695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.439824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.439857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.439875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.446257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.446289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.446317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.453263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.453297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.453314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.460998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.461030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.461047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.468589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.468632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.468649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.476111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.476143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.476161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.482307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.482339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.482357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.489191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.489235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.489253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.495750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.495782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.495799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.501787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.501821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.501838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.507898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.507937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.507955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.514570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.514602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.514620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.521627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.521658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.521701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.529307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.529340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.529358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.535265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.535297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.535316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.542260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.542293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.542310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.549499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.549532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.549549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.556944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.556976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.863 [2024-11-26 05:25:49.556993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.863 [2024-11-26 05:25:49.564163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.863 [2024-11-26 05:25:49.564207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.864 [2024-11-26 05:25:49.564225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.864 [2024-11-26 05:25:49.571539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.864 [2024-11-26 05:25:49.571572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.864 [2024-11-26 05:25:49.571590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.864 [2024-11-26 05:25:49.578787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.864 [2024-11-26 05:25:49.578819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.864 [2024-11-26 05:25:49.578837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.864 [2024-11-26 05:25:49.586053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.864 [2024-11-26 05:25:49.586087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.864 [2024-11-26 05:25:49.586104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.864 [2024-11-26 05:25:49.594999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.864 [2024-11-26 05:25:49.595032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.864 [2024-11-26 05:25:49.595050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.864 [2024-11-26 05:25:49.603066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.864 [2024-11-26 05:25:49.603097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.864 [2024-11-26 05:25:49.603115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.864 [2024-11-26 05:25:49.611361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.864 [2024-11-26 05:25:49.611394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.864 [2024-11-26 05:25:49.611411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.864 [2024-11-26 05:25:49.619058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:47.864 [2024-11-26 05:25:49.619090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.864 [2024-11-26 05:25:49.619108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.125 [2024-11-26 05:25:49.626735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.125 [2024-11-26 05:25:49.626768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.125 [2024-11-26 05:25:49.626786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.125 [2024-11-26 05:25:49.634428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.125 [2024-11-26 05:25:49.634462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.125 [2024-11-26 05:25:49.634487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.125 [2024-11-26 05:25:49.641397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.125 [2024-11-26 05:25:49.641430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.125 [2024-11-26 05:25:49.641448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.125 [2024-11-26 05:25:49.648872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.648904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.648922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.656470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.656502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.656520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.663814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.663847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.663864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.671261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.671293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.671311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.678885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.678918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.678936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.686770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.686803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.686820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.695040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.695073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.695090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.701964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.701996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.702013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.706013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.706044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.706061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.713196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.713226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.713242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.721440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.721470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.721488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.729602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.729633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.729649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.737812] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.737859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.737876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.745381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.745412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.745428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.753951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.753984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.754017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.762238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.762269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.762292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.769866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.769898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.769916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.777548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.777582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.777599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.784489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.784521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.784552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.791941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.791989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.792006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.799505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.799549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.799566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.806726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.806758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.806775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.812652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.812692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.812712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.818597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.818628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.818646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.825256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.825309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.825327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.833358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.833389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.833420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.126 [2024-11-26 05:25:49.840576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.126 [2024-11-26 05:25:49.840608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.126 [2024-11-26 05:25:49.840639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.127 [2024-11-26 05:25:49.849208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.127 [2024-11-26 05:25:49.849239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.127 [2024-11-26 05:25:49.849272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.127 [2024-11-26 05:25:49.857112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.127 [2024-11-26 05:25:49.857144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.127 [2024-11-26 05:25:49.857177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.127 [2024-11-26 05:25:49.865360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.127 [2024-11-26 05:25:49.865391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.127 [2024-11-26 05:25:49.865408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.127 [2024-11-26 05:25:49.872797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.127 [2024-11-26 05:25:49.872844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.127 [2024-11-26 05:25:49.872861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.127 [2024-11-26 05:25:49.880299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.127 [2024-11-26 05:25:49.880332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.127 [2024-11-26 05:25:49.880350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.127 [2024-11-26 05:25:49.888021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.127 [2024-11-26 05:25:49.888054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.127 [2024-11-26 05:25:49.888070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.388 [2024-11-26 05:25:49.895560] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.388 [2024-11-26 05:25:49.895593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.388 [2024-11-26 05:25:49.895610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.388 [2024-11-26 05:25:49.904040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.388 [2024-11-26 05:25:49.904088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.388 [2024-11-26 05:25:49.904104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.388 [2024-11-26 05:25:49.912040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.388 [2024-11-26 05:25:49.912086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.388 [2024-11-26 05:25:49.912102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.388 [2024-11-26 05:25:49.919548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.388 [2024-11-26 05:25:49.919580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.388 [2024-11-26 05:25:49.919597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.388 [2024-11-26 05:25:49.926506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:49.926539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:49.926557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:49.934243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:49.934275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:49.934293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:49.941607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:49.941639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:49.941657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:49.950299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:49.950332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:49.950350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:49.958391] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:49.958423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:49.958451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:49.967372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:49.967405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:49.967422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:49.975884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:49.975916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:49.975949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:49.982928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:49.982960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:49.982978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:49.989522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:49.989554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:49.989571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:49.995790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:49.995822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:49.995839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.003570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.003617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.003649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.012119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.012160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.012180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.020575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.020609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.020640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.028597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.028641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.028660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.035648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.035681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.035710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.042144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.042197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.042218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.048837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.048870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.048888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.056761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.056821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.056841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.064017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.064061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.064080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.071508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.071546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.071565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.077364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.077398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.077416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.083193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.083227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.083245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.089309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.089341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.089359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.096471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.096503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.096520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.103907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.103940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.103958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.111011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.111043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.111061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.118411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.389 [2024-11-26 05:25:50.118443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.389 [2024-11-26 05:25:50.118460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.389 [2024-11-26 05:25:50.126152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.390 [2024-11-26 05:25:50.126184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.390 [2024-11-26 05:25:50.126202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.390 [2024-11-26 05:25:50.133642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.390 [2024-11-26 05:25:50.133674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.390 [2024-11-26 05:25:50.133700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.390 [2024-11-26 05:25:50.141273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.390 [2024-11-26 05:25:50.141306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.390 [2024-11-26 05:25:50.141323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.390 [2024-11-26 05:25:50.148932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.390 [2024-11-26 05:25:50.148966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.390 [2024-11-26 05:25:50.148994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.650 [2024-11-26 05:25:50.156656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.650 [2024-11-26 05:25:50.156714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.650 [2024-11-26 05:25:50.156735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.650 [2024-11-26 05:25:50.164250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.650 [2024-11-26 05:25:50.164282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.650 [2024-11-26 05:25:50.164299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.650 [2024-11-26 05:25:50.172062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.650 [2024-11-26 05:25:50.172095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.650 [2024-11-26 05:25:50.172112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.650 [2024-11-26 05:25:50.179585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.650 [2024-11-26 05:25:50.179618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.650 [2024-11-26 05:25:50.179637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.650 [2024-11-26 05:25:50.186721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.650 [2024-11-26 05:25:50.186754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.650 [2024-11-26 05:25:50.186771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.650 [2024-11-26 05:25:50.194987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.650 [2024-11-26 05:25:50.195019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.650 [2024-11-26 05:25:50.195036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.650 [2024-11-26 05:25:50.202998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.203030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.203048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.210849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.210881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.210898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.218451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.218492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.218510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.225158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.225190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.225207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.232416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.232449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.232467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.238993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.239026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.239043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.245881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.245913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.245930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.252561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.252593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.252610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.257403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.257434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.257452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.264846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.264878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.264896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.271820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.271871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.271889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.279500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.279545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.279563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.287028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.287074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.287091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.294471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.294518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.294535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.302199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.302246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.302264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.309806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.309839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.309857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.317385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.317417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.317435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.325102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.325135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.325152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.332871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.332905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.332922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.339755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.339788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.339813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.347047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.347093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.347110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.354976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.355026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.355043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.362385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.362417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.362434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.370012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.370060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.370078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.377971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.378019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.378035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.385712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.385745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.385762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.651 [2024-11-26 05:25:50.393762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.651 [2024-11-26 05:25:50.393795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.651 [2024-11-26 05:25:50.393812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.652 [2024-11-26 05:25:50.401617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.652 [2024-11-26 05:25:50.401651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.652 [2024-11-26 05:25:50.401669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.652 [2024-11-26 05:25:50.409888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.652 [2024-11-26 05:25:50.409930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.652 [2024-11-26 05:25:50.409973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.418097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.418145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.418165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.426140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.426175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.426194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.433807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.433838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.433856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.441344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.441379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.441398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.449285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.449321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.449339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.457624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.457659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.457678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.465985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.466022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.466041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.473479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.473515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.473534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.480771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.480812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.480830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.488404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.488441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.488461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.496564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.496599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.496620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.504557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.504592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.504612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.512538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.512572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.512592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.520318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.520353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.520373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.911 [2024-11-26 05:25:50.528072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.911 [2024-11-26 05:25:50.528108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.911 [2024-11-26 05:25:50.528127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.912 [2024-11-26 05:25:50.536011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.912 [2024-11-26 05:25:50.536058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.912 [2024-11-26 05:25:50.536076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.912 [2024-11-26 05:25:50.543792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.912 [2024-11-26 05:25:50.543829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.912 [2024-11-26 05:25:50.543863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.912 [2024-11-26 05:25:50.551677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.912 [2024-11-26 05:25:50.551748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.912 [2024-11-26 05:25:50.551766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.912 [2024-11-26 05:25:50.559626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x7aa190) 00:29:48.912 [2024-11-26 05:25:50.559661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.912 [2024-11-26 05:25:50.559680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.912 00:29:48.912 Latency(us) 00:29:48.912 [2024-11-26T04:25:50.680Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:48.912 [2024-11-26T04:25:50.680Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:48.912 nvme0n1 : 2.00 4151.79 518.97 0.00 0.00 3848.94 652.33 11650.84 00:29:48.912 [2024-11-26T04:25:50.680Z] =================================================================================================================== 00:29:48.912 [2024-11-26T04:25:50.680Z] Total : 4151.79 518.97 0.00 0.00 3848.94 652.33 11650.84 00:29:48.912 0 00:29:48.912 05:25:50 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:48.912 05:25:50 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:48.912 05:25:50 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:48.912 | .driver_specific 00:29:48.912 | .nvme_error 00:29:48.912 | .status_code 00:29:48.912 | .command_transient_transport_error' 00:29:48.912 05:25:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:49.172 05:25:50 -- host/digest.sh@71 -- # (( 268 > 0 )) 00:29:49.172 05:25:50 -- host/digest.sh@73 -- # killprocess 3421296 00:29:49.172 05:25:50 -- common/autotest_common.sh@936 -- # '[' -z 3421296 ']' 00:29:49.172 05:25:50 -- common/autotest_common.sh@940 -- # kill -0 3421296 00:29:49.172 05:25:50 -- common/autotest_common.sh@941 -- # uname 00:29:49.172 05:25:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:49.172 05:25:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3421296 00:29:49.172 05:25:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:49.172 05:25:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:49.172 05:25:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3421296' 00:29:49.172 killing process with pid 3421296 00:29:49.172 05:25:50 -- common/autotest_common.sh@955 -- # kill 3421296 00:29:49.172 Received shutdown signal, test time was about 2.000000 seconds 00:29:49.172 00:29:49.172 Latency(us) 00:29:49.172 [2024-11-26T04:25:50.940Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:49.172 [2024-11-26T04:25:50.940Z] =================================================================================================================== 00:29:49.172 [2024-11-26T04:25:50.940Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:49.172 05:25:50 -- common/autotest_common.sh@960 -- # wait 3421296 00:29:49.431 05:25:51 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:29:49.431 05:25:51 -- host/digest.sh@54 -- # local rw bs qd 00:29:49.431 05:25:51 -- host/digest.sh@56 -- # rw=randwrite 00:29:49.431 05:25:51 -- host/digest.sh@56 -- # bs=4096 00:29:49.431 05:25:51 -- host/digest.sh@56 -- # qd=128 00:29:49.431 05:25:51 -- host/digest.sh@58 -- # bperfpid=3421846 00:29:49.431 05:25:51 -- host/digest.sh@60 -- # waitforlisten 3421846 /var/tmp/bperf.sock 00:29:49.431 05:25:51 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:49.431 05:25:51 -- common/autotest_common.sh@829 -- # '[' -z 3421846 ']' 00:29:49.431 05:25:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:49.431 05:25:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:49.431 05:25:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:49.431 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:49.431 05:25:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:49.431 05:25:51 -- common/autotest_common.sh@10 -- # set +x 00:29:49.431 [2024-11-26 05:25:51.163649] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:49.431 [2024-11-26 05:25:51.163774] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3421846 ] 00:29:49.431 EAL: No free 2048 kB hugepages reported on node 1 00:29:49.690 [2024-11-26 05:25:51.225907] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:49.690 [2024-11-26 05:25:51.311349] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:50.623 05:25:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:50.623 05:25:52 -- common/autotest_common.sh@862 -- # return 0 00:29:50.623 05:25:52 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:50.623 05:25:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:50.623 05:25:52 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:50.623 05:25:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:50.624 05:25:52 -- common/autotest_common.sh@10 -- # set +x 00:29:50.624 05:25:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:50.624 05:25:52 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:50.624 05:25:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:51.193 nvme0n1 00:29:51.193 05:25:52 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:51.193 05:25:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.193 05:25:52 -- common/autotest_common.sh@10 -- # set +x 00:29:51.193 05:25:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.193 05:25:52 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:51.193 05:25:52 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:51.193 Running I/O for 2 seconds... 00:29:51.193 [2024-11-26 05:25:52.832914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ee5c8 00:29:51.194 [2024-11-26 05:25:52.834005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:1984 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.194 [2024-11-26 05:25:52.834060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:29:51.194 [2024-11-26 05:25:52.846026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e6b70 00:29:51.194 [2024-11-26 05:25:52.847336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:1545 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.194 [2024-11-26 05:25:52.847373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:29:51.194 [2024-11-26 05:25:52.858868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190df988 00:29:51.194 [2024-11-26 05:25:52.859700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:13729 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.194 [2024-11-26 05:25:52.859769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:29:51.194 [2024-11-26 05:25:52.871640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f0ff8 00:29:51.194 [2024-11-26 05:25:52.872186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:19389 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.194 [2024-11-26 05:25:52.872220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:29:51.194 [2024-11-26 05:25:52.884184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e1b48 00:29:51.194 [2024-11-26 05:25:52.884682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:24168 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.194 [2024-11-26 05:25:52.884725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:29:51.194 [2024-11-26 05:25:52.896697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e4140 00:29:51.194 [2024-11-26 05:25:52.897310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:6178 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.194 [2024-11-26 05:25:52.897343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:29:51.194 [2024-11-26 05:25:52.909155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f0bc0 00:29:51.194 [2024-11-26 05:25:52.909546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:4074 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.194 [2024-11-26 05:25:52.909579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:29:51.194 [2024-11-26 05:25:52.921547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f20d8 00:29:51.194 [2024-11-26 05:25:52.921930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:12314 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.194 [2024-11-26 05:25:52.921960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:29:51.194 [2024-11-26 05:25:52.933864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f1ca0 00:29:51.194 [2024-11-26 05:25:52.934242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:18801 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.194 [2024-11-26 05:25:52.934275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:51.194 [2024-11-26 05:25:52.946301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190eff18 00:29:51.194 [2024-11-26 05:25:52.946589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:4763 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.194 [2024-11-26 05:25:52.946622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:52.958654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e5658 00:29:51.455 [2024-11-26 05:25:52.958918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:25527 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:52.958949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:52.970934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ee190 00:29:51.455 [2024-11-26 05:25:52.971173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:11292 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:52.971207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:52.985445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f0bc0 00:29:51.455 [2024-11-26 05:25:52.987278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:16335 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:52.987312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:52.997779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e27f0 00:29:51.455 [2024-11-26 05:25:52.999602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:18696 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:52.999636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.008853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ec840 00:29:51.455 [2024-11-26 05:25:53.010340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:4377 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.010374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.021131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ec840 00:29:51.455 [2024-11-26 05:25:53.022552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:7980 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.022586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.033424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f20d8 00:29:51.455 [2024-11-26 05:25:53.034922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:15916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.034950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.045679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ed920 00:29:51.455 [2024-11-26 05:25:53.047402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:13868 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.047436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.057094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e27f0 00:29:51.455 [2024-11-26 05:25:53.058267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:20686 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.058300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.070311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190fa7d8 00:29:51.455 [2024-11-26 05:25:53.072285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:8937 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.072318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.081617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e73e0 00:29:51.455 [2024-11-26 05:25:53.082469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:10462 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.082502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.094151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f92c0 00:29:51.455 [2024-11-26 05:25:53.094295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:1530 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.094325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.106990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f6cc8 00:29:51.455 [2024-11-26 05:25:53.107857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:583 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.107888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.120357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f2948 00:29:51.455 [2024-11-26 05:25:53.120877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:24859 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.120906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.133258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0630 00:29:51.455 [2024-11-26 05:25:53.134478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24044 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.134511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.146345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f4298 00:29:51.455 [2024-11-26 05:25:53.147904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:5015 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.147934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.158368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190fe2e8 00:29:51.455 [2024-11-26 05:25:53.159355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:3489 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.159388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.170438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ef6a8 00:29:51.455 [2024-11-26 05:25:53.172253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:6591 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.172286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.183719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f92c0 00:29:51.455 [2024-11-26 05:25:53.185534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:16143 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.185573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.194780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190eee38 00:29:51.455 [2024-11-26 05:25:53.196028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:3926 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.196071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:29:51.455 [2024-11-26 05:25:53.207467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e9168 00:29:51.455 [2024-11-26 05:25:53.208942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:10670 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.455 [2024-11-26 05:25:53.208972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.220095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ebb98 00:29:51.715 [2024-11-26 05:25:53.221050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:12545 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.221084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.232265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e88f8 00:29:51.715 [2024-11-26 05:25:53.233180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:14254 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.233214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.244430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f3a28 00:29:51.715 [2024-11-26 05:25:53.245315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:8378 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.245349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.255449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f2948 00:29:51.715 [2024-11-26 05:25:53.255758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:492 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.255786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.269058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190eaab8 00:29:51.715 [2024-11-26 05:25:53.269534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:9531 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.269565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.281646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ed4e8 00:29:51.715 [2024-11-26 05:25:53.282358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:5856 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.282391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.293961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190df550 00:29:51.715 [2024-11-26 05:25:53.294626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:18549 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.294658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.306306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190efae0 00:29:51.715 [2024-11-26 05:25:53.306911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:3211 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.306939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.318632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f4b08 00:29:51.715 [2024-11-26 05:25:53.319259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:4347 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.319292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.331077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e6b70 00:29:51.715 [2024-11-26 05:25:53.331587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:12653 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.331620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.343453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e12d8 00:29:51.715 [2024-11-26 05:25:53.344022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:11886 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.344069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.355761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e6b70 00:29:51.715 [2024-11-26 05:25:53.356201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:6251 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.356233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.368187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f4b08 00:29:51.715 [2024-11-26 05:25:53.368596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:10489 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.368628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.380432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190efae0 00:29:51.715 [2024-11-26 05:25:53.380827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:7115 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.380858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.392753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f92c0 00:29:51.715 [2024-11-26 05:25:53.393142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:12215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.393178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.404985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190eff18 00:29:51.715 [2024-11-26 05:25:53.405474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:5916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.405506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.417284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f8618 00:29:51.715 [2024-11-26 05:25:53.417777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:4644 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.417806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.429568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190eea00 00:29:51.715 [2024-11-26 05:25:53.430078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:3108 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.430118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.441566] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f3e60 00:29:51.715 [2024-11-26 05:25:53.442928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:11410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.715 [2024-11-26 05:25:53.442958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:29:51.715 [2024-11-26 05:25:53.454002] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e5a90 00:29:51.715 [2024-11-26 05:25:53.455326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:6875 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.716 [2024-11-26 05:25:53.455359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:29:51.716 [2024-11-26 05:25:53.466156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e7c50 00:29:51.716 [2024-11-26 05:25:53.467085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:25492 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.716 [2024-11-26 05:25:53.467117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0036 p:0 m:0 dnr:0 00:29:51.974 [2024-11-26 05:25:53.479100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f35f0 00:29:51.974 [2024-11-26 05:25:53.480296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:20559 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.974 [2024-11-26 05:25:53.480329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:29:51.974 [2024-11-26 05:25:53.491767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f35f0 00:29:51.974 [2024-11-26 05:25:53.493027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:24180 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.974 [2024-11-26 05:25:53.493060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:29:51.974 [2024-11-26 05:25:53.503636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f8618 00:29:51.974 [2024-11-26 05:25:53.503871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:17561 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.974 [2024-11-26 05:25:53.503905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.974 [2024-11-26 05:25:53.516364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f4b08 00:29:51.974 [2024-11-26 05:25:53.517292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22680 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.974 [2024-11-26 05:25:53.517325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:29:51.974 [2024-11-26 05:25:53.528923] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190fc560 00:29:51.974 [2024-11-26 05:25:53.529366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:16338 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.974 [2024-11-26 05:25:53.529397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:001f p:0 m:0 dnr:0 00:29:51.974 [2024-11-26 05:25:53.542519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f6458 00:29:51.974 [2024-11-26 05:25:53.543103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:7680 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.974 [2024-11-26 05:25:53.543135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:29:51.974 [2024-11-26 05:25:53.556600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f6458 00:29:51.974 [2024-11-26 05:25:53.558192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:5623 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.974 [2024-11-26 05:25:53.558223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:51.974 [2024-11-26 05:25:53.567346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ebb98 00:29:51.974 [2024-11-26 05:25:53.568061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21162 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.974 [2024-11-26 05:25:53.568094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:51.975 [2024-11-26 05:25:53.579653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190df118 00:29:51.975 [2024-11-26 05:25:53.580269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:6629 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.975 [2024-11-26 05:25:53.580302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:29:51.975 [2024-11-26 05:25:53.592052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190fda78 00:29:51.975 [2024-11-26 05:25:53.592603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:10505 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.975 [2024-11-26 05:25:53.592635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:51.975 [2024-11-26 05:25:53.604357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e1b48 00:29:51.975 [2024-11-26 05:25:53.604883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:22338 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.975 [2024-11-26 05:25:53.604913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:51.975 [2024-11-26 05:25:53.616624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190edd58 00:29:51.975 [2024-11-26 05:25:53.617130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:15221 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.975 [2024-11-26 05:25:53.617162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:51.975 [2024-11-26 05:25:53.629012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e23b8 00:29:51.975 [2024-11-26 05:25:53.629536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:19312 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.975 [2024-11-26 05:25:53.629567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:51.975 [2024-11-26 05:25:53.641317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f4298 00:29:51.975 [2024-11-26 05:25:53.641902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:15508 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.975 [2024-11-26 05:25:53.641932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:51.975 [2024-11-26 05:25:53.653550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e9168 00:29:51.975 [2024-11-26 05:25:53.654193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.975 [2024-11-26 05:25:53.654226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:51.975 [2024-11-26 05:25:53.665670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e23b8 00:29:51.975 [2024-11-26 05:25:53.667287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:9941 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.975 [2024-11-26 05:25:53.667319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:51.975 [2024-11-26 05:25:53.678135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190df988 00:29:51.975 [2024-11-26 05:25:53.679438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:5386 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.975 [2024-11-26 05:25:53.679470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:51.975 [2024-11-26 05:25:53.690722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190df988 00:29:51.975 [2024-11-26 05:25:53.692056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:2772 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.975 [2024-11-26 05:25:53.692087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:51.975 [2024-11-26 05:25:53.703110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190df988 00:29:51.975 [2024-11-26 05:25:53.704459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:5200 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.975 [2024-11-26 05:25:53.704491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:51.975 [2024-11-26 05:25:53.715674] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190df988 00:29:51.975 [2024-11-26 05:25:53.717008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:2261 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.975 [2024-11-26 05:25:53.717053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:51.975 [2024-11-26 05:25:53.728118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190fd640 00:29:51.975 [2024-11-26 05:25:53.729487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:6395 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:51.975 [2024-11-26 05:25:53.729521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:52.234 [2024-11-26 05:25:53.740681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f1430 00:29:52.234 [2024-11-26 05:25:53.742132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:23852 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.234 [2024-11-26 05:25:53.742167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:29:52.234 [2024-11-26 05:25:53.752339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e84c0 00:29:52.234 [2024-11-26 05:25:53.753346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:18467 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.234 [2024-11-26 05:25:53.753379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0030 p:0 m:0 dnr:0 00:29:52.234 [2024-11-26 05:25:53.766715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ed4e8 00:29:52.234 [2024-11-26 05:25:53.768440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:1969 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.234 [2024-11-26 05:25:53.768473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:52.234 [2024-11-26 05:25:53.779293] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e5a90 00:29:52.234 [2024-11-26 05:25:53.780554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:10554 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.234 [2024-11-26 05:25:53.780585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:52.234 [2024-11-26 05:25:53.791613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e1b48 00:29:52.234 [2024-11-26 05:25:53.792607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:13872 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.234 [2024-11-26 05:25:53.792639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:52.234 [2024-11-26 05:25:53.803980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e6b70 00:29:52.234 [2024-11-26 05:25:53.804936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:11265 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.234 [2024-11-26 05:25:53.804965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.234 [2024-11-26 05:25:53.815317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ecc78 00:29:52.234 [2024-11-26 05:25:53.816835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:20949 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.234 [2024-11-26 05:25:53.816865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:52.234 [2024-11-26 05:25:53.828611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190de8a8 00:29:52.234 [2024-11-26 05:25:53.829416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:368 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.234 [2024-11-26 05:25:53.829456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:52.234 [2024-11-26 05:25:53.841009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f92c0 00:29:52.234 [2024-11-26 05:25:53.841754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:4003 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.234 [2024-11-26 05:25:53.841784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:52.234 [2024-11-26 05:25:53.853362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e23b8 00:29:52.234 [2024-11-26 05:25:53.854061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:7083 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.234 [2024-11-26 05:25:53.854093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:29:52.234 [2024-11-26 05:25:53.865762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190df118 00:29:52.234 [2024-11-26 05:25:53.866451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:12252 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.234 [2024-11-26 05:25:53.866483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:29:52.234 [2024-11-26 05:25:53.878142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e3060 00:29:52.235 [2024-11-26 05:25:53.878881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:8434 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.235 [2024-11-26 05:25:53.878910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:29:52.235 [2024-11-26 05:25:53.890522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f2948 00:29:52.235 [2024-11-26 05:25:53.891307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:20599 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.235 [2024-11-26 05:25:53.891339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:29:52.235 [2024-11-26 05:25:53.902889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f0788 00:29:52.235 [2024-11-26 05:25:53.903674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:11663 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.235 [2024-11-26 05:25:53.903714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:29:52.235 [2024-11-26 05:25:53.914856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f4f40 00:29:52.235 [2024-11-26 05:25:53.916589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:18064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.235 [2024-11-26 05:25:53.916621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:29:52.235 [2024-11-26 05:25:53.927375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f0ff8 00:29:52.235 [2024-11-26 05:25:53.928882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:15561 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.235 [2024-11-26 05:25:53.928909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:29:52.235 [2024-11-26 05:25:53.939846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e5658 00:29:52.235 [2024-11-26 05:25:53.941308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:11987 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.235 [2024-11-26 05:25:53.941340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:29:52.235 [2024-11-26 05:25:53.952389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f7538 00:29:52.235 [2024-11-26 05:25:53.953889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:9423 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.235 [2024-11-26 05:25:53.953915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:29:52.235 [2024-11-26 05:25:53.964853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e1b48 00:29:52.235 [2024-11-26 05:25:53.966306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:18671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.235 [2024-11-26 05:25:53.966347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:29:52.235 [2024-11-26 05:25:53.978135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190feb58 00:29:52.235 [2024-11-26 05:25:53.979950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:21933 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.235 [2024-11-26 05:25:53.980009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:29:52.235 [2024-11-26 05:25:53.990078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f0ff8 00:29:52.235 [2024-11-26 05:25:53.991608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:24073 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.235 [2024-11-26 05:25:53.991638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:29:52.495 [2024-11-26 05:25:54.002097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190de8a8 00:29:52.495 [2024-11-26 05:25:54.003770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:7993 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.495 [2024-11-26 05:25:54.003800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:29:52.495 [2024-11-26 05:25:54.014600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190de038 00:29:52.495 [2024-11-26 05:25:54.016321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:18980 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.495 [2024-11-26 05:25:54.016355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:29:52.495 [2024-11-26 05:25:54.027061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e95a0 00:29:52.495 [2024-11-26 05:25:54.028742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:19972 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.495 [2024-11-26 05:25:54.028772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:29:52.495 [2024-11-26 05:25:54.039478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f7970 00:29:52.495 [2024-11-26 05:25:54.041152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:2202 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.495 [2024-11-26 05:25:54.041189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:29:52.495 [2024-11-26 05:25:54.050443] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ff3c8 00:29:52.495 [2024-11-26 05:25:54.051460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24395 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.495 [2024-11-26 05:25:54.051492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:29:52.495 [2024-11-26 05:25:54.063283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190de8a8 00:29:52.495 [2024-11-26 05:25:54.064473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:25482 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.495 [2024-11-26 05:25:54.064505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:29:52.495 [2024-11-26 05:25:54.075891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190de8a8 00:29:52.496 [2024-11-26 05:25:54.077098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:11239 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.077130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.088488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e1710 00:29:52.496 [2024-11-26 05:25:54.089705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:22078 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.089753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.101027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e1710 00:29:52.496 [2024-11-26 05:25:54.102346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:7736 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.102379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.113679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ed4e8 00:29:52.496 [2024-11-26 05:25:54.114977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:12970 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.115034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.126167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ed4e8 00:29:52.496 [2024-11-26 05:25:54.127450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:11037 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.127483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.138561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ed4e8 00:29:52.496 [2024-11-26 05:25:54.139754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:6614 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.139782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.150946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190ed4e8 00:29:52.496 [2024-11-26 05:25:54.152241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:476 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.152280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.163281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e12d8 00:29:52.496 [2024-11-26 05:25:54.164622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:8004 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.164655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.175531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f4b08 00:29:52.496 [2024-11-26 05:25:54.177006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:2844 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.177039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.187083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f7538 00:29:52.496 [2024-11-26 05:25:54.188057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:4980 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.188089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.199588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f7538 00:29:52.496 [2024-11-26 05:25:54.200865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:24266 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.200892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.211996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190f7538 00:29:52.496 [2024-11-26 05:25:54.213198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:13633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.213231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.225768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.496 [2024-11-26 05:25:54.226070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:2318 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.226105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.239429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.496 [2024-11-26 05:25:54.239714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:8798 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.239762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.496 [2024-11-26 05:25:54.253241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.496 [2024-11-26 05:25:54.253526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:10814 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.496 [2024-11-26 05:25:54.253559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.266851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.267141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:17086 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.267173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.280534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.280840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:9673 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.280870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.294315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.294588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:1799 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.294621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.308018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.308299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:16425 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.308331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.321835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.322146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:23044 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.322179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.335498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.335796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:4053 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.335827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.349273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.349554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:16658 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.349587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.362969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.363265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:3370 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.363297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.376634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.376996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:9104 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.377028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.390312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.390591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:4456 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.390623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.403918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.404213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:5458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.404245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.417468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.417764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:9363 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.417793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.431201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.431479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:18446 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.431511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.444841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.445202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:21100 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.445234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.458662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.458971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:1996 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.459018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.472405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.472682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:13920 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.472739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.486009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.486299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:5720 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.758 [2024-11-26 05:25:54.486332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.758 [2024-11-26 05:25:54.499586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.758 [2024-11-26 05:25:54.499871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:4727 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.759 [2024-11-26 05:25:54.499904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:52.759 [2024-11-26 05:25:54.513230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:52.759 [2024-11-26 05:25:54.513506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:13746 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.759 [2024-11-26 05:25:54.513538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.020 [2024-11-26 05:25:54.526772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.527120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:16707 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.527154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.540443] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.540741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:20860 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.540771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.554127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.554402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:21201 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.554435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.567833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.568123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:21353 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.568155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.581384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.581670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:5274 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.581712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.595085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.595371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:6835 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.595404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.608773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.609076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:2161 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.609109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.622435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.622741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:6788 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.622777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.636242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.636527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:1653 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.636560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.649910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.650209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:13161 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.650240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.663499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.663793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:5631 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.663823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.677048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.677336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:22469 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.677368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.690683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.691049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:14740 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.691081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.704386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.704660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:21307 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.704702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.718071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.718348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:13778 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.718379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.731757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.732119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:7457 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.732150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.745408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.745696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:24421 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.745743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.759035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.759318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:25075 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.759351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.021 [2024-11-26 05:25:54.772676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.021 [2024-11-26 05:25:54.772974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:22515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.021 [2024-11-26 05:25:54.773019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.281 [2024-11-26 05:25:54.786332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.281 [2024-11-26 05:25:54.786617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:19387 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.281 [2024-11-26 05:25:54.786652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.281 [2024-11-26 05:25:54.799941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.281 [2024-11-26 05:25:54.800230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:1546 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.281 [2024-11-26 05:25:54.800263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.281 [2024-11-26 05:25:54.813567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d843f0) with pdu=0x2000190e0a68 00:29:53.281 [2024-11-26 05:25:54.813859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:23948 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:53.281 [2024-11-26 05:25:54.813889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:53.281 00:29:53.281 Latency(us) 00:29:53.281 [2024-11-26T04:25:55.049Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:53.281 [2024-11-26T04:25:55.049Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:53.281 nvme0n1 : 2.01 19944.49 77.91 0.00 0.00 6404.01 3034.07 14466.47 00:29:53.281 [2024-11-26T04:25:55.049Z] =================================================================================================================== 00:29:53.281 [2024-11-26T04:25:55.049Z] Total : 19944.49 77.91 0.00 0.00 6404.01 3034.07 14466.47 00:29:53.281 0 00:29:53.281 05:25:54 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:53.281 05:25:54 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:53.281 05:25:54 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:53.281 | .driver_specific 00:29:53.281 | .nvme_error 00:29:53.281 | .status_code 00:29:53.281 | .command_transient_transport_error' 00:29:53.281 05:25:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:53.541 05:25:55 -- host/digest.sh@71 -- # (( 156 > 0 )) 00:29:53.541 05:25:55 -- host/digest.sh@73 -- # killprocess 3421846 00:29:53.541 05:25:55 -- common/autotest_common.sh@936 -- # '[' -z 3421846 ']' 00:29:53.541 05:25:55 -- common/autotest_common.sh@940 -- # kill -0 3421846 00:29:53.541 05:25:55 -- common/autotest_common.sh@941 -- # uname 00:29:53.541 05:25:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:53.541 05:25:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3421846 00:29:53.541 05:25:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:53.541 05:25:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:53.541 05:25:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3421846' 00:29:53.541 killing process with pid 3421846 00:29:53.541 05:25:55 -- common/autotest_common.sh@955 -- # kill 3421846 00:29:53.541 Received shutdown signal, test time was about 2.000000 seconds 00:29:53.541 00:29:53.541 Latency(us) 00:29:53.541 [2024-11-26T04:25:55.310Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:53.542 [2024-11-26T04:25:55.310Z] =================================================================================================================== 00:29:53.542 [2024-11-26T04:25:55.310Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:53.542 05:25:55 -- common/autotest_common.sh@960 -- # wait 3421846 00:29:53.800 05:25:55 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:29:53.800 05:25:55 -- host/digest.sh@54 -- # local rw bs qd 00:29:53.800 05:25:55 -- host/digest.sh@56 -- # rw=randwrite 00:29:53.800 05:25:55 -- host/digest.sh@56 -- # bs=131072 00:29:53.800 05:25:55 -- host/digest.sh@56 -- # qd=16 00:29:53.800 05:25:55 -- host/digest.sh@58 -- # bperfpid=3422398 00:29:53.800 05:25:55 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:29:53.800 05:25:55 -- host/digest.sh@60 -- # waitforlisten 3422398 /var/tmp/bperf.sock 00:29:53.800 05:25:55 -- common/autotest_common.sh@829 -- # '[' -z 3422398 ']' 00:29:53.800 05:25:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:53.800 05:25:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:53.800 05:25:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:53.800 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:53.800 05:25:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:53.800 05:25:55 -- common/autotest_common.sh@10 -- # set +x 00:29:53.800 [2024-11-26 05:25:55.405853] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:53.800 [2024-11-26 05:25:55.405938] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3422398 ] 00:29:53.801 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:53.801 Zero copy mechanism will not be used. 00:29:53.801 EAL: No free 2048 kB hugepages reported on node 1 00:29:53.801 [2024-11-26 05:25:55.464909] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:53.801 [2024-11-26 05:25:55.547605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:54.737 05:25:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:54.737 05:25:56 -- common/autotest_common.sh@862 -- # return 0 00:29:54.737 05:25:56 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:54.737 05:25:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:54.994 05:25:56 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:54.995 05:25:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:54.995 05:25:56 -- common/autotest_common.sh@10 -- # set +x 00:29:54.995 05:25:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:54.995 05:25:56 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:54.995 05:25:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:55.253 nvme0n1 00:29:55.253 05:25:57 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:55.253 05:25:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:55.253 05:25:57 -- common/autotest_common.sh@10 -- # set +x 00:29:55.253 05:25:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:55.253 05:25:57 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:55.253 05:25:57 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:55.512 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:55.513 Zero copy mechanism will not be used. 00:29:55.513 Running I/O for 2 seconds... 00:29:55.513 [2024-11-26 05:25:57.141441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.142028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.142074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.147105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.147528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.147566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.152468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.153056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.153164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.157950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.158505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.158552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.163224] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.163927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.164039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.168598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.169081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.169141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.174024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.174262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.174348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.178747] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.178881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.178923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.184282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.184509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.184556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.188957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.189461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.189523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.193666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.194038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.194070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.198169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.198604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.198642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.202716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.203051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.203082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.207203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.207503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.207585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.211716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.212030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.212082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.216197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.216383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.216412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.220758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.221014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.221093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.225345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.225701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.225756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.229983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.230441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.230473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.234700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.234896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.234972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.239257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.239520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.239551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.243846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.513 [2024-11-26 05:25:57.244202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.513 [2024-11-26 05:25:57.244292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.513 [2024-11-26 05:25:57.248450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.514 [2024-11-26 05:25:57.248789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.514 [2024-11-26 05:25:57.248840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.514 [2024-11-26 05:25:57.253020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.514 [2024-11-26 05:25:57.253231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.514 [2024-11-26 05:25:57.253262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.514 [2024-11-26 05:25:57.257541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.514 [2024-11-26 05:25:57.257954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.514 [2024-11-26 05:25:57.258037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.514 [2024-11-26 05:25:57.262029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.514 [2024-11-26 05:25:57.262347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.514 [2024-11-26 05:25:57.262427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.514 [2024-11-26 05:25:57.266497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.514 [2024-11-26 05:25:57.266722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.514 [2024-11-26 05:25:57.266801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.514 [2024-11-26 05:25:57.271021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.514 [2024-11-26 05:25:57.271220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.514 [2024-11-26 05:25:57.271299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.514 [2024-11-26 05:25:57.275584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.514 [2024-11-26 05:25:57.275846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.514 [2024-11-26 05:25:57.275878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.775 [2024-11-26 05:25:57.280062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.775 [2024-11-26 05:25:57.280410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.775 [2024-11-26 05:25:57.280442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.775 [2024-11-26 05:25:57.284519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.775 [2024-11-26 05:25:57.284891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.775 [2024-11-26 05:25:57.284986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.775 [2024-11-26 05:25:57.289221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.775 [2024-11-26 05:25:57.289421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.775 [2024-11-26 05:25:57.289451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.775 [2024-11-26 05:25:57.293543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.775 [2024-11-26 05:25:57.293805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.775 [2024-11-26 05:25:57.293890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.775 [2024-11-26 05:25:57.298133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.775 [2024-11-26 05:25:57.298329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.775 [2024-11-26 05:25:57.298418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.775 [2024-11-26 05:25:57.302593] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.775 [2024-11-26 05:25:57.302834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.775 [2024-11-26 05:25:57.302906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.775 [2024-11-26 05:25:57.307221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.307417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.307447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.311658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.311961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.312037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.316245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.316475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.316506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.320752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.320961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.321040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.325163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.325352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.325461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.329800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.330021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.330097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.334352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.334677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.334717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.338916] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.339037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.339120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.344499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.344795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.344857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.350983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.351171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.351205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.357317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.357534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.357595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.362568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.362853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.362894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.367556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.367701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.367732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.373204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.373415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.373485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.379005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.379220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.379274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.385625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.385916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.385966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.392743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.392983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.393070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.399616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.399835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.399869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.406139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.406294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.406325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.413115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.413398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.413430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.420280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.420450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.420480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.426405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.426576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.426607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.433077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.433295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.433379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.439944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.440202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.440265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.447174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.447335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.447383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.454301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.454546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.454578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.461042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.776 [2024-11-26 05:25:57.461191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.776 [2024-11-26 05:25:57.461225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.776 [2024-11-26 05:25:57.467875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.777 [2024-11-26 05:25:57.468114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.777 [2024-11-26 05:25:57.468147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.777 [2024-11-26 05:25:57.474182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.777 [2024-11-26 05:25:57.474361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.777 [2024-11-26 05:25:57.474391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.777 [2024-11-26 05:25:57.480940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.777 [2024-11-26 05:25:57.481109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.777 [2024-11-26 05:25:57.481139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.777 [2024-11-26 05:25:57.488041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.777 [2024-11-26 05:25:57.488364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.777 [2024-11-26 05:25:57.488451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.777 [2024-11-26 05:25:57.494720] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.777 [2024-11-26 05:25:57.495031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.777 [2024-11-26 05:25:57.495069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.777 [2024-11-26 05:25:57.501833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.777 [2024-11-26 05:25:57.502028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.777 [2024-11-26 05:25:57.502060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.777 [2024-11-26 05:25:57.509118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.777 [2024-11-26 05:25:57.509348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.777 [2024-11-26 05:25:57.509379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.777 [2024-11-26 05:25:57.515577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.777 [2024-11-26 05:25:57.515666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.777 [2024-11-26 05:25:57.515744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.777 [2024-11-26 05:25:57.521214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.777 [2024-11-26 05:25:57.521300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.777 [2024-11-26 05:25:57.521330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.777 [2024-11-26 05:25:57.526284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.777 [2024-11-26 05:25:57.526438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.777 [2024-11-26 05:25:57.526522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.777 [2024-11-26 05:25:57.531132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.777 [2024-11-26 05:25:57.531423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.777 [2024-11-26 05:25:57.531501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.777 [2024-11-26 05:25:57.535624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:55.777 [2024-11-26 05:25:57.535926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.777 [2024-11-26 05:25:57.536011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.038 [2024-11-26 05:25:57.540155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.038 [2024-11-26 05:25:57.540511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.038 [2024-11-26 05:25:57.540542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.038 [2024-11-26 05:25:57.544694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.038 [2024-11-26 05:25:57.544980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.038 [2024-11-26 05:25:57.545011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.038 [2024-11-26 05:25:57.549197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.038 [2024-11-26 05:25:57.549631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.038 [2024-11-26 05:25:57.549706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.038 [2024-11-26 05:25:57.553587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.038 [2024-11-26 05:25:57.553849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.038 [2024-11-26 05:25:57.553935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.038 [2024-11-26 05:25:57.558204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.038 [2024-11-26 05:25:57.558381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.038 [2024-11-26 05:25:57.558467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.038 [2024-11-26 05:25:57.562668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.038 [2024-11-26 05:25:57.563027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.038 [2024-11-26 05:25:57.563059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.038 [2024-11-26 05:25:57.567145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.038 [2024-11-26 05:25:57.567393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.038 [2024-11-26 05:25:57.567442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.038 [2024-11-26 05:25:57.571620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.038 [2024-11-26 05:25:57.571818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.038 [2024-11-26 05:25:57.571886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.038 [2024-11-26 05:25:57.576081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.038 [2024-11-26 05:25:57.576291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.038 [2024-11-26 05:25:57.576322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.038 [2024-11-26 05:25:57.580609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.038 [2024-11-26 05:25:57.580982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.038 [2024-11-26 05:25:57.581014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.038 [2024-11-26 05:25:57.585203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.038 [2024-11-26 05:25:57.585515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.038 [2024-11-26 05:25:57.585548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.038 [2024-11-26 05:25:57.589656] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.038 [2024-11-26 05:25:57.589831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.589904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.594081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.594476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.594568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.598694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.599029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.599060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.603190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.603630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.603661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.607631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.607864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.607895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.612130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.612384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.612416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.616717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.616968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.617044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.621179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.621536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.621615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.625638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.625940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.625972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.630143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.630322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.630404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.634719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.634927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.635008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.639243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.639467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.639547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.643703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.643876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.643953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.648187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.648434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.648466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.652659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.652911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.652985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.657753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.658066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.658097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.663916] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.664138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.664194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.670180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.670363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.670393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.677297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.677555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.677586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.684414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.684599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.684629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.691392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.691597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.691626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.698322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.698594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.698626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.704697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.704909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.704940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.711575] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.711938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.711998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.717821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.718182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.718213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.724817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.724990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.725019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.731203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.731356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.039 [2024-11-26 05:25:57.731408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.039 [2024-11-26 05:25:57.736807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.039 [2024-11-26 05:25:57.736892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.736922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.741724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.741903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.741980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.746341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.746546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.746575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.750856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.751177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.751209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.755313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.755579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.755656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.759822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.760033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.760103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.764305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.764550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.764622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.768773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.769079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.769111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.773268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.773460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.773490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.777789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.778118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.778210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.782331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.782574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.782643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.786944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.787286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.787323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.791356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.791638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.791684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.795877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.796132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.796186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.040 [2024-11-26 05:25:57.800499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.040 [2024-11-26 05:25:57.800826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.040 [2024-11-26 05:25:57.800860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.804925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.805246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.805336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.809395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.809599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.809703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.813800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.813997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.814027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.818374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.818490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.818560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.822943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.823260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.823291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.827431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.827724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.827794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.831876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.832169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.832223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.836412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.836781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.836814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.840939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.841238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.841296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.845319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.845553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.845584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.849887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.850146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.850204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.854409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.854694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.854747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.858784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.858961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.858991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.863234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.863481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.863513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.867806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.868060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.868117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.872509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.873014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.873046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.876930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.877285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.877378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.881418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.881640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.881671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.885827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.886033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.886120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.890250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.890442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.890472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.894922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.895154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.895236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.899307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.899653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.899754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.301 [2024-11-26 05:25:57.903715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.301 [2024-11-26 05:25:57.903904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.301 [2024-11-26 05:25:57.903961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.908234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.908356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.908434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.912783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.913238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.913269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.917176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.917505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.917551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.921673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.921918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.922001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.926316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.926484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.926512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.931118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.931419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.931451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.935588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.935990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.936023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.940298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.940622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.940669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.944750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.945014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.945045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.949798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.950038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.950115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.955764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.955907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.955936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.962292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.962486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.962516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.969063] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.969248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.969277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.975821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.976009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.976045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.982600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.982784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.982813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.989507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.989659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.989700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:57.996337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:57.996488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:57.996517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:58.003662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:58.003892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:58.003971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:58.010991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:58.011303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:58.011335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:58.018016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:58.018264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:58.018295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:58.025349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:58.025584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:58.025666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:58.032445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:58.032600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:58.032630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:58.039870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:58.040072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:58.040102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:58.046826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:58.046949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:58.046982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:58.053390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:58.053562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:58.053591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.302 [2024-11-26 05:25:58.060113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.302 [2024-11-26 05:25:58.060335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.302 [2024-11-26 05:25:58.060367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.563 [2024-11-26 05:25:58.066988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.563 [2024-11-26 05:25:58.067233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.563 [2024-11-26 05:25:58.067309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.563 [2024-11-26 05:25:58.073867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.563 [2024-11-26 05:25:58.074067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.563 [2024-11-26 05:25:58.074113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.563 [2024-11-26 05:25:58.080710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.563 [2024-11-26 05:25:58.080963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.563 [2024-11-26 05:25:58.080995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.563 [2024-11-26 05:25:58.087836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.563 [2024-11-26 05:25:58.088015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.563 [2024-11-26 05:25:58.088052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.094636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.094907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.094939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.101872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.102055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.102083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.108733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.108894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.108932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.115846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.116017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.116099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.122230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.122480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.122511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.129499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.129901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.129932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.136534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.136934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.136994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.143550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.143828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.143858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.150517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.150819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.150859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.157557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.157773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.157811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.164341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.164472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.164501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.171553] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.171761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.171791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.178638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.178921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.178955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.185535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.185906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.185975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.192657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.192871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.192902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.199753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.199894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.199931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.205574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.205858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.205890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.210441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.210975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.211077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.215295] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.215811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.215894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.220149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.564 [2024-11-26 05:25:58.220527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.564 [2024-11-26 05:25:58.220562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.564 [2024-11-26 05:25:58.224962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.225313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.225348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.229823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.230325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.230359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.234533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.234963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.235063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.239433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.239868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.239948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.244323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.244554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.244608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.249176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.249556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.249641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.254073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.254344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.254379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.258915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.259216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.259309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.263911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.264243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.264336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.268787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.269177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.269212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.273599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.273988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.274104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.278421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.278695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.278739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.283251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.283683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.283730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.288071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.288490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.288524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.292873] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.293398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.293434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.297809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.298219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.298307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.302785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.303009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.303052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.307765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.308131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.308214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.312699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.313184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.313219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.317662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.318016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.318051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.565 [2024-11-26 05:25:58.322563] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.565 [2024-11-26 05:25:58.323044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.565 [2024-11-26 05:25:58.323123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.825 [2024-11-26 05:25:58.327467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.825 [2024-11-26 05:25:58.327847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.825 [2024-11-26 05:25:58.327908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.825 [2024-11-26 05:25:58.332274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.825 [2024-11-26 05:25:58.332816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.825 [2024-11-26 05:25:58.332897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.825 [2024-11-26 05:25:58.337090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.825 [2024-11-26 05:25:58.337419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.825 [2024-11-26 05:25:58.337461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.825 [2024-11-26 05:25:58.341824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.825 [2024-11-26 05:25:58.342347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.825 [2024-11-26 05:25:58.342381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.825 [2024-11-26 05:25:58.346540] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.825 [2024-11-26 05:25:58.346961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.825 [2024-11-26 05:25:58.347059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.825 [2024-11-26 05:25:58.351460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.825 [2024-11-26 05:25:58.351773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.825 [2024-11-26 05:25:58.351855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.825 [2024-11-26 05:25:58.356454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.825 [2024-11-26 05:25:58.356855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.825 [2024-11-26 05:25:58.356894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.825 [2024-11-26 05:25:58.361328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.825 [2024-11-26 05:25:58.361714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.825 [2024-11-26 05:25:58.361806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.825 [2024-11-26 05:25:58.366119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.825 [2024-11-26 05:25:58.366517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.825 [2024-11-26 05:25:58.366551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.825 [2024-11-26 05:25:58.370984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.371338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.371419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.375729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.376134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.376170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.380588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.380888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.380959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.385559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.385865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.385904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.390283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.390757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.390790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.395149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.395635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.395736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.400109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.400385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.400474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.404888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.405149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.405237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.409729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.410050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.410133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.414576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.414955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.415062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.419440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.419801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.419884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.424128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.424540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.424577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.428950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.429407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.429499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.433787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.434209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.434298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.438559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.438996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.439028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.443473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.443803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.443835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.448328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.448799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.448830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.453200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.453793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.453824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.458142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.458433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.458465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.462994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.463311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.463396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.467834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.468153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.826 [2024-11-26 05:25:58.468239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.826 [2024-11-26 05:25:58.472538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.826 [2024-11-26 05:25:58.472816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.472898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.477257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.477506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.477539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.481912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.482132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.482163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.486390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.486574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.486639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.491033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.491257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.491333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.495533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.495741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.495779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.500003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.500346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.500447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.504601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.504908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.505003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.509030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.509391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.509421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.513515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.513738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.513769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.517926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.518101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.518131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.522510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.522885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.522916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.527130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.527420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.527450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.531631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.532082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.532114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.536327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.536556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.536587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.540907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.541195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.541289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.545490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.545816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.545902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.550112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.550511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.550541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.554657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.554959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.555071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.559320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.559642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.559743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.563866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.564108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.564190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.568393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.827 [2024-11-26 05:25:58.568525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.827 [2024-11-26 05:25:58.568613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.827 [2024-11-26 05:25:58.573058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.828 [2024-11-26 05:25:58.573387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.828 [2024-11-26 05:25:58.573435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.828 [2024-11-26 05:25:58.577587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.828 [2024-11-26 05:25:58.577925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.828 [2024-11-26 05:25:58.578032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.828 [2024-11-26 05:25:58.582152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.828 [2024-11-26 05:25:58.582450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.828 [2024-11-26 05:25:58.582573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.828 [2024-11-26 05:25:58.586775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:56.828 [2024-11-26 05:25:58.587086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.828 [2024-11-26 05:25:58.587194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.591308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.591567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.591639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.596102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.596240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.596307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.600582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.600937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.601038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.605124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.605333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.605405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.609572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.609838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.609903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.614344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.614609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.614640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.619063] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.619508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.619540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.623575] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.623917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.623947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.628294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.628597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.628663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.632878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.633198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.633285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.637729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.638147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.638179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.642419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.642677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.642787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.647091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.647315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.647392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.651761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.652139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.652221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.656471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.656669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.656773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.661003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.661341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.661373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.665640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.666089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.089 [2024-11-26 05:25:58.666133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.089 [2024-11-26 05:25:58.670430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.089 [2024-11-26 05:25:58.670840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.670920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.675136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.675439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.675477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.679666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.679898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.679980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.684410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.684525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.684607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.689206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.689498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.689533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.693883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.694140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.694198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.698439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.698796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.698829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.703023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.703313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.703397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.707643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.708059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.708138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.712302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.712619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.712720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.716894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.717251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.717341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.721622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.721933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.721965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.726293] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.726624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.726656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.730913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.731159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.731236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.735571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.735965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.736016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.740203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.740720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.740761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.744698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.745106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.745139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.749491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.749776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.749860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.754156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.754495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.754527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.758844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.759155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.759188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.763448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.763811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.763842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.768101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.768462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.768560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.772709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.773116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.773200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.090 [2024-11-26 05:25:58.777526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.090 [2024-11-26 05:25:58.778103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.090 [2024-11-26 05:25:58.778188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.782284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.782779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.782861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.786839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.787094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.787186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.791607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.791957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.792022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.796649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.796862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.796892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.801458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.801822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.801854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.806254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.806520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.806554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.811051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.811289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.811371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.815666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.815984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.816040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.820404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.820705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.820753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.825266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.825674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.825720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.830106] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.830420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.830510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.834817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.835255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.835323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.839777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.840008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.840067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.844493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.844832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.844894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.091 [2024-11-26 05:25:58.849502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.091 [2024-11-26 05:25:58.849929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.091 [2024-11-26 05:25:58.850034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.353 [2024-11-26 05:25:58.854448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.353 [2024-11-26 05:25:58.854820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.353 [2024-11-26 05:25:58.854901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.353 [2024-11-26 05:25:58.859331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.353 [2024-11-26 05:25:58.859805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.353 [2024-11-26 05:25:58.859851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.353 [2024-11-26 05:25:58.864160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.353 [2024-11-26 05:25:58.864481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.353 [2024-11-26 05:25:58.864571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.353 [2024-11-26 05:25:58.869115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.353 [2024-11-26 05:25:58.869314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.353 [2024-11-26 05:25:58.869403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.353 [2024-11-26 05:25:58.874141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.353 [2024-11-26 05:25:58.874586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.353 [2024-11-26 05:25:58.874665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.353 [2024-11-26 05:25:58.879063] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.353 [2024-11-26 05:25:58.879412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.353 [2024-11-26 05:25:58.879447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.353 [2024-11-26 05:25:58.884251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.353 [2024-11-26 05:25:58.884619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.353 [2024-11-26 05:25:58.884653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.353 [2024-11-26 05:25:58.890447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.353 [2024-11-26 05:25:58.890628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.353 [2024-11-26 05:25:58.890661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.353 [2024-11-26 05:25:58.897799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.353 [2024-11-26 05:25:58.897952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.353 [2024-11-26 05:25:58.897982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.353 [2024-11-26 05:25:58.904543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.353 [2024-11-26 05:25:58.904739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.353 [2024-11-26 05:25:58.904768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:58.911396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:58.911579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:58.911611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:58.918917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:58.919145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:58.919204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:58.925913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:58.926062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:58.926110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:58.933549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:58.933807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:58.933844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:58.940918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:58.941272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:58.941305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:58.948009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:58.948315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:58.948348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:58.954981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:58.955178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:58.955211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:58.962439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:58.962618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:58.962649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:58.969860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:58.970153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:58.970187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:58.977062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:58.977233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:58.977272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:58.984503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:58.984777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:58.984823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:58.992039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:58.992271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:58.992306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:58.999137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:58.999327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:58.999359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:59.006521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:59.006682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:59.006762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:59.013920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:59.014083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:59.014115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:59.021490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:59.021851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:59.021917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:59.028721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:59.028983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:59.029032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:59.036156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:59.036310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:59.036343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:59.043252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:59.043548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:59.043638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:59.050379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:59.050595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:59.050624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:59.057194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:59.057418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:59.057452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.354 [2024-11-26 05:25:59.064673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.354 [2024-11-26 05:25:59.064886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.354 [2024-11-26 05:25:59.064915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.355 [2024-11-26 05:25:59.072055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.355 [2024-11-26 05:25:59.072213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-26 05:25:59.072251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.355 [2024-11-26 05:25:59.079364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.355 [2024-11-26 05:25:59.079600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-26 05:25:59.079676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.355 [2024-11-26 05:25:59.086411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.355 [2024-11-26 05:25:59.086616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-26 05:25:59.086648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.355 [2024-11-26 05:25:59.093702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.355 [2024-11-26 05:25:59.093841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-26 05:25:59.093870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.355 [2024-11-26 05:25:59.100932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.355 [2024-11-26 05:25:59.101327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-26 05:25:59.101361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.355 [2024-11-26 05:25:59.108321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.355 [2024-11-26 05:25:59.108629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-26 05:25:59.108744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.355 [2024-11-26 05:25:59.115784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.355 [2024-11-26 05:25:59.116109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-26 05:25:59.116150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.619 [2024-11-26 05:25:59.123051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.619 [2024-11-26 05:25:59.123278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-26 05:25:59.123337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.619 [2024-11-26 05:25:59.130129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1d84590) with pdu=0x2000190fef90 00:29:57.619 [2024-11-26 05:25:59.130327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-26 05:25:59.130355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.619 00:29:57.619 Latency(us) 00:29:57.619 [2024-11-26T04:25:59.387Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:57.619 [2024-11-26T04:25:59.387Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:57.619 nvme0n1 : 2.00 5801.27 725.16 0.00 0.00 2747.06 1650.54 10340.12 00:29:57.619 [2024-11-26T04:25:59.388Z] =================================================================================================================== 00:29:57.620 [2024-11-26T04:25:59.388Z] Total : 5801.27 725.16 0.00 0.00 2747.06 1650.54 10340.12 00:29:57.620 0 00:29:57.620 05:25:59 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:57.620 05:25:59 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:57.620 05:25:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:57.620 05:25:59 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:57.620 | .driver_specific 00:29:57.620 | .nvme_error 00:29:57.620 | .status_code 00:29:57.620 | .command_transient_transport_error' 00:29:57.880 05:25:59 -- host/digest.sh@71 -- # (( 374 > 0 )) 00:29:57.880 05:25:59 -- host/digest.sh@73 -- # killprocess 3422398 00:29:57.880 05:25:59 -- common/autotest_common.sh@936 -- # '[' -z 3422398 ']' 00:29:57.880 05:25:59 -- common/autotest_common.sh@940 -- # kill -0 3422398 00:29:57.880 05:25:59 -- common/autotest_common.sh@941 -- # uname 00:29:57.880 05:25:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:57.880 05:25:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3422398 00:29:57.880 05:25:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:57.880 05:25:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:57.880 05:25:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3422398' 00:29:57.880 killing process with pid 3422398 00:29:57.880 05:25:59 -- common/autotest_common.sh@955 -- # kill 3422398 00:29:57.880 Received shutdown signal, test time was about 2.000000 seconds 00:29:57.880 00:29:57.880 Latency(us) 00:29:57.880 [2024-11-26T04:25:59.648Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:57.880 [2024-11-26T04:25:59.648Z] =================================================================================================================== 00:29:57.880 [2024-11-26T04:25:59.648Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:57.880 05:25:59 -- common/autotest_common.sh@960 -- # wait 3422398 00:29:58.140 05:25:59 -- host/digest.sh@115 -- # killprocess 3420851 00:29:58.140 05:25:59 -- common/autotest_common.sh@936 -- # '[' -z 3420851 ']' 00:29:58.140 05:25:59 -- common/autotest_common.sh@940 -- # kill -0 3420851 00:29:58.140 05:25:59 -- common/autotest_common.sh@941 -- # uname 00:29:58.140 05:25:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:58.140 05:25:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3420851 00:29:58.140 05:25:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:58.140 05:25:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:58.140 05:25:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3420851' 00:29:58.140 killing process with pid 3420851 00:29:58.140 05:25:59 -- common/autotest_common.sh@955 -- # kill 3420851 00:29:58.140 05:25:59 -- common/autotest_common.sh@960 -- # wait 3420851 00:29:58.400 00:29:58.400 real 0m17.150s 00:29:58.400 user 0m33.619s 00:29:58.400 sys 0m4.578s 00:29:58.400 05:25:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:58.400 05:25:59 -- common/autotest_common.sh@10 -- # set +x 00:29:58.400 ************************************ 00:29:58.400 END TEST nvmf_digest_error 00:29:58.400 ************************************ 00:29:58.400 05:25:59 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:29:58.400 05:25:59 -- host/digest.sh@139 -- # nvmftestfini 00:29:58.400 05:25:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:58.400 05:25:59 -- nvmf/common.sh@116 -- # sync 00:29:58.400 05:25:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:58.400 05:25:59 -- nvmf/common.sh@119 -- # set +e 00:29:58.400 05:25:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:58.400 05:25:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:58.400 rmmod nvme_tcp 00:29:58.400 rmmod nvme_fabrics 00:29:58.400 rmmod nvme_keyring 00:29:58.400 05:26:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:58.400 05:26:00 -- nvmf/common.sh@123 -- # set -e 00:29:58.400 05:26:00 -- nvmf/common.sh@124 -- # return 0 00:29:58.400 05:26:00 -- nvmf/common.sh@477 -- # '[' -n 3420851 ']' 00:29:58.400 05:26:00 -- nvmf/common.sh@478 -- # killprocess 3420851 00:29:58.400 05:26:00 -- common/autotest_common.sh@936 -- # '[' -z 3420851 ']' 00:29:58.400 05:26:00 -- common/autotest_common.sh@940 -- # kill -0 3420851 00:29:58.400 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3420851) - No such process 00:29:58.400 05:26:00 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3420851 is not found' 00:29:58.400 Process with pid 3420851 is not found 00:29:58.400 05:26:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:58.400 05:26:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:58.400 05:26:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:58.400 05:26:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:58.400 05:26:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:58.400 05:26:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:58.400 05:26:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:58.400 05:26:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:00.309 05:26:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:00.309 00:30:00.309 real 0m36.991s 00:30:00.309 user 1m4.898s 00:30:00.309 sys 0m10.442s 00:30:00.309 05:26:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:00.309 05:26:02 -- common/autotest_common.sh@10 -- # set +x 00:30:00.309 ************************************ 00:30:00.309 END TEST nvmf_digest 00:30:00.309 ************************************ 00:30:00.569 05:26:02 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:30:00.569 05:26:02 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:30:00.569 05:26:02 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:30:00.569 05:26:02 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:00.569 05:26:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:00.569 05:26:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:00.569 05:26:02 -- common/autotest_common.sh@10 -- # set +x 00:30:00.569 ************************************ 00:30:00.569 START TEST nvmf_bdevperf 00:30:00.570 ************************************ 00:30:00.570 05:26:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:00.570 * Looking for test storage... 00:30:00.570 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:00.570 05:26:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:00.570 05:26:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:00.570 05:26:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:00.570 05:26:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:00.570 05:26:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:00.570 05:26:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:00.570 05:26:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:00.570 05:26:02 -- scripts/common.sh@335 -- # IFS=.-: 00:30:00.570 05:26:02 -- scripts/common.sh@335 -- # read -ra ver1 00:30:00.570 05:26:02 -- scripts/common.sh@336 -- # IFS=.-: 00:30:00.570 05:26:02 -- scripts/common.sh@336 -- # read -ra ver2 00:30:00.570 05:26:02 -- scripts/common.sh@337 -- # local 'op=<' 00:30:00.570 05:26:02 -- scripts/common.sh@339 -- # ver1_l=2 00:30:00.570 05:26:02 -- scripts/common.sh@340 -- # ver2_l=1 00:30:00.570 05:26:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:00.570 05:26:02 -- scripts/common.sh@343 -- # case "$op" in 00:30:00.570 05:26:02 -- scripts/common.sh@344 -- # : 1 00:30:00.570 05:26:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:00.570 05:26:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:00.570 05:26:02 -- scripts/common.sh@364 -- # decimal 1 00:30:00.570 05:26:02 -- scripts/common.sh@352 -- # local d=1 00:30:00.570 05:26:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:00.570 05:26:02 -- scripts/common.sh@354 -- # echo 1 00:30:00.570 05:26:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:00.570 05:26:02 -- scripts/common.sh@365 -- # decimal 2 00:30:00.570 05:26:02 -- scripts/common.sh@352 -- # local d=2 00:30:00.570 05:26:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:00.570 05:26:02 -- scripts/common.sh@354 -- # echo 2 00:30:00.570 05:26:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:00.570 05:26:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:00.570 05:26:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:00.570 05:26:02 -- scripts/common.sh@367 -- # return 0 00:30:00.570 05:26:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:00.570 05:26:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:00.570 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:00.570 --rc genhtml_branch_coverage=1 00:30:00.570 --rc genhtml_function_coverage=1 00:30:00.570 --rc genhtml_legend=1 00:30:00.570 --rc geninfo_all_blocks=1 00:30:00.570 --rc geninfo_unexecuted_blocks=1 00:30:00.570 00:30:00.570 ' 00:30:00.570 05:26:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:00.570 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:00.570 --rc genhtml_branch_coverage=1 00:30:00.570 --rc genhtml_function_coverage=1 00:30:00.570 --rc genhtml_legend=1 00:30:00.570 --rc geninfo_all_blocks=1 00:30:00.570 --rc geninfo_unexecuted_blocks=1 00:30:00.570 00:30:00.570 ' 00:30:00.570 05:26:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:00.570 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:00.570 --rc genhtml_branch_coverage=1 00:30:00.570 --rc genhtml_function_coverage=1 00:30:00.570 --rc genhtml_legend=1 00:30:00.570 --rc geninfo_all_blocks=1 00:30:00.570 --rc geninfo_unexecuted_blocks=1 00:30:00.570 00:30:00.570 ' 00:30:00.570 05:26:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:00.570 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:00.570 --rc genhtml_branch_coverage=1 00:30:00.570 --rc genhtml_function_coverage=1 00:30:00.570 --rc genhtml_legend=1 00:30:00.570 --rc geninfo_all_blocks=1 00:30:00.570 --rc geninfo_unexecuted_blocks=1 00:30:00.570 00:30:00.570 ' 00:30:00.570 05:26:02 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:00.570 05:26:02 -- nvmf/common.sh@7 -- # uname -s 00:30:00.570 05:26:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:00.570 05:26:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:00.570 05:26:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:00.570 05:26:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:00.570 05:26:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:00.570 05:26:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:00.570 05:26:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:00.570 05:26:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:00.570 05:26:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:00.570 05:26:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:00.570 05:26:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:00.570 05:26:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:00.570 05:26:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:00.570 05:26:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:00.570 05:26:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:00.570 05:26:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:00.570 05:26:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:00.570 05:26:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:00.570 05:26:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:00.570 05:26:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:00.570 05:26:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:00.570 05:26:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:00.570 05:26:02 -- paths/export.sh@5 -- # export PATH 00:30:00.570 05:26:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:00.570 05:26:02 -- nvmf/common.sh@46 -- # : 0 00:30:00.570 05:26:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:00.571 05:26:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:00.571 05:26:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:00.571 05:26:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:00.571 05:26:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:00.571 05:26:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:00.571 05:26:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:00.571 05:26:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:00.571 05:26:02 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:00.571 05:26:02 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:00.571 05:26:02 -- host/bdevperf.sh@24 -- # nvmftestinit 00:30:00.571 05:26:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:00.571 05:26:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:00.571 05:26:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:00.571 05:26:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:00.571 05:26:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:00.571 05:26:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:00.571 05:26:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:00.571 05:26:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:00.571 05:26:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:00.571 05:26:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:00.571 05:26:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:00.571 05:26:02 -- common/autotest_common.sh@10 -- # set +x 00:30:03.103 05:26:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:03.103 05:26:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:03.103 05:26:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:03.103 05:26:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:03.103 05:26:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:03.103 05:26:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:03.103 05:26:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:03.103 05:26:04 -- nvmf/common.sh@294 -- # net_devs=() 00:30:03.103 05:26:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:03.103 05:26:04 -- nvmf/common.sh@295 -- # e810=() 00:30:03.103 05:26:04 -- nvmf/common.sh@295 -- # local -ga e810 00:30:03.103 05:26:04 -- nvmf/common.sh@296 -- # x722=() 00:30:03.103 05:26:04 -- nvmf/common.sh@296 -- # local -ga x722 00:30:03.103 05:26:04 -- nvmf/common.sh@297 -- # mlx=() 00:30:03.103 05:26:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:03.103 05:26:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:03.103 05:26:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:03.103 05:26:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:03.103 05:26:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:03.103 05:26:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:03.103 05:26:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:03.103 05:26:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:03.103 05:26:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:03.103 05:26:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:03.103 05:26:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:03.103 05:26:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:03.103 05:26:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:03.103 05:26:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:03.103 05:26:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:03.103 05:26:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:03.103 05:26:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:03.103 05:26:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:03.103 05:26:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:03.103 05:26:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:03.103 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:03.103 05:26:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:03.103 05:26:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:03.103 05:26:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:03.103 05:26:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:03.103 05:26:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:03.103 05:26:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:03.103 05:26:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:03.103 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:03.103 05:26:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:03.103 05:26:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:03.103 05:26:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:03.104 05:26:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:03.104 05:26:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:03.104 05:26:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:03.104 05:26:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:03.104 05:26:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:03.104 05:26:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:03.104 05:26:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:03.104 05:26:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:03.104 05:26:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:03.104 05:26:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:03.104 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:03.104 05:26:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:03.104 05:26:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:03.104 05:26:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:03.104 05:26:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:03.104 05:26:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:03.104 05:26:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:03.104 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:03.104 05:26:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:03.104 05:26:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:03.104 05:26:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:03.104 05:26:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:03.104 05:26:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:03.104 05:26:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:03.104 05:26:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:03.104 05:26:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:03.104 05:26:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:03.104 05:26:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:03.104 05:26:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:03.104 05:26:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:03.104 05:26:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:03.104 05:26:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:03.104 05:26:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:03.104 05:26:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:03.104 05:26:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:03.104 05:26:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:03.104 05:26:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:03.104 05:26:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:03.104 05:26:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:03.104 05:26:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:03.104 05:26:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:03.104 05:26:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:03.104 05:26:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:03.104 05:26:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:03.104 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:03.104 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:30:03.104 00:30:03.104 --- 10.0.0.2 ping statistics --- 00:30:03.104 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:03.104 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:30:03.104 05:26:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:03.104 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:03.104 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.175 ms 00:30:03.104 00:30:03.104 --- 10.0.0.1 ping statistics --- 00:30:03.104 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:03.104 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:30:03.104 05:26:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:03.104 05:26:04 -- nvmf/common.sh@410 -- # return 0 00:30:03.104 05:26:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:03.104 05:26:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:03.104 05:26:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:03.104 05:26:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:03.104 05:26:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:03.104 05:26:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:03.104 05:26:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:03.104 05:26:04 -- host/bdevperf.sh@25 -- # tgt_init 00:30:03.104 05:26:04 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:03.104 05:26:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:03.104 05:26:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:03.104 05:26:04 -- common/autotest_common.sh@10 -- # set +x 00:30:03.104 05:26:04 -- nvmf/common.sh@469 -- # nvmfpid=3424908 00:30:03.104 05:26:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:03.104 05:26:04 -- nvmf/common.sh@470 -- # waitforlisten 3424908 00:30:03.104 05:26:04 -- common/autotest_common.sh@829 -- # '[' -z 3424908 ']' 00:30:03.104 05:26:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:03.104 05:26:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:03.104 05:26:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:03.104 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:03.104 05:26:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:03.104 05:26:04 -- common/autotest_common.sh@10 -- # set +x 00:30:03.104 [2024-11-26 05:26:04.472324] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:03.104 [2024-11-26 05:26:04.472410] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:03.104 EAL: No free 2048 kB hugepages reported on node 1 00:30:03.104 [2024-11-26 05:26:04.538292] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:03.104 [2024-11-26 05:26:04.626830] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:03.104 [2024-11-26 05:26:04.626986] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:03.104 [2024-11-26 05:26:04.627004] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:03.104 [2024-11-26 05:26:04.627016] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:03.104 [2024-11-26 05:26:04.627137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:03.104 [2024-11-26 05:26:04.627178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:03.104 [2024-11-26 05:26:04.627181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:04.040 05:26:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:04.040 05:26:05 -- common/autotest_common.sh@862 -- # return 0 00:30:04.040 05:26:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:04.040 05:26:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:04.040 05:26:05 -- common/autotest_common.sh@10 -- # set +x 00:30:04.040 05:26:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:04.040 05:26:05 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:04.040 05:26:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.040 05:26:05 -- common/autotest_common.sh@10 -- # set +x 00:30:04.040 [2024-11-26 05:26:05.482840] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:04.040 05:26:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.040 05:26:05 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:04.040 05:26:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.040 05:26:05 -- common/autotest_common.sh@10 -- # set +x 00:30:04.040 Malloc0 00:30:04.040 05:26:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.040 05:26:05 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:04.040 05:26:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.040 05:26:05 -- common/autotest_common.sh@10 -- # set +x 00:30:04.040 05:26:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.040 05:26:05 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:04.040 05:26:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.040 05:26:05 -- common/autotest_common.sh@10 -- # set +x 00:30:04.040 05:26:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.040 05:26:05 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:04.040 05:26:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.040 05:26:05 -- common/autotest_common.sh@10 -- # set +x 00:30:04.040 [2024-11-26 05:26:05.538195] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:04.040 05:26:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.040 05:26:05 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:30:04.040 05:26:05 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:30:04.040 05:26:05 -- nvmf/common.sh@520 -- # config=() 00:30:04.040 05:26:05 -- nvmf/common.sh@520 -- # local subsystem config 00:30:04.040 05:26:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:04.040 05:26:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:04.040 { 00:30:04.040 "params": { 00:30:04.040 "name": "Nvme$subsystem", 00:30:04.040 "trtype": "$TEST_TRANSPORT", 00:30:04.040 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:04.040 "adrfam": "ipv4", 00:30:04.040 "trsvcid": "$NVMF_PORT", 00:30:04.040 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:04.040 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:04.040 "hdgst": ${hdgst:-false}, 00:30:04.040 "ddgst": ${ddgst:-false} 00:30:04.040 }, 00:30:04.041 "method": "bdev_nvme_attach_controller" 00:30:04.041 } 00:30:04.041 EOF 00:30:04.041 )") 00:30:04.041 05:26:05 -- nvmf/common.sh@542 -- # cat 00:30:04.041 05:26:05 -- nvmf/common.sh@544 -- # jq . 00:30:04.041 05:26:05 -- nvmf/common.sh@545 -- # IFS=, 00:30:04.041 05:26:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:04.041 "params": { 00:30:04.041 "name": "Nvme1", 00:30:04.041 "trtype": "tcp", 00:30:04.041 "traddr": "10.0.0.2", 00:30:04.041 "adrfam": "ipv4", 00:30:04.041 "trsvcid": "4420", 00:30:04.041 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:04.041 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:04.041 "hdgst": false, 00:30:04.041 "ddgst": false 00:30:04.041 }, 00:30:04.041 "method": "bdev_nvme_attach_controller" 00:30:04.041 }' 00:30:04.041 [2024-11-26 05:26:05.580532] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:04.041 [2024-11-26 05:26:05.580626] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3425067 ] 00:30:04.041 EAL: No free 2048 kB hugepages reported on node 1 00:30:04.041 [2024-11-26 05:26:05.644563] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:04.041 [2024-11-26 05:26:05.728088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:04.300 Running I/O for 1 seconds... 00:30:05.680 00:30:05.680 Latency(us) 00:30:05.680 [2024-11-26T04:26:07.448Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:05.680 [2024-11-26T04:26:07.448Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:05.680 Verification LBA range: start 0x0 length 0x4000 00:30:05.680 Nvme1n1 : 1.01 12868.11 50.27 0.00 0.00 9901.86 1771.90 16990.81 00:30:05.680 [2024-11-26T04:26:07.448Z] =================================================================================================================== 00:30:05.680 [2024-11-26T04:26:07.448Z] Total : 12868.11 50.27 0.00 0.00 9901.86 1771.90 16990.81 00:30:05.680 05:26:07 -- host/bdevperf.sh@30 -- # bdevperfpid=3425216 00:30:05.680 05:26:07 -- host/bdevperf.sh@32 -- # sleep 3 00:30:05.680 05:26:07 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:30:05.680 05:26:07 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:30:05.680 05:26:07 -- nvmf/common.sh@520 -- # config=() 00:30:05.680 05:26:07 -- nvmf/common.sh@520 -- # local subsystem config 00:30:05.680 05:26:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:05.680 05:26:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:05.680 { 00:30:05.680 "params": { 00:30:05.680 "name": "Nvme$subsystem", 00:30:05.680 "trtype": "$TEST_TRANSPORT", 00:30:05.680 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:05.680 "adrfam": "ipv4", 00:30:05.680 "trsvcid": "$NVMF_PORT", 00:30:05.680 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:05.680 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:05.680 "hdgst": ${hdgst:-false}, 00:30:05.680 "ddgst": ${ddgst:-false} 00:30:05.680 }, 00:30:05.680 "method": "bdev_nvme_attach_controller" 00:30:05.680 } 00:30:05.680 EOF 00:30:05.680 )") 00:30:05.680 05:26:07 -- nvmf/common.sh@542 -- # cat 00:30:05.680 05:26:07 -- nvmf/common.sh@544 -- # jq . 00:30:05.680 05:26:07 -- nvmf/common.sh@545 -- # IFS=, 00:30:05.680 05:26:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:05.680 "params": { 00:30:05.680 "name": "Nvme1", 00:30:05.680 "trtype": "tcp", 00:30:05.680 "traddr": "10.0.0.2", 00:30:05.680 "adrfam": "ipv4", 00:30:05.680 "trsvcid": "4420", 00:30:05.680 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:05.680 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:05.680 "hdgst": false, 00:30:05.680 "ddgst": false 00:30:05.680 }, 00:30:05.680 "method": "bdev_nvme_attach_controller" 00:30:05.680 }' 00:30:05.680 [2024-11-26 05:26:07.319748] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:05.680 [2024-11-26 05:26:07.319836] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3425216 ] 00:30:05.680 EAL: No free 2048 kB hugepages reported on node 1 00:30:05.680 [2024-11-26 05:26:07.382277] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:05.939 [2024-11-26 05:26:07.463828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:05.939 Running I/O for 15 seconds... 00:30:09.237 05:26:10 -- host/bdevperf.sh@33 -- # kill -9 3424908 00:30:09.237 05:26:10 -- host/bdevperf.sh@35 -- # sleep 3 00:30:09.237 [2024-11-26 05:26:10.293963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:8976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:9016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:9048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:9056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:9080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:9096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:8552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:8568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:8584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:8592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:8600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:8608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:8616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:8624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:9112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:9120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:9128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:9144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:9168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:9176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:9200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:9208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:9224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.237 [2024-11-26 05:26:10.294912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:9232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.237 [2024-11-26 05:26:10.294941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.294956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:9240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.237 [2024-11-26 05:26:10.294969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.237 [2024-11-26 05:26:10.295002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:9248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.238 [2024-11-26 05:26:10.295021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:9256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:9264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:8632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:8672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:8680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:8704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:8712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:8736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:8752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:8760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:8784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:8792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:8808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:8816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:8848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:8856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:9272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.238 [2024-11-26 05:26:10.295623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:9280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:9296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.238 [2024-11-26 05:26:10.295756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:9304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.238 [2024-11-26 05:26:10.295786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:9312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:9320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:8880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:8920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.295959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.295992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:8936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.296006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.296022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:8944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.296037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.296053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:8952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.296068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.296084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:8960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.296098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.296115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:9328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.296129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.296145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:9336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.238 [2024-11-26 05:26:10.296159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.296175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.296189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.296206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:9352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.238 [2024-11-26 05:26:10.296222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.296238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:9360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.296257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.238 [2024-11-26 05:26:10.296274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:9368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.238 [2024-11-26 05:26:10.296289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:9376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.296320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:9384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.296350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:9392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.296381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:9400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.296411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:9408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.296442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.296472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:9424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.296502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:9432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.296533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.296563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:9448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.296594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:9456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.296624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:9464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.296660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:9472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.296700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:9480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.296733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:9488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.296777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:9496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.296806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:8968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.296833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:8984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.296860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:8992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.296887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:9000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.296915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:9024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.296951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.296965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:9032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.296993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:9064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.297024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:9072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.297063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:9504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.297095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:9512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.297125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:9520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.297156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:9528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.297186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:9536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.297217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:9544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.297248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:9552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.297279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:9560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.297309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:9568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.297340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:9576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.297370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:9584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.297400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:9592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.297430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:9600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.239 [2024-11-26 05:26:10.297466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:9608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.297497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:9616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.239 [2024-11-26 05:26:10.297527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.239 [2024-11-26 05:26:10.297544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:9624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.240 [2024-11-26 05:26:10.297558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.297574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:9632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.240 [2024-11-26 05:26:10.297588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.297605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:9640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.240 [2024-11-26 05:26:10.297619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.297635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:9648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.240 [2024-11-26 05:26:10.297649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.297665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:9656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.240 [2024-11-26 05:26:10.297679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.297704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:9664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.240 [2024-11-26 05:26:10.297720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.297736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.240 [2024-11-26 05:26:10.297766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.297782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:9680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.240 [2024-11-26 05:26:10.297795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.297809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:9688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.240 [2024-11-26 05:26:10.297822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.297836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:9696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.240 [2024-11-26 05:26:10.297849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.297869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:9704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.240 [2024-11-26 05:26:10.297883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.297899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:9712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.240 [2024-11-26 05:26:10.297912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.297926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:9720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.240 [2024-11-26 05:26:10.297939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.297957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:9728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.240 [2024-11-26 05:26:10.297970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.298002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:9088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.240 [2024-11-26 05:26:10.298016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.298032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:9104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.240 [2024-11-26 05:26:10.298046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.298063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.240 [2024-11-26 05:26:10.298077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.298093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:9152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.240 [2024-11-26 05:26:10.298107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.298124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:9160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.240 [2024-11-26 05:26:10.298138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.298154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:9184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.240 [2024-11-26 05:26:10.298169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.298185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:9192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.240 [2024-11-26 05:26:10.298200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.298216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x69f900 is same with the state(5) to be set 00:30:09.240 [2024-11-26 05:26:10.298235] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:09.240 [2024-11-26 05:26:10.298247] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:09.240 [2024-11-26 05:26:10.298260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9216 len:8 PRP1 0x0 PRP2 0x0 00:30:09.240 [2024-11-26 05:26:10.298279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.298354] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x69f900 was disconnected and freed. reset controller. 00:30:09.240 [2024-11-26 05:26:10.298434] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.240 [2024-11-26 05:26:10.298457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.298474] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.240 [2024-11-26 05:26:10.298488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.298503] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.240 [2024-11-26 05:26:10.298518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.298533] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.240 [2024-11-26 05:26:10.298547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.240 [2024-11-26 05:26:10.298560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.240 [2024-11-26 05:26:10.301031] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.240 [2024-11-26 05:26:10.301076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.240 [2024-11-26 05:26:10.301565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.240 [2024-11-26 05:26:10.301747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.240 [2024-11-26 05:26:10.301774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.240 [2024-11-26 05:26:10.301791] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.240 [2024-11-26 05:26:10.301911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.240 [2024-11-26 05:26:10.302113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.240 [2024-11-26 05:26:10.302137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.240 [2024-11-26 05:26:10.302158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.240 [2024-11-26 05:26:10.304624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.240 [2024-11-26 05:26:10.313900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.240 [2024-11-26 05:26:10.314278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.240 [2024-11-26 05:26:10.314449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.240 [2024-11-26 05:26:10.314478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.240 [2024-11-26 05:26:10.314495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.240 [2024-11-26 05:26:10.314679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.240 [2024-11-26 05:26:10.314867] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.240 [2024-11-26 05:26:10.314889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.240 [2024-11-26 05:26:10.314905] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.240 [2024-11-26 05:26:10.317297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.240 [2024-11-26 05:26:10.326592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.240 [2024-11-26 05:26:10.326920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.240 [2024-11-26 05:26:10.327047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.240 [2024-11-26 05:26:10.327076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.240 [2024-11-26 05:26:10.327095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.240 [2024-11-26 05:26:10.327262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.240 [2024-11-26 05:26:10.327414] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.241 [2024-11-26 05:26:10.327440] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.241 [2024-11-26 05:26:10.327456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.241 [2024-11-26 05:26:10.329738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.241 [2024-11-26 05:26:10.339225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.241 [2024-11-26 05:26:10.339546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.339701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.339731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.241 [2024-11-26 05:26:10.339748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.241 [2024-11-26 05:26:10.339896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.241 [2024-11-26 05:26:10.340066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.241 [2024-11-26 05:26:10.340092] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.241 [2024-11-26 05:26:10.340108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.241 [2024-11-26 05:26:10.342316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.241 [2024-11-26 05:26:10.351824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.241 [2024-11-26 05:26:10.352141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.352289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.352319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.241 [2024-11-26 05:26:10.352338] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.241 [2024-11-26 05:26:10.352486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.241 [2024-11-26 05:26:10.352674] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.241 [2024-11-26 05:26:10.352714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.241 [2024-11-26 05:26:10.352738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.241 [2024-11-26 05:26:10.355305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.241 [2024-11-26 05:26:10.364394] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.241 [2024-11-26 05:26:10.364776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.364929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.364954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.241 [2024-11-26 05:26:10.364971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.241 [2024-11-26 05:26:10.365169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.241 [2024-11-26 05:26:10.365321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.241 [2024-11-26 05:26:10.365347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.241 [2024-11-26 05:26:10.365363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.241 [2024-11-26 05:26:10.367838] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.241 [2024-11-26 05:26:10.377086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.241 [2024-11-26 05:26:10.377353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.377499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.377529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.241 [2024-11-26 05:26:10.377547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.241 [2024-11-26 05:26:10.377709] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.241 [2024-11-26 05:26:10.377899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.241 [2024-11-26 05:26:10.377925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.241 [2024-11-26 05:26:10.377942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.241 [2024-11-26 05:26:10.380325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.241 [2024-11-26 05:26:10.389773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.241 [2024-11-26 05:26:10.390104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.390242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.390266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.241 [2024-11-26 05:26:10.390283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.241 [2024-11-26 05:26:10.390480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.241 [2024-11-26 05:26:10.390614] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.241 [2024-11-26 05:26:10.390640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.241 [2024-11-26 05:26:10.390657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.241 [2024-11-26 05:26:10.393260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.241 [2024-11-26 05:26:10.402350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.241 [2024-11-26 05:26:10.402635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.402827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.402857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.241 [2024-11-26 05:26:10.402876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.241 [2024-11-26 05:26:10.403043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.241 [2024-11-26 05:26:10.403213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.241 [2024-11-26 05:26:10.403239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.241 [2024-11-26 05:26:10.403255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.241 [2024-11-26 05:26:10.405587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.241 [2024-11-26 05:26:10.414649] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.241 [2024-11-26 05:26:10.415039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.415305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.415358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.241 [2024-11-26 05:26:10.415377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.241 [2024-11-26 05:26:10.415561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.241 [2024-11-26 05:26:10.415766] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.241 [2024-11-26 05:26:10.415793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.241 [2024-11-26 05:26:10.415810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.241 [2024-11-26 05:26:10.418032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.241 [2024-11-26 05:26:10.427327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.241 [2024-11-26 05:26:10.427751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.427921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.241 [2024-11-26 05:26:10.427950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.242 [2024-11-26 05:26:10.427968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.242 [2024-11-26 05:26:10.428152] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.242 [2024-11-26 05:26:10.428322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.242 [2024-11-26 05:26:10.428349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.242 [2024-11-26 05:26:10.428364] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.242 [2024-11-26 05:26:10.430595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.242 [2024-11-26 05:26:10.440157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.242 [2024-11-26 05:26:10.440486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.440644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.440673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.242 [2024-11-26 05:26:10.440705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.242 [2024-11-26 05:26:10.440926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.242 [2024-11-26 05:26:10.441118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.242 [2024-11-26 05:26:10.441144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.242 [2024-11-26 05:26:10.441161] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.242 [2024-11-26 05:26:10.443493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.242 [2024-11-26 05:26:10.452603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.242 [2024-11-26 05:26:10.452947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.453216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.453268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.242 [2024-11-26 05:26:10.453286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.242 [2024-11-26 05:26:10.453470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.242 [2024-11-26 05:26:10.453640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.242 [2024-11-26 05:26:10.453666] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.242 [2024-11-26 05:26:10.453683] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.242 [2024-11-26 05:26:10.456050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.242 [2024-11-26 05:26:10.465358] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.242 [2024-11-26 05:26:10.465707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.465889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.465920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.242 [2024-11-26 05:26:10.465939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.242 [2024-11-26 05:26:10.466069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.242 [2024-11-26 05:26:10.466222] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.242 [2024-11-26 05:26:10.466247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.242 [2024-11-26 05:26:10.466263] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.242 [2024-11-26 05:26:10.468734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.242 [2024-11-26 05:26:10.477755] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.242 [2024-11-26 05:26:10.478050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.478319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.478372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.242 [2024-11-26 05:26:10.478390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.242 [2024-11-26 05:26:10.478574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.242 [2024-11-26 05:26:10.478742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.242 [2024-11-26 05:26:10.478767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.242 [2024-11-26 05:26:10.478783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.242 [2024-11-26 05:26:10.481078] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.242 [2024-11-26 05:26:10.490319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.242 [2024-11-26 05:26:10.490634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.490818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.490846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.242 [2024-11-26 05:26:10.490863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.242 [2024-11-26 05:26:10.491063] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.242 [2024-11-26 05:26:10.491200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.242 [2024-11-26 05:26:10.491226] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.242 [2024-11-26 05:26:10.491242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.242 [2024-11-26 05:26:10.493765] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.242 [2024-11-26 05:26:10.502818] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.242 [2024-11-26 05:26:10.503162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.503284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.503312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.242 [2024-11-26 05:26:10.503330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.242 [2024-11-26 05:26:10.503513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.242 [2024-11-26 05:26:10.503716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.242 [2024-11-26 05:26:10.503743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.242 [2024-11-26 05:26:10.503759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.242 [2024-11-26 05:26:10.506341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.242 [2024-11-26 05:26:10.515318] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.242 [2024-11-26 05:26:10.515655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.515800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.515834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.242 [2024-11-26 05:26:10.515853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.242 [2024-11-26 05:26:10.516038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.242 [2024-11-26 05:26:10.516191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.242 [2024-11-26 05:26:10.516217] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.242 [2024-11-26 05:26:10.516234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.242 [2024-11-26 05:26:10.518434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.242 [2024-11-26 05:26:10.527914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.242 [2024-11-26 05:26:10.528252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.528421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.528449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.242 [2024-11-26 05:26:10.528467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.242 [2024-11-26 05:26:10.528650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.242 [2024-11-26 05:26:10.528840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.242 [2024-11-26 05:26:10.528867] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.242 [2024-11-26 05:26:10.528883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.242 [2024-11-26 05:26:10.531340] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.242 [2024-11-26 05:26:10.540372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.242 [2024-11-26 05:26:10.540724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.540953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.242 [2024-11-26 05:26:10.541017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.242 [2024-11-26 05:26:10.541035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.242 [2024-11-26 05:26:10.541238] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.242 [2024-11-26 05:26:10.541392] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.243 [2024-11-26 05:26:10.541418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.243 [2024-11-26 05:26:10.541434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.243 [2024-11-26 05:26:10.543818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.243 [2024-11-26 05:26:10.552889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.243 [2024-11-26 05:26:10.553221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.553365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.553395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.243 [2024-11-26 05:26:10.553420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.243 [2024-11-26 05:26:10.553605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.243 [2024-11-26 05:26:10.553752] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.243 [2024-11-26 05:26:10.553778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.243 [2024-11-26 05:26:10.553794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.243 [2024-11-26 05:26:10.555982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.243 [2024-11-26 05:26:10.565418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.243 [2024-11-26 05:26:10.565731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.565879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.565909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.243 [2024-11-26 05:26:10.565928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.243 [2024-11-26 05:26:10.566096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.243 [2024-11-26 05:26:10.566266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.243 [2024-11-26 05:26:10.566291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.243 [2024-11-26 05:26:10.566308] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.243 [2024-11-26 05:26:10.568753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.243 [2024-11-26 05:26:10.578071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.243 [2024-11-26 05:26:10.578377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.578557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.578587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.243 [2024-11-26 05:26:10.578606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.243 [2024-11-26 05:26:10.578767] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.243 [2024-11-26 05:26:10.578974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.243 [2024-11-26 05:26:10.579000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.243 [2024-11-26 05:26:10.579016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.243 [2024-11-26 05:26:10.581294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.243 [2024-11-26 05:26:10.590674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.243 [2024-11-26 05:26:10.591070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.591233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.591261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.243 [2024-11-26 05:26:10.591279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.243 [2024-11-26 05:26:10.591486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.243 [2024-11-26 05:26:10.591639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.243 [2024-11-26 05:26:10.591665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.243 [2024-11-26 05:26:10.591682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.243 [2024-11-26 05:26:10.594026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.243 [2024-11-26 05:26:10.603188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.243 [2024-11-26 05:26:10.603458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.603622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.603650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.243 [2024-11-26 05:26:10.603667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.243 [2024-11-26 05:26:10.603859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.243 [2024-11-26 05:26:10.604023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.243 [2024-11-26 05:26:10.604049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.243 [2024-11-26 05:26:10.604065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.243 [2024-11-26 05:26:10.606451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.243 [2024-11-26 05:26:10.615895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.243 [2024-11-26 05:26:10.616216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.616441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.616469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.243 [2024-11-26 05:26:10.616501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.243 [2024-11-26 05:26:10.616641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.243 [2024-11-26 05:26:10.616852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.243 [2024-11-26 05:26:10.616879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.243 [2024-11-26 05:26:10.616896] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.243 [2024-11-26 05:26:10.619195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.243 [2024-11-26 05:26:10.628626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.243 [2024-11-26 05:26:10.628935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.629151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.629183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.243 [2024-11-26 05:26:10.629203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.243 [2024-11-26 05:26:10.629370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.243 [2024-11-26 05:26:10.629495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.243 [2024-11-26 05:26:10.629521] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.243 [2024-11-26 05:26:10.629537] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.243 [2024-11-26 05:26:10.631755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.243 [2024-11-26 05:26:10.641390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.243 [2024-11-26 05:26:10.641751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.641866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.641891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.243 [2024-11-26 05:26:10.641908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.243 [2024-11-26 05:26:10.642129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.243 [2024-11-26 05:26:10.642300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.243 [2024-11-26 05:26:10.642325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.243 [2024-11-26 05:26:10.642341] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.243 [2024-11-26 05:26:10.644774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.243 [2024-11-26 05:26:10.653860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.243 [2024-11-26 05:26:10.654210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.654352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.243 [2024-11-26 05:26:10.654382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.243 [2024-11-26 05:26:10.654400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.243 [2024-11-26 05:26:10.654530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.243 [2024-11-26 05:26:10.654711] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.243 [2024-11-26 05:26:10.654738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.243 [2024-11-26 05:26:10.654755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.243 [2024-11-26 05:26:10.657240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.243 [2024-11-26 05:26:10.666354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.244 [2024-11-26 05:26:10.666708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.666859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.666888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.244 [2024-11-26 05:26:10.666906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.244 [2024-11-26 05:26:10.667054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.244 [2024-11-26 05:26:10.667224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.244 [2024-11-26 05:26:10.667257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.244 [2024-11-26 05:26:10.667275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.244 [2024-11-26 05:26:10.669555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.244 [2024-11-26 05:26:10.679010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.244 [2024-11-26 05:26:10.679323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.679515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.679541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.244 [2024-11-26 05:26:10.679573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.244 [2024-11-26 05:26:10.679756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.244 [2024-11-26 05:26:10.679994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.244 [2024-11-26 05:26:10.680019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.244 [2024-11-26 05:26:10.680035] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.244 [2024-11-26 05:26:10.682349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.244 [2024-11-26 05:26:10.691526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.244 [2024-11-26 05:26:10.691915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.692066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.692092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.244 [2024-11-26 05:26:10.692108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.244 [2024-11-26 05:26:10.692301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.244 [2024-11-26 05:26:10.692437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.244 [2024-11-26 05:26:10.692461] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.244 [2024-11-26 05:26:10.692477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.244 [2024-11-26 05:26:10.694856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.244 [2024-11-26 05:26:10.704117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.244 [2024-11-26 05:26:10.704421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.704559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.704589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.244 [2024-11-26 05:26:10.704608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.244 [2024-11-26 05:26:10.704749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.244 [2024-11-26 05:26:10.704957] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.244 [2024-11-26 05:26:10.704982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.244 [2024-11-26 05:26:10.705004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.244 [2024-11-26 05:26:10.707247] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.244 [2024-11-26 05:26:10.716713] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.244 [2024-11-26 05:26:10.717141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.717309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.717336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.244 [2024-11-26 05:26:10.717353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.244 [2024-11-26 05:26:10.717542] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.244 [2024-11-26 05:26:10.717715] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.244 [2024-11-26 05:26:10.717741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.244 [2024-11-26 05:26:10.717757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.244 [2024-11-26 05:26:10.720147] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.244 [2024-11-26 05:26:10.729202] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.244 [2024-11-26 05:26:10.729578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.729771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.729802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.244 [2024-11-26 05:26:10.729820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.244 [2024-11-26 05:26:10.730022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.244 [2024-11-26 05:26:10.730157] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.244 [2024-11-26 05:26:10.730182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.244 [2024-11-26 05:26:10.730199] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.244 [2024-11-26 05:26:10.732333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.244 [2024-11-26 05:26:10.741883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.244 [2024-11-26 05:26:10.742211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.742385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.742414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.244 [2024-11-26 05:26:10.742432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.244 [2024-11-26 05:26:10.742579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.244 [2024-11-26 05:26:10.742746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.244 [2024-11-26 05:26:10.742773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.244 [2024-11-26 05:26:10.742789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.244 [2024-11-26 05:26:10.745073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.244 [2024-11-26 05:26:10.754327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.244 [2024-11-26 05:26:10.754709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.754937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.755004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.244 [2024-11-26 05:26:10.755023] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.244 [2024-11-26 05:26:10.755189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.244 [2024-11-26 05:26:10.755378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.244 [2024-11-26 05:26:10.755403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.244 [2024-11-26 05:26:10.755419] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.244 [2024-11-26 05:26:10.757795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.244 [2024-11-26 05:26:10.767015] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.244 [2024-11-26 05:26:10.767387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.767574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.767601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.244 [2024-11-26 05:26:10.767617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.244 [2024-11-26 05:26:10.767772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.244 [2024-11-26 05:26:10.767981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.244 [2024-11-26 05:26:10.768006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.244 [2024-11-26 05:26:10.768022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.244 [2024-11-26 05:26:10.770515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.244 [2024-11-26 05:26:10.779601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.244 [2024-11-26 05:26:10.779909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.780128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.244 [2024-11-26 05:26:10.780158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.244 [2024-11-26 05:26:10.780177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.245 [2024-11-26 05:26:10.780288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.245 [2024-11-26 05:26:10.780460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.245 [2024-11-26 05:26:10.780484] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.245 [2024-11-26 05:26:10.780500] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.245 [2024-11-26 05:26:10.782752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.245 [2024-11-26 05:26:10.792243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.245 [2024-11-26 05:26:10.792574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.792745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.792794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.245 [2024-11-26 05:26:10.792811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.245 [2024-11-26 05:26:10.792926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.245 [2024-11-26 05:26:10.793127] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.245 [2024-11-26 05:26:10.793152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.245 [2024-11-26 05:26:10.793168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.245 [2024-11-26 05:26:10.795570] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.245 [2024-11-26 05:26:10.804986] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.245 [2024-11-26 05:26:10.805367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.805561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.805590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.245 [2024-11-26 05:26:10.805608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.245 [2024-11-26 05:26:10.805749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.245 [2024-11-26 05:26:10.805992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.245 [2024-11-26 05:26:10.806017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.245 [2024-11-26 05:26:10.806032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.245 [2024-11-26 05:26:10.808252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.245 [2024-11-26 05:26:10.817641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.245 [2024-11-26 05:26:10.817955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.818096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.818125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.245 [2024-11-26 05:26:10.818143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.245 [2024-11-26 05:26:10.818309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.245 [2024-11-26 05:26:10.818498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.245 [2024-11-26 05:26:10.818523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.245 [2024-11-26 05:26:10.818538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.245 [2024-11-26 05:26:10.820857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.245 [2024-11-26 05:26:10.830245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.245 [2024-11-26 05:26:10.830571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.830743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.830774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.245 [2024-11-26 05:26:10.830792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.245 [2024-11-26 05:26:10.830958] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.245 [2024-11-26 05:26:10.831112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.245 [2024-11-26 05:26:10.831136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.245 [2024-11-26 05:26:10.831152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.245 [2024-11-26 05:26:10.833606] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.245 [2024-11-26 05:26:10.842857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.245 [2024-11-26 05:26:10.843202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.843346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.843375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.245 [2024-11-26 05:26:10.843393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.245 [2024-11-26 05:26:10.843559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.245 [2024-11-26 05:26:10.843759] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.245 [2024-11-26 05:26:10.843785] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.245 [2024-11-26 05:26:10.843801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.245 [2024-11-26 05:26:10.846057] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.245 [2024-11-26 05:26:10.855426] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.245 [2024-11-26 05:26:10.855774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.855993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.856044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.245 [2024-11-26 05:26:10.856063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.245 [2024-11-26 05:26:10.856210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.245 [2024-11-26 05:26:10.856399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.245 [2024-11-26 05:26:10.856423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.245 [2024-11-26 05:26:10.856439] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.245 [2024-11-26 05:26:10.858643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.245 [2024-11-26 05:26:10.868130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.245 [2024-11-26 05:26:10.868450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.868602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.868637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.245 [2024-11-26 05:26:10.868656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.245 [2024-11-26 05:26:10.868835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.245 [2024-11-26 05:26:10.869006] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.245 [2024-11-26 05:26:10.869031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.245 [2024-11-26 05:26:10.869047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.245 [2024-11-26 05:26:10.871375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.245 [2024-11-26 05:26:10.880739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.245 [2024-11-26 05:26:10.881006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.881238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.881265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.245 [2024-11-26 05:26:10.881296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.245 [2024-11-26 05:26:10.881476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.245 [2024-11-26 05:26:10.881665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.245 [2024-11-26 05:26:10.881700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.245 [2024-11-26 05:26:10.881719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.245 [2024-11-26 05:26:10.883958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.245 [2024-11-26 05:26:10.893350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.245 [2024-11-26 05:26:10.893698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.893815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.245 [2024-11-26 05:26:10.893844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.245 [2024-11-26 05:26:10.893863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.245 [2024-11-26 05:26:10.894029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.245 [2024-11-26 05:26:10.894199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.245 [2024-11-26 05:26:10.894224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.245 [2024-11-26 05:26:10.894240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.246 [2024-11-26 05:26:10.896556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.246 [2024-11-26 05:26:10.906011] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.246 [2024-11-26 05:26:10.906293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.906461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.906490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.246 [2024-11-26 05:26:10.906513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.246 [2024-11-26 05:26:10.906709] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.246 [2024-11-26 05:26:10.906881] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.246 [2024-11-26 05:26:10.906906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.246 [2024-11-26 05:26:10.906922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.246 [2024-11-26 05:26:10.909466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.246 [2024-11-26 05:26:10.918446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.246 [2024-11-26 05:26:10.918779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.918920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.918978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.246 [2024-11-26 05:26:10.918996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.246 [2024-11-26 05:26:10.919197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.246 [2024-11-26 05:26:10.919368] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.246 [2024-11-26 05:26:10.919393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.246 [2024-11-26 05:26:10.919409] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.246 [2024-11-26 05:26:10.921614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.246 [2024-11-26 05:26:10.930955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.246 [2024-11-26 05:26:10.931302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.931469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.931498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.246 [2024-11-26 05:26:10.931516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.246 [2024-11-26 05:26:10.931663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.246 [2024-11-26 05:26:10.931826] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.246 [2024-11-26 05:26:10.931851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.246 [2024-11-26 05:26:10.931868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.246 [2024-11-26 05:26:10.934051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.246 [2024-11-26 05:26:10.943568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.246 [2024-11-26 05:26:10.943935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.944082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.944112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.246 [2024-11-26 05:26:10.944130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.246 [2024-11-26 05:26:10.944337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.246 [2024-11-26 05:26:10.944527] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.246 [2024-11-26 05:26:10.944552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.246 [2024-11-26 05:26:10.944568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.246 [2024-11-26 05:26:10.946962] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.246 [2024-11-26 05:26:10.956049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.246 [2024-11-26 05:26:10.956379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.956550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.956579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.246 [2024-11-26 05:26:10.956597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.246 [2024-11-26 05:26:10.956792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.246 [2024-11-26 05:26:10.956964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.246 [2024-11-26 05:26:10.956988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.246 [2024-11-26 05:26:10.957004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.246 [2024-11-26 05:26:10.959384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.246 [2024-11-26 05:26:10.968586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.246 [2024-11-26 05:26:10.968934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.969224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.969277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.246 [2024-11-26 05:26:10.969295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.246 [2024-11-26 05:26:10.969461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.246 [2024-11-26 05:26:10.969614] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.246 [2024-11-26 05:26:10.969638] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.246 [2024-11-26 05:26:10.969654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.246 [2024-11-26 05:26:10.972123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.246 [2024-11-26 05:26:10.981220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.246 [2024-11-26 05:26:10.981502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.981678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.981714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.246 [2024-11-26 05:26:10.981731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.246 [2024-11-26 05:26:10.981884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.246 [2024-11-26 05:26:10.982079] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.246 [2024-11-26 05:26:10.982104] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.246 [2024-11-26 05:26:10.982120] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.246 [2024-11-26 05:26:10.984454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.246 [2024-11-26 05:26:10.993786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.246 [2024-11-26 05:26:10.994091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.994231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.246 [2024-11-26 05:26:10.994257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.246 [2024-11-26 05:26:10.994274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.246 [2024-11-26 05:26:10.994437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.246 [2024-11-26 05:26:10.994582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.246 [2024-11-26 05:26:10.994603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.246 [2024-11-26 05:26:10.994630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.506 [2024-11-26 05:26:10.996935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.506 [2024-11-26 05:26:11.006401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.506 [2024-11-26 05:26:11.006736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 05:26:11.006851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 05:26:11.006878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.507 [2024-11-26 05:26:11.006895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.507 [2024-11-26 05:26:11.007088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.507 [2024-11-26 05:26:11.007262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.507 [2024-11-26 05:26:11.007288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.507 [2024-11-26 05:26:11.007304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.507 [2024-11-26 05:26:11.009752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.507 [2024-11-26 05:26:11.018893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.507 [2024-11-26 05:26:11.019187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.019327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.019372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.507 [2024-11-26 05:26:11.019391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.507 [2024-11-26 05:26:11.019581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.507 [2024-11-26 05:26:11.019789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.507 [2024-11-26 05:26:11.019813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.507 [2024-11-26 05:26:11.019833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.507 [2024-11-26 05:26:11.021998] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.507 [2024-11-26 05:26:11.031015] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.507 [2024-11-26 05:26:11.031319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.031456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.031483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.507 [2024-11-26 05:26:11.031499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.507 [2024-11-26 05:26:11.031716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.507 [2024-11-26 05:26:11.031889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.507 [2024-11-26 05:26:11.031914] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.507 [2024-11-26 05:26:11.031945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.507 [2024-11-26 05:26:11.034289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.507 [2024-11-26 05:26:11.043528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.507 [2024-11-26 05:26:11.043821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.043931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.043959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.507 [2024-11-26 05:26:11.043976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.507 [2024-11-26 05:26:11.044137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.507 [2024-11-26 05:26:11.044363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.507 [2024-11-26 05:26:11.044388] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.507 [2024-11-26 05:26:11.044403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.507 [2024-11-26 05:26:11.046798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.507 [2024-11-26 05:26:11.056223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.507 [2024-11-26 05:26:11.056595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.056739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.056766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.507 [2024-11-26 05:26:11.056783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.507 [2024-11-26 05:26:11.056949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.507 [2024-11-26 05:26:11.057119] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.507 [2024-11-26 05:26:11.057142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.507 [2024-11-26 05:26:11.057162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.507 [2024-11-26 05:26:11.059442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.507 [2024-11-26 05:26:11.068868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.507 [2024-11-26 05:26:11.069179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.069326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.069357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.507 [2024-11-26 05:26:11.069376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.507 [2024-11-26 05:26:11.069536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.507 [2024-11-26 05:26:11.069717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.507 [2024-11-26 05:26:11.069740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.507 [2024-11-26 05:26:11.069755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.507 [2024-11-26 05:26:11.071976] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.507 [2024-11-26 05:26:11.081256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.507 [2024-11-26 05:26:11.081605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.081775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.081803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.507 [2024-11-26 05:26:11.081820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.507 [2024-11-26 05:26:11.082005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.507 [2024-11-26 05:26:11.082177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.507 [2024-11-26 05:26:11.082202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.507 [2024-11-26 05:26:11.082218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.507 [2024-11-26 05:26:11.084400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.507 [2024-11-26 05:26:11.093775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.507 [2024-11-26 05:26:11.094096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.094282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.094326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.507 [2024-11-26 05:26:11.094344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.507 [2024-11-26 05:26:11.094564] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.507 [2024-11-26 05:26:11.094773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.507 [2024-11-26 05:26:11.094796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.507 [2024-11-26 05:26:11.094810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.507 [2024-11-26 05:26:11.097106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.507 [2024-11-26 05:26:11.106373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.507 [2024-11-26 05:26:11.106680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.106858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.106887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.507 [2024-11-26 05:26:11.106905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.507 [2024-11-26 05:26:11.107054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.507 [2024-11-26 05:26:11.107243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.507 [2024-11-26 05:26:11.107267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.507 [2024-11-26 05:26:11.107283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.507 [2024-11-26 05:26:11.109467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.507 [2024-11-26 05:26:11.118878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.507 [2024-11-26 05:26:11.119248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.119390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 05:26:11.119438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.507 [2024-11-26 05:26:11.119455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.508 [2024-11-26 05:26:11.119639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.508 [2024-11-26 05:26:11.119866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.508 [2024-11-26 05:26:11.119892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.508 [2024-11-26 05:26:11.119908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.508 [2024-11-26 05:26:11.122199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.508 [2024-11-26 05:26:11.131451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.508 [2024-11-26 05:26:11.131768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.131921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.131948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.508 [2024-11-26 05:26:11.131964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.508 [2024-11-26 05:26:11.132160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.508 [2024-11-26 05:26:11.132346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.508 [2024-11-26 05:26:11.132370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.508 [2024-11-26 05:26:11.132385] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.508 [2024-11-26 05:26:11.134829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.508 [2024-11-26 05:26:11.144022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.508 [2024-11-26 05:26:11.144328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.144489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.144515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.508 [2024-11-26 05:26:11.144547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.508 [2024-11-26 05:26:11.144781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.508 [2024-11-26 05:26:11.144899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.508 [2024-11-26 05:26:11.144923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.508 [2024-11-26 05:26:11.144939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.508 [2024-11-26 05:26:11.147320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.508 [2024-11-26 05:26:11.156616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.508 [2024-11-26 05:26:11.156957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.157132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.157161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.508 [2024-11-26 05:26:11.157180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.508 [2024-11-26 05:26:11.157382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.508 [2024-11-26 05:26:11.157554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.508 [2024-11-26 05:26:11.157578] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.508 [2024-11-26 05:26:11.157594] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.508 [2024-11-26 05:26:11.159839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.508 [2024-11-26 05:26:11.169274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.508 [2024-11-26 05:26:11.169546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.169696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.169725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.508 [2024-11-26 05:26:11.169744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.508 [2024-11-26 05:26:11.169947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.508 [2024-11-26 05:26:11.170136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.508 [2024-11-26 05:26:11.170160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.508 [2024-11-26 05:26:11.170176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.508 [2024-11-26 05:26:11.172545] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.508 [2024-11-26 05:26:11.181950] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.508 [2024-11-26 05:26:11.182259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.182398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.182428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.508 [2024-11-26 05:26:11.182446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.508 [2024-11-26 05:26:11.182613] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.508 [2024-11-26 05:26:11.182795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.508 [2024-11-26 05:26:11.182821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.508 [2024-11-26 05:26:11.182837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.508 [2024-11-26 05:26:11.185128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.508 [2024-11-26 05:26:11.194575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.508 [2024-11-26 05:26:11.194934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.195121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.195148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.508 [2024-11-26 05:26:11.195165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.508 [2024-11-26 05:26:11.195292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.508 [2024-11-26 05:26:11.195498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.508 [2024-11-26 05:26:11.195523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.508 [2024-11-26 05:26:11.195539] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.508 [2024-11-26 05:26:11.197752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.508 [2024-11-26 05:26:11.207068] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.508 [2024-11-26 05:26:11.207355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.207496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.207525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.508 [2024-11-26 05:26:11.207543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.508 [2024-11-26 05:26:11.207758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.508 [2024-11-26 05:26:11.207893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.508 [2024-11-26 05:26:11.207917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.508 [2024-11-26 05:26:11.207933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.508 [2024-11-26 05:26:11.210313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.508 [2024-11-26 05:26:11.219586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.508 [2024-11-26 05:26:11.219965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.220098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.220137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.508 [2024-11-26 05:26:11.220160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.508 [2024-11-26 05:26:11.220381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.508 [2024-11-26 05:26:11.220570] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.508 [2024-11-26 05:26:11.220594] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.508 [2024-11-26 05:26:11.220610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.508 [2024-11-26 05:26:11.222950] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.508 [2024-11-26 05:26:11.232395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.508 [2024-11-26 05:26:11.232741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.232879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 05:26:11.232906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.508 [2024-11-26 05:26:11.232922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.508 [2024-11-26 05:26:11.233109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.508 [2024-11-26 05:26:11.233280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.508 [2024-11-26 05:26:11.233304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.508 [2024-11-26 05:26:11.233321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.509 [2024-11-26 05:26:11.235782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.509 [2024-11-26 05:26:11.245146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.509 [2024-11-26 05:26:11.245455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 05:26:11.245623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 05:26:11.245652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.509 [2024-11-26 05:26:11.245670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.509 [2024-11-26 05:26:11.245846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.509 [2024-11-26 05:26:11.246054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.509 [2024-11-26 05:26:11.246078] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.509 [2024-11-26 05:26:11.246094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.509 [2024-11-26 05:26:11.248623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.509 [2024-11-26 05:26:11.257681] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.509 [2024-11-26 05:26:11.258035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 05:26:11.258229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 05:26:11.258277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.509 [2024-11-26 05:26:11.258296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.509 [2024-11-26 05:26:11.258450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.509 [2024-11-26 05:26:11.258656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.509 [2024-11-26 05:26:11.258680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.509 [2024-11-26 05:26:11.258709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.509 [2024-11-26 05:26:11.260860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.769 [2024-11-26 05:26:11.270292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.769 [2024-11-26 05:26:11.270610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.769 [2024-11-26 05:26:11.270768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.769 [2024-11-26 05:26:11.270798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.769 [2024-11-26 05:26:11.270816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.769 [2024-11-26 05:26:11.270947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.769 [2024-11-26 05:26:11.271099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.769 [2024-11-26 05:26:11.271124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.769 [2024-11-26 05:26:11.271140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.769 [2024-11-26 05:26:11.273324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.769 [2024-11-26 05:26:11.282866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.769 [2024-11-26 05:26:11.283270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.769 [2024-11-26 05:26:11.283440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.769 [2024-11-26 05:26:11.283481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.769 [2024-11-26 05:26:11.283497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.769 [2024-11-26 05:26:11.283713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.769 [2024-11-26 05:26:11.283885] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.769 [2024-11-26 05:26:11.283909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.769 [2024-11-26 05:26:11.283926] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.769 [2024-11-26 05:26:11.286307] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.769 [2024-11-26 05:26:11.295447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.769 [2024-11-26 05:26:11.295799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.769 [2024-11-26 05:26:11.295987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.769 [2024-11-26 05:26:11.296032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.769 [2024-11-26 05:26:11.296050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.769 [2024-11-26 05:26:11.296181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.769 [2024-11-26 05:26:11.296358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.769 [2024-11-26 05:26:11.296383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.769 [2024-11-26 05:26:11.296400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.769 [2024-11-26 05:26:11.298935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.769 [2024-11-26 05:26:11.308033] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.769 [2024-11-26 05:26:11.308384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.769 [2024-11-26 05:26:11.308506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.769 [2024-11-26 05:26:11.308537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.769 [2024-11-26 05:26:11.308555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.769 [2024-11-26 05:26:11.308714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.769 [2024-11-26 05:26:11.308886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.769 [2024-11-26 05:26:11.308910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.769 [2024-11-26 05:26:11.308926] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.769 [2024-11-26 05:26:11.311004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.769 [2024-11-26 05:26:11.320456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.769 [2024-11-26 05:26:11.320804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.769 [2024-11-26 05:26:11.320918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.769 [2024-11-26 05:26:11.320947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.769 [2024-11-26 05:26:11.320965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.769 [2024-11-26 05:26:11.321149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.769 [2024-11-26 05:26:11.321320] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.769 [2024-11-26 05:26:11.321345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.769 [2024-11-26 05:26:11.321361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.769 [2024-11-26 05:26:11.323770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.769 [2024-11-26 05:26:11.333018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.769 [2024-11-26 05:26:11.333330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.769 [2024-11-26 05:26:11.333468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.333497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.770 [2024-11-26 05:26:11.333515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.770 [2024-11-26 05:26:11.333711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.770 [2024-11-26 05:26:11.333900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.770 [2024-11-26 05:26:11.333931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.770 [2024-11-26 05:26:11.333948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.770 [2024-11-26 05:26:11.336168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.770 [2024-11-26 05:26:11.345604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.770 [2024-11-26 05:26:11.345935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.346117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.346158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.770 [2024-11-26 05:26:11.346174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.770 [2024-11-26 05:26:11.346352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.770 [2024-11-26 05:26:11.346524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.770 [2024-11-26 05:26:11.346548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.770 [2024-11-26 05:26:11.346564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.770 [2024-11-26 05:26:11.348830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.770 [2024-11-26 05:26:11.358157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.770 [2024-11-26 05:26:11.358520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.358658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.358698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.770 [2024-11-26 05:26:11.358719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.770 [2024-11-26 05:26:11.358921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.770 [2024-11-26 05:26:11.359092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.770 [2024-11-26 05:26:11.359117] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.770 [2024-11-26 05:26:11.359132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.770 [2024-11-26 05:26:11.361370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.770 [2024-11-26 05:26:11.370742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.770 [2024-11-26 05:26:11.371033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.371247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.371287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.770 [2024-11-26 05:26:11.371303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.770 [2024-11-26 05:26:11.371528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.770 [2024-11-26 05:26:11.371664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.770 [2024-11-26 05:26:11.371698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.770 [2024-11-26 05:26:11.371722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.770 [2024-11-26 05:26:11.374029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.770 [2024-11-26 05:26:11.383313] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.770 [2024-11-26 05:26:11.383560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.383695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.383751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.770 [2024-11-26 05:26:11.383770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.770 [2024-11-26 05:26:11.383931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.770 [2024-11-26 05:26:11.384085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.770 [2024-11-26 05:26:11.384109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.770 [2024-11-26 05:26:11.384125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.770 [2024-11-26 05:26:11.386365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.770 [2024-11-26 05:26:11.396017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.770 [2024-11-26 05:26:11.396353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.396537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.396566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.770 [2024-11-26 05:26:11.396585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.770 [2024-11-26 05:26:11.396764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.770 [2024-11-26 05:26:11.396936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.770 [2024-11-26 05:26:11.396961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.770 [2024-11-26 05:26:11.396977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.770 [2024-11-26 05:26:11.399504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.770 [2024-11-26 05:26:11.408456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.770 [2024-11-26 05:26:11.408790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.409008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.409062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.770 [2024-11-26 05:26:11.409080] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.770 [2024-11-26 05:26:11.409246] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.770 [2024-11-26 05:26:11.409453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.770 [2024-11-26 05:26:11.409477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.770 [2024-11-26 05:26:11.409493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.770 [2024-11-26 05:26:11.411729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.770 [2024-11-26 05:26:11.420980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.770 [2024-11-26 05:26:11.421297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.421547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.421576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.770 [2024-11-26 05:26:11.421594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.770 [2024-11-26 05:26:11.421845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.770 [2024-11-26 05:26:11.422017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.770 [2024-11-26 05:26:11.422041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.770 [2024-11-26 05:26:11.422057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.770 [2024-11-26 05:26:11.424348] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.770 [2024-11-26 05:26:11.433571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.770 [2024-11-26 05:26:11.433902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.434050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.434079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.770 [2024-11-26 05:26:11.434098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.770 [2024-11-26 05:26:11.434264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.770 [2024-11-26 05:26:11.434399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.770 [2024-11-26 05:26:11.434424] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.770 [2024-11-26 05:26:11.434439] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.770 [2024-11-26 05:26:11.436832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.770 [2024-11-26 05:26:11.446093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.770 [2024-11-26 05:26:11.446387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.446518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.770 [2024-11-26 05:26:11.446547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.770 [2024-11-26 05:26:11.446566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.770 [2024-11-26 05:26:11.446677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.771 [2024-11-26 05:26:11.446858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.771 [2024-11-26 05:26:11.446883] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.771 [2024-11-26 05:26:11.446899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.771 [2024-11-26 05:26:11.449334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.771 [2024-11-26 05:26:11.458603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.771 [2024-11-26 05:26:11.458934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.771 [2024-11-26 05:26:11.459076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.771 [2024-11-26 05:26:11.459106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.771 [2024-11-26 05:26:11.459124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.771 [2024-11-26 05:26:11.459290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.771 [2024-11-26 05:26:11.459442] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.771 [2024-11-26 05:26:11.459467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.771 [2024-11-26 05:26:11.459482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.771 [2024-11-26 05:26:11.461940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.771 [2024-11-26 05:26:11.471270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.771 [2024-11-26 05:26:11.471594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.771 [2024-11-26 05:26:11.471744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.771 [2024-11-26 05:26:11.471772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.771 [2024-11-26 05:26:11.471788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.771 [2024-11-26 05:26:11.472012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.771 [2024-11-26 05:26:11.472191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.771 [2024-11-26 05:26:11.472215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.771 [2024-11-26 05:26:11.472231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.771 [2024-11-26 05:26:11.474544] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.771 [2024-11-26 05:26:11.483933] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.771 [2024-11-26 05:26:11.484278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.771 [2024-11-26 05:26:11.484446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.771 [2024-11-26 05:26:11.484476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.771 [2024-11-26 05:26:11.484494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.771 [2024-11-26 05:26:11.484642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.771 [2024-11-26 05:26:11.484822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.771 [2024-11-26 05:26:11.484848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.771 [2024-11-26 05:26:11.484863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.771 [2024-11-26 05:26:11.487193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.771 [2024-11-26 05:26:11.496479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.771 [2024-11-26 05:26:11.496846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.771 [2024-11-26 05:26:11.496995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.771 [2024-11-26 05:26:11.497023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.771 [2024-11-26 05:26:11.497041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.771 [2024-11-26 05:26:11.497189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.771 [2024-11-26 05:26:11.497396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.771 [2024-11-26 05:26:11.497421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.771 [2024-11-26 05:26:11.497437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.771 [2024-11-26 05:26:11.499897] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.771 [2024-11-26 05:26:11.509132] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.771 [2024-11-26 05:26:11.509483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.771 [2024-11-26 05:26:11.509625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.771 [2024-11-26 05:26:11.509654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.771 [2024-11-26 05:26:11.509671] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.771 [2024-11-26 05:26:11.509810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.771 [2024-11-26 05:26:11.509945] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.771 [2024-11-26 05:26:11.509970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.771 [2024-11-26 05:26:11.509986] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.771 [2024-11-26 05:26:11.512259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:09.771 [2024-11-26 05:26:11.521808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.771 [2024-11-26 05:26:11.522137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.771 [2024-11-26 05:26:11.522342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.771 [2024-11-26 05:26:11.522376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:09.771 [2024-11-26 05:26:11.522415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:09.771 [2024-11-26 05:26:11.522618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:09.771 [2024-11-26 05:26:11.522780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:09.771 [2024-11-26 05:26:11.522805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:09.771 [2024-11-26 05:26:11.522822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.771 [2024-11-26 05:26:11.525062] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.033 [2024-11-26 05:26:11.534222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.033 [2024-11-26 05:26:11.534664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.033 [2024-11-26 05:26:11.534855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.033 [2024-11-26 05:26:11.534889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.033 [2024-11-26 05:26:11.534908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.033 [2024-11-26 05:26:11.535074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.033 [2024-11-26 05:26:11.535263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.033 [2024-11-26 05:26:11.535288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.033 [2024-11-26 05:26:11.535304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.033 [2024-11-26 05:26:11.537671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.033 [2024-11-26 05:26:11.546809] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.033 [2024-11-26 05:26:11.547116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.033 [2024-11-26 05:26:11.547375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.033 [2024-11-26 05:26:11.547428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.033 [2024-11-26 05:26:11.547446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.033 [2024-11-26 05:26:11.547593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.033 [2024-11-26 05:26:11.547774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.033 [2024-11-26 05:26:11.547800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.033 [2024-11-26 05:26:11.547816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.033 [2024-11-26 05:26:11.550088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.033 [2024-11-26 05:26:11.559466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.033 [2024-11-26 05:26:11.559778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.033 [2024-11-26 05:26:11.559971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.033 [2024-11-26 05:26:11.560032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.033 [2024-11-26 05:26:11.560050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.033 [2024-11-26 05:26:11.560234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.033 [2024-11-26 05:26:11.560405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.033 [2024-11-26 05:26:11.560431] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.033 [2024-11-26 05:26:11.560446] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.033 [2024-11-26 05:26:11.562857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.033 [2024-11-26 05:26:11.571949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.033 [2024-11-26 05:26:11.572357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.033 [2024-11-26 05:26:11.572518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.033 [2024-11-26 05:26:11.572549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.033 [2024-11-26 05:26:11.572573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.033 [2024-11-26 05:26:11.572781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.033 [2024-11-26 05:26:11.573024] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.033 [2024-11-26 05:26:11.573050] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.033 [2024-11-26 05:26:11.573067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.033 [2024-11-26 05:26:11.575465] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.033 [2024-11-26 05:26:11.584671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.033 [2024-11-26 05:26:11.584993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.033 [2024-11-26 05:26:11.585214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.033 [2024-11-26 05:26:11.585276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.033 [2024-11-26 05:26:11.585294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.033 [2024-11-26 05:26:11.585442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.033 [2024-11-26 05:26:11.585594] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.033 [2024-11-26 05:26:11.585620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.033 [2024-11-26 05:26:11.585636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.033 [2024-11-26 05:26:11.587980] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.034 [2024-11-26 05:26:11.597409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.034 [2024-11-26 05:26:11.597711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.597853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.597884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.034 [2024-11-26 05:26:11.597903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.034 [2024-11-26 05:26:11.598087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.034 [2024-11-26 05:26:11.598258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.034 [2024-11-26 05:26:11.598284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.034 [2024-11-26 05:26:11.598300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.034 [2024-11-26 05:26:11.600824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.034 [2024-11-26 05:26:11.610141] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.034 [2024-11-26 05:26:11.610455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.610601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.610632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.034 [2024-11-26 05:26:11.610651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.034 [2024-11-26 05:26:11.610801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.034 [2024-11-26 05:26:11.610992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.034 [2024-11-26 05:26:11.611018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.034 [2024-11-26 05:26:11.611034] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.034 [2024-11-26 05:26:11.613384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.034 [2024-11-26 05:26:11.622769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.034 [2024-11-26 05:26:11.623116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.623261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.623292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.034 [2024-11-26 05:26:11.623310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.034 [2024-11-26 05:26:11.623494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.034 [2024-11-26 05:26:11.623666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.034 [2024-11-26 05:26:11.623704] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.034 [2024-11-26 05:26:11.623723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.034 [2024-11-26 05:26:11.626019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.034 [2024-11-26 05:26:11.635631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.034 [2024-11-26 05:26:11.635966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.636134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.636164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.034 [2024-11-26 05:26:11.636182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.034 [2024-11-26 05:26:11.636331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.034 [2024-11-26 05:26:11.636501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.034 [2024-11-26 05:26:11.636527] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.034 [2024-11-26 05:26:11.636543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.034 [2024-11-26 05:26:11.638923] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.034 [2024-11-26 05:26:11.648246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.034 [2024-11-26 05:26:11.648577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.648719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.648751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.034 [2024-11-26 05:26:11.648770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.034 [2024-11-26 05:26:11.648991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.034 [2024-11-26 05:26:11.649170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.034 [2024-11-26 05:26:11.649196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.034 [2024-11-26 05:26:11.649212] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.034 [2024-11-26 05:26:11.651526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.034 [2024-11-26 05:26:11.660645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.034 [2024-11-26 05:26:11.661034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.661191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.661237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.034 [2024-11-26 05:26:11.661255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.034 [2024-11-26 05:26:11.661422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.034 [2024-11-26 05:26:11.661609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.034 [2024-11-26 05:26:11.661635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.034 [2024-11-26 05:26:11.661651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.034 [2024-11-26 05:26:11.663888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.034 [2024-11-26 05:26:11.673245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.034 [2024-11-26 05:26:11.673576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.673778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.673806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.034 [2024-11-26 05:26:11.673823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.034 [2024-11-26 05:26:11.674033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.034 [2024-11-26 05:26:11.674207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.034 [2024-11-26 05:26:11.674232] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.034 [2024-11-26 05:26:11.674249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.034 [2024-11-26 05:26:11.676633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.034 [2024-11-26 05:26:11.685980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.034 [2024-11-26 05:26:11.686288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.686401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.686431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.034 [2024-11-26 05:26:11.686449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.034 [2024-11-26 05:26:11.686598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.034 [2024-11-26 05:26:11.686820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.034 [2024-11-26 05:26:11.686852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.034 [2024-11-26 05:26:11.686870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.034 [2024-11-26 05:26:11.689139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.034 [2024-11-26 05:26:11.698588] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.034 [2024-11-26 05:26:11.698922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.699080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.699126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.034 [2024-11-26 05:26:11.699145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.034 [2024-11-26 05:26:11.699292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.034 [2024-11-26 05:26:11.699480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.034 [2024-11-26 05:26:11.699506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.034 [2024-11-26 05:26:11.699523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.034 [2024-11-26 05:26:11.701906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.034 [2024-11-26 05:26:11.711272] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.034 [2024-11-26 05:26:11.711593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.711703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.034 [2024-11-26 05:26:11.711741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.035 [2024-11-26 05:26:11.711758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.035 [2024-11-26 05:26:11.711925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.035 [2024-11-26 05:26:11.712133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.035 [2024-11-26 05:26:11.712158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.035 [2024-11-26 05:26:11.712175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.035 [2024-11-26 05:26:11.714521] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.035 [2024-11-26 05:26:11.723842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.035 [2024-11-26 05:26:11.724256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.035 [2024-11-26 05:26:11.724429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.035 [2024-11-26 05:26:11.724457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.035 [2024-11-26 05:26:11.724474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.035 [2024-11-26 05:26:11.724604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.035 [2024-11-26 05:26:11.724786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.035 [2024-11-26 05:26:11.724810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.035 [2024-11-26 05:26:11.724834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.035 [2024-11-26 05:26:11.727277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.035 [2024-11-26 05:26:11.736306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.035 [2024-11-26 05:26:11.736600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.035 [2024-11-26 05:26:11.736757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.035 [2024-11-26 05:26:11.736785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.035 [2024-11-26 05:26:11.736802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.035 [2024-11-26 05:26:11.737007] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.035 [2024-11-26 05:26:11.737226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.035 [2024-11-26 05:26:11.737253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.035 [2024-11-26 05:26:11.737269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.035 [2024-11-26 05:26:11.739720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.035 [2024-11-26 05:26:11.748895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.035 [2024-11-26 05:26:11.749251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.035 [2024-11-26 05:26:11.749445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.035 [2024-11-26 05:26:11.749493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.035 [2024-11-26 05:26:11.749512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.035 [2024-11-26 05:26:11.749660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.035 [2024-11-26 05:26:11.749843] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.035 [2024-11-26 05:26:11.749870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.035 [2024-11-26 05:26:11.749888] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.035 [2024-11-26 05:26:11.752329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.035 [2024-11-26 05:26:11.761546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.035 [2024-11-26 05:26:11.761884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.035 [2024-11-26 05:26:11.762029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.035 [2024-11-26 05:26:11.762056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.035 [2024-11-26 05:26:11.762072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.035 [2024-11-26 05:26:11.762247] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.035 [2024-11-26 05:26:11.762419] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.035 [2024-11-26 05:26:11.762445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.035 [2024-11-26 05:26:11.762461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.035 [2024-11-26 05:26:11.764893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.035 [2024-11-26 05:26:11.774164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.035 [2024-11-26 05:26:11.774511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.035 [2024-11-26 05:26:11.774679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.035 [2024-11-26 05:26:11.774719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.035 [2024-11-26 05:26:11.774738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.035 [2024-11-26 05:26:11.774941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.035 [2024-11-26 05:26:11.775142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.035 [2024-11-26 05:26:11.775168] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.035 [2024-11-26 05:26:11.775184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.035 [2024-11-26 05:26:11.777624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.035 [2024-11-26 05:26:11.786654] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.035 [2024-11-26 05:26:11.787005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.035 [2024-11-26 05:26:11.787269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.035 [2024-11-26 05:26:11.787324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.035 [2024-11-26 05:26:11.787342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.035 [2024-11-26 05:26:11.787491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.035 [2024-11-26 05:26:11.787643] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.035 [2024-11-26 05:26:11.787669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.035 [2024-11-26 05:26:11.787694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.035 [2024-11-26 05:26:11.789958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.298 [2024-11-26 05:26:11.799179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.298 [2024-11-26 05:26:11.799586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.799783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.799818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.298 [2024-11-26 05:26:11.799837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.298 [2024-11-26 05:26:11.799969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.298 [2024-11-26 05:26:11.800176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.298 [2024-11-26 05:26:11.800202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.298 [2024-11-26 05:26:11.800218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.298 [2024-11-26 05:26:11.802609] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.298 [2024-11-26 05:26:11.812002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.298 [2024-11-26 05:26:11.812309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.812530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.812581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.298 [2024-11-26 05:26:11.812598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.298 [2024-11-26 05:26:11.812776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.298 [2024-11-26 05:26:11.813000] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.298 [2024-11-26 05:26:11.813024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.298 [2024-11-26 05:26:11.813040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.298 [2024-11-26 05:26:11.815299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.298 [2024-11-26 05:26:11.824719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.298 [2024-11-26 05:26:11.825035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.825194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.825222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.298 [2024-11-26 05:26:11.825253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.298 [2024-11-26 05:26:11.825393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.298 [2024-11-26 05:26:11.825599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.298 [2024-11-26 05:26:11.825625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.298 [2024-11-26 05:26:11.825641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.298 [2024-11-26 05:26:11.827806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.298 [2024-11-26 05:26:11.837300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.298 [2024-11-26 05:26:11.837671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.837839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.837882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.298 [2024-11-26 05:26:11.837902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.298 [2024-11-26 05:26:11.838067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.298 [2024-11-26 05:26:11.838273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.298 [2024-11-26 05:26:11.838299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.298 [2024-11-26 05:26:11.838315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.298 [2024-11-26 05:26:11.840633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.298 [2024-11-26 05:26:11.850006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.298 [2024-11-26 05:26:11.850283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.850493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.850523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.298 [2024-11-26 05:26:11.850541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.298 [2024-11-26 05:26:11.850654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.298 [2024-11-26 05:26:11.850837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.298 [2024-11-26 05:26:11.850863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.298 [2024-11-26 05:26:11.850879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.298 [2024-11-26 05:26:11.853065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.298 [2024-11-26 05:26:11.862535] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.298 [2024-11-26 05:26:11.862847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.863052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.863082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.298 [2024-11-26 05:26:11.863100] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.298 [2024-11-26 05:26:11.863267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.298 [2024-11-26 05:26:11.863455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.298 [2024-11-26 05:26:11.863481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.298 [2024-11-26 05:26:11.863498] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.298 [2024-11-26 05:26:11.865896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.298 [2024-11-26 05:26:11.875173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.298 [2024-11-26 05:26:11.875483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.875627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-11-26 05:26:11.875658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.298 [2024-11-26 05:26:11.875676] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.298 [2024-11-26 05:26:11.875857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.298 [2024-11-26 05:26:11.876027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.298 [2024-11-26 05:26:11.876053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.298 [2024-11-26 05:26:11.876069] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.298 [2024-11-26 05:26:11.878328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.298 [2024-11-26 05:26:11.887906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.299 [2024-11-26 05:26:11.888227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.888370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.888401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.299 [2024-11-26 05:26:11.888424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.299 [2024-11-26 05:26:11.888645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.299 [2024-11-26 05:26:11.888814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.299 [2024-11-26 05:26:11.888841] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.299 [2024-11-26 05:26:11.888858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.299 [2024-11-26 05:26:11.891156] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.299 [2024-11-26 05:26:11.900394] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.299 [2024-11-26 05:26:11.900758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.900917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.900945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.299 [2024-11-26 05:26:11.900963] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.299 [2024-11-26 05:26:11.901182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.299 [2024-11-26 05:26:11.901353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.299 [2024-11-26 05:26:11.901379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.299 [2024-11-26 05:26:11.901395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.299 [2024-11-26 05:26:11.903971] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.299 [2024-11-26 05:26:11.912915] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.299 [2024-11-26 05:26:11.913247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.913470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.913521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.299 [2024-11-26 05:26:11.913540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.299 [2024-11-26 05:26:11.913726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.299 [2024-11-26 05:26:11.913864] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.299 [2024-11-26 05:26:11.913890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.299 [2024-11-26 05:26:11.913906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.299 [2024-11-26 05:26:11.916364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.299 [2024-11-26 05:26:11.925726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.299 [2024-11-26 05:26:11.926050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.926221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.926248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.299 [2024-11-26 05:26:11.926266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.299 [2024-11-26 05:26:11.926439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.299 [2024-11-26 05:26:11.926628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.299 [2024-11-26 05:26:11.926654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.299 [2024-11-26 05:26:11.926669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.299 [2024-11-26 05:26:11.928819] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.299 [2024-11-26 05:26:11.938363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.299 [2024-11-26 05:26:11.938702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.938847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.938875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.299 [2024-11-26 05:26:11.938892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.299 [2024-11-26 05:26:11.939058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.299 [2024-11-26 05:26:11.939246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.299 [2024-11-26 05:26:11.939272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.299 [2024-11-26 05:26:11.939288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.299 [2024-11-26 05:26:11.941547] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.299 [2024-11-26 05:26:11.950863] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.299 [2024-11-26 05:26:11.951226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.951439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.951492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.299 [2024-11-26 05:26:11.951511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.299 [2024-11-26 05:26:11.951710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.299 [2024-11-26 05:26:11.951936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.299 [2024-11-26 05:26:11.951960] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.299 [2024-11-26 05:26:11.951976] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.299 [2024-11-26 05:26:11.954325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.299 [2024-11-26 05:26:11.963340] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.299 [2024-11-26 05:26:11.963664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.963841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.963870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.299 [2024-11-26 05:26:11.963888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.299 [2024-11-26 05:26:11.964073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.299 [2024-11-26 05:26:11.964249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.299 [2024-11-26 05:26:11.964276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.299 [2024-11-26 05:26:11.964292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.299 [2024-11-26 05:26:11.966573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.299 [2024-11-26 05:26:11.976018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.299 [2024-11-26 05:26:11.976349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.976491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.976521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.299 [2024-11-26 05:26:11.976539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.299 [2024-11-26 05:26:11.976720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.299 [2024-11-26 05:26:11.976927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.299 [2024-11-26 05:26:11.976952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.299 [2024-11-26 05:26:11.976968] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.299 [2024-11-26 05:26:11.979335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.299 [2024-11-26 05:26:11.988449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.299 [2024-11-26 05:26:11.988725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.988918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:11.988969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.299 [2024-11-26 05:26:11.988987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.299 [2024-11-26 05:26:11.989119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.299 [2024-11-26 05:26:11.989307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.299 [2024-11-26 05:26:11.989332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.299 [2024-11-26 05:26:11.989348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.299 [2024-11-26 05:26:11.991709] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.299 [2024-11-26 05:26:12.001209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.299 [2024-11-26 05:26:12.001531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:12.001729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-11-26 05:26:12.001761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.300 [2024-11-26 05:26:12.001780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.300 [2024-11-26 05:26:12.001946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.300 [2024-11-26 05:26:12.002080] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.300 [2024-11-26 05:26:12.002112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.300 [2024-11-26 05:26:12.002129] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.300 [2024-11-26 05:26:12.004425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.300 [2024-11-26 05:26:12.013795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.300 [2024-11-26 05:26:12.014125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-11-26 05:26:12.014269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-11-26 05:26:12.014299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.300 [2024-11-26 05:26:12.014317] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.300 [2024-11-26 05:26:12.014465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.300 [2024-11-26 05:26:12.014636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.300 [2024-11-26 05:26:12.014661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.300 [2024-11-26 05:26:12.014678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.300 [2024-11-26 05:26:12.016844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.300 [2024-11-26 05:26:12.026310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.300 [2024-11-26 05:26:12.026660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-11-26 05:26:12.026817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-11-26 05:26:12.026846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.300 [2024-11-26 05:26:12.026864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.300 [2024-11-26 05:26:12.027067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.300 [2024-11-26 05:26:12.027256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.300 [2024-11-26 05:26:12.027281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.300 [2024-11-26 05:26:12.027297] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.300 [2024-11-26 05:26:12.029597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.300 [2024-11-26 05:26:12.038992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.300 [2024-11-26 05:26:12.039244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-11-26 05:26:12.039379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-11-26 05:26:12.039410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.300 [2024-11-26 05:26:12.039429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.300 [2024-11-26 05:26:12.039614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.300 [2024-11-26 05:26:12.039837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.300 [2024-11-26 05:26:12.039864] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.300 [2024-11-26 05:26:12.039887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.300 [2024-11-26 05:26:12.042151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.300 [2024-11-26 05:26:12.051583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.300 [2024-11-26 05:26:12.051942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-11-26 05:26:12.052114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-11-26 05:26:12.052143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.300 [2024-11-26 05:26:12.052161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.300 [2024-11-26 05:26:12.052254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.300 [2024-11-26 05:26:12.052442] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.300 [2024-11-26 05:26:12.052466] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.300 [2024-11-26 05:26:12.052482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.300 [2024-11-26 05:26:12.054793] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.562 [2024-11-26 05:26:12.064099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.562 [2024-11-26 05:26:12.064424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.064569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.064599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.562 [2024-11-26 05:26:12.064617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.562 [2024-11-26 05:26:12.064763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.562 [2024-11-26 05:26:12.064916] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.562 [2024-11-26 05:26:12.064940] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.562 [2024-11-26 05:26:12.064955] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.562 [2024-11-26 05:26:12.067325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.562 [2024-11-26 05:26:12.076663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.562 [2024-11-26 05:26:12.077019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.077183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.077212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.562 [2024-11-26 05:26:12.077231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.562 [2024-11-26 05:26:12.077361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.562 [2024-11-26 05:26:12.077513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.562 [2024-11-26 05:26:12.077538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.562 [2024-11-26 05:26:12.077555] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.562 [2024-11-26 05:26:12.079933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.562 [2024-11-26 05:26:12.089284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.562 [2024-11-26 05:26:12.089615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.089786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.089814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.562 [2024-11-26 05:26:12.089831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.562 [2024-11-26 05:26:12.089996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.562 [2024-11-26 05:26:12.090197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.562 [2024-11-26 05:26:12.090223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.562 [2024-11-26 05:26:12.090239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.562 [2024-11-26 05:26:12.092435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.562 [2024-11-26 05:26:12.101832] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.562 [2024-11-26 05:26:12.102217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.102378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.102425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.562 [2024-11-26 05:26:12.102443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.562 [2024-11-26 05:26:12.102615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.562 [2024-11-26 05:26:12.102796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.562 [2024-11-26 05:26:12.102819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.562 [2024-11-26 05:26:12.102834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.562 [2024-11-26 05:26:12.105266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.562 [2024-11-26 05:26:12.114220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.562 [2024-11-26 05:26:12.114534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.114680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.114743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.562 [2024-11-26 05:26:12.114760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.562 [2024-11-26 05:26:12.114876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.562 [2024-11-26 05:26:12.115047] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.562 [2024-11-26 05:26:12.115087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.562 [2024-11-26 05:26:12.115103] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.562 [2024-11-26 05:26:12.117456] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.562 [2024-11-26 05:26:12.126718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.562 [2024-11-26 05:26:12.127116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.127271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.127318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.562 [2024-11-26 05:26:12.127336] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.562 [2024-11-26 05:26:12.127502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.562 [2024-11-26 05:26:12.127654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.562 [2024-11-26 05:26:12.127679] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.562 [2024-11-26 05:26:12.127709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.562 [2024-11-26 05:26:12.130032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.562 [2024-11-26 05:26:12.139213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.562 [2024-11-26 05:26:12.139511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.139657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.139697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.562 [2024-11-26 05:26:12.139719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.562 [2024-11-26 05:26:12.139887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.562 [2024-11-26 05:26:12.140099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.562 [2024-11-26 05:26:12.140124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.562 [2024-11-26 05:26:12.140140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.562 [2024-11-26 05:26:12.142464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.562 [2024-11-26 05:26:12.151896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.562 [2024-11-26 05:26:12.152197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.152352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.562 [2024-11-26 05:26:12.152382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.562 [2024-11-26 05:26:12.152400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.562 [2024-11-26 05:26:12.152584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.562 [2024-11-26 05:26:12.152751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.562 [2024-11-26 05:26:12.152777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.562 [2024-11-26 05:26:12.152793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.562 [2024-11-26 05:26:12.155138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.562 [2024-11-26 05:26:12.164291] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.562 [2024-11-26 05:26:12.164672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.164829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.164858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.563 [2024-11-26 05:26:12.164877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.563 [2024-11-26 05:26:12.165079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.563 [2024-11-26 05:26:12.165232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.563 [2024-11-26 05:26:12.165256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.563 [2024-11-26 05:26:12.165273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.563 [2024-11-26 05:26:12.167784] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.563 [2024-11-26 05:26:12.176946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.563 [2024-11-26 05:26:12.177295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.177449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.177479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.563 [2024-11-26 05:26:12.177498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.563 [2024-11-26 05:26:12.177610] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.563 [2024-11-26 05:26:12.177776] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.563 [2024-11-26 05:26:12.177802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.563 [2024-11-26 05:26:12.177817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.563 [2024-11-26 05:26:12.179997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.563 [2024-11-26 05:26:12.189345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.563 [2024-11-26 05:26:12.189714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.189884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.189913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.563 [2024-11-26 05:26:12.189932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.563 [2024-11-26 05:26:12.190098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.563 [2024-11-26 05:26:12.190252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.563 [2024-11-26 05:26:12.190277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.563 [2024-11-26 05:26:12.190292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.563 [2024-11-26 05:26:12.192664] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.563 [2024-11-26 05:26:12.201949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.563 [2024-11-26 05:26:12.202320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.202469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.202504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.563 [2024-11-26 05:26:12.202524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.563 [2024-11-26 05:26:12.202720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.563 [2024-11-26 05:26:12.202910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.563 [2024-11-26 05:26:12.202936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.563 [2024-11-26 05:26:12.202952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.563 [2024-11-26 05:26:12.205413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.563 [2024-11-26 05:26:12.214599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.563 [2024-11-26 05:26:12.214938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.215128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.215155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.563 [2024-11-26 05:26:12.215189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.563 [2024-11-26 05:26:12.215408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.563 [2024-11-26 05:26:12.215596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.563 [2024-11-26 05:26:12.215621] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.563 [2024-11-26 05:26:12.215637] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.563 [2024-11-26 05:26:12.218235] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.563 [2024-11-26 05:26:12.227315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.563 [2024-11-26 05:26:12.227654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.227833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.227860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.563 [2024-11-26 05:26:12.227877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.563 [2024-11-26 05:26:12.228048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.563 [2024-11-26 05:26:12.228201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.563 [2024-11-26 05:26:12.228226] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.563 [2024-11-26 05:26:12.228242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.563 [2024-11-26 05:26:12.230396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.563 [2024-11-26 05:26:12.239957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.563 [2024-11-26 05:26:12.240353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.240538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.240568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.563 [2024-11-26 05:26:12.240592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.563 [2024-11-26 05:26:12.240783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.563 [2024-11-26 05:26:12.240907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.563 [2024-11-26 05:26:12.240941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.563 [2024-11-26 05:26:12.240956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.563 [2024-11-26 05:26:12.243215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.563 [2024-11-26 05:26:12.252613] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.563 [2024-11-26 05:26:12.252946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.253098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.253134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.563 [2024-11-26 05:26:12.253150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.563 [2024-11-26 05:26:12.253314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.563 [2024-11-26 05:26:12.253538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.563 [2024-11-26 05:26:12.253564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.563 [2024-11-26 05:26:12.253580] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.563 [2024-11-26 05:26:12.255963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.563 [2024-11-26 05:26:12.265222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.563 [2024-11-26 05:26:12.265555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.265735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.265766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.563 [2024-11-26 05:26:12.265784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.563 [2024-11-26 05:26:12.265955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.563 [2024-11-26 05:26:12.266126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.563 [2024-11-26 05:26:12.266152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.563 [2024-11-26 05:26:12.266168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.563 [2024-11-26 05:26:12.268555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.563 [2024-11-26 05:26:12.277719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.563 [2024-11-26 05:26:12.278032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.278170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.563 [2024-11-26 05:26:12.278214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.564 [2024-11-26 05:26:12.278230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.564 [2024-11-26 05:26:12.278397] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.564 [2024-11-26 05:26:12.278577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.564 [2024-11-26 05:26:12.278602] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.564 [2024-11-26 05:26:12.278619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.564 [2024-11-26 05:26:12.281142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.564 [2024-11-26 05:26:12.290486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.564 [2024-11-26 05:26:12.290798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.564 [2024-11-26 05:26:12.290981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.564 [2024-11-26 05:26:12.291008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.564 [2024-11-26 05:26:12.291025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.564 [2024-11-26 05:26:12.291240] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.564 [2024-11-26 05:26:12.291448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.564 [2024-11-26 05:26:12.291472] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.564 [2024-11-26 05:26:12.291488] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.564 [2024-11-26 05:26:12.293884] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.564 [2024-11-26 05:26:12.303056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.564 [2024-11-26 05:26:12.303388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.564 [2024-11-26 05:26:12.303526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.564 [2024-11-26 05:26:12.303553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.564 [2024-11-26 05:26:12.303570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.564 [2024-11-26 05:26:12.303791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.564 [2024-11-26 05:26:12.303964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.564 [2024-11-26 05:26:12.303988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.564 [2024-11-26 05:26:12.304005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.564 [2024-11-26 05:26:12.306389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.564 [2024-11-26 05:26:12.315481] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.564 [2024-11-26 05:26:12.315768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.564 [2024-11-26 05:26:12.315882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.564 [2024-11-26 05:26:12.315911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.564 [2024-11-26 05:26:12.315929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.564 [2024-11-26 05:26:12.316132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.564 [2024-11-26 05:26:12.316348] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.564 [2024-11-26 05:26:12.316374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.564 [2024-11-26 05:26:12.316391] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.564 [2024-11-26 05:26:12.318895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.824 [2024-11-26 05:26:12.327999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.824 [2024-11-26 05:26:12.328372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.824 [2024-11-26 05:26:12.328500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.824 [2024-11-26 05:26:12.328529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.824 [2024-11-26 05:26:12.328547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.824 [2024-11-26 05:26:12.328747] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.824 [2024-11-26 05:26:12.328937] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.824 [2024-11-26 05:26:12.328961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.824 [2024-11-26 05:26:12.328977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.824 [2024-11-26 05:26:12.331285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.824 [2024-11-26 05:26:12.340631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.824 [2024-11-26 05:26:12.341011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.824 [2024-11-26 05:26:12.341184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.824 [2024-11-26 05:26:12.341215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.824 [2024-11-26 05:26:12.341233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.824 [2024-11-26 05:26:12.341400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.824 [2024-11-26 05:26:12.341607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.824 [2024-11-26 05:26:12.341633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.824 [2024-11-26 05:26:12.341649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.824 [2024-11-26 05:26:12.344007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.824 [2024-11-26 05:26:12.353351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.824 [2024-11-26 05:26:12.353738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.824 [2024-11-26 05:26:12.353927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.824 [2024-11-26 05:26:12.353952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.824 [2024-11-26 05:26:12.353968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.824 [2024-11-26 05:26:12.354167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.824 [2024-11-26 05:26:12.354354] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.824 [2024-11-26 05:26:12.354386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.824 [2024-11-26 05:26:12.354404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.824 [2024-11-26 05:26:12.356904] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.824 [2024-11-26 05:26:12.366045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.824 [2024-11-26 05:26:12.366392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.824 [2024-11-26 05:26:12.366537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.824 [2024-11-26 05:26:12.366567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.824 [2024-11-26 05:26:12.366585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.824 [2024-11-26 05:26:12.366743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.824 [2024-11-26 05:26:12.366897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.824 [2024-11-26 05:26:12.366922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.824 [2024-11-26 05:26:12.366941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.824 [2024-11-26 05:26:12.369307] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.824 [2024-11-26 05:26:12.378448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.824 [2024-11-26 05:26:12.378724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.824 [2024-11-26 05:26:12.378843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.824 [2024-11-26 05:26:12.378874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.824 [2024-11-26 05:26:12.378892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.824 [2024-11-26 05:26:12.379059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.824 [2024-11-26 05:26:12.379230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.825 [2024-11-26 05:26:12.379256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.825 [2024-11-26 05:26:12.379272] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.825 [2024-11-26 05:26:12.381620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.825 [2024-11-26 05:26:12.391176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.825 [2024-11-26 05:26:12.391543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.391704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.391735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.825 [2024-11-26 05:26:12.391753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.825 [2024-11-26 05:26:12.391883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.825 [2024-11-26 05:26:12.392090] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.825 [2024-11-26 05:26:12.392116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.825 [2024-11-26 05:26:12.392142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.825 [2024-11-26 05:26:12.394404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.825 [2024-11-26 05:26:12.403845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.825 [2024-11-26 05:26:12.404175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.404278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.404316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.825 [2024-11-26 05:26:12.404333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.825 [2024-11-26 05:26:12.404517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.825 [2024-11-26 05:26:12.404720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.825 [2024-11-26 05:26:12.404746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.825 [2024-11-26 05:26:12.404762] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.825 [2024-11-26 05:26:12.407096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.825 [2024-11-26 05:26:12.416390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.825 [2024-11-26 05:26:12.416678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.416851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.416877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.825 [2024-11-26 05:26:12.416894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.825 [2024-11-26 05:26:12.417129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.825 [2024-11-26 05:26:12.417338] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.825 [2024-11-26 05:26:12.417363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.825 [2024-11-26 05:26:12.417378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.825 [2024-11-26 05:26:12.419536] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.825 [2024-11-26 05:26:12.429068] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.825 [2024-11-26 05:26:12.429406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.429593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.429619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.825 [2024-11-26 05:26:12.429636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.825 [2024-11-26 05:26:12.429837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.825 [2024-11-26 05:26:12.430018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.825 [2024-11-26 05:26:12.430045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.825 [2024-11-26 05:26:12.430061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.825 [2024-11-26 05:26:12.432465] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.825 [2024-11-26 05:26:12.441531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.825 [2024-11-26 05:26:12.441891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.442002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.442032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.825 [2024-11-26 05:26:12.442050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.825 [2024-11-26 05:26:12.442235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.825 [2024-11-26 05:26:12.442440] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.825 [2024-11-26 05:26:12.442467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.825 [2024-11-26 05:26:12.442482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.825 [2024-11-26 05:26:12.444900] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.825 [2024-11-26 05:26:12.454242] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.825 [2024-11-26 05:26:12.454609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.454744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.454776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.825 [2024-11-26 05:26:12.454795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.825 [2024-11-26 05:26:12.454980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.825 [2024-11-26 05:26:12.455150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.825 [2024-11-26 05:26:12.455177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.825 [2024-11-26 05:26:12.455193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.825 [2024-11-26 05:26:12.457401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.825 [2024-11-26 05:26:12.466603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.825 [2024-11-26 05:26:12.466925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.467084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.467135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.825 [2024-11-26 05:26:12.467154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.825 [2024-11-26 05:26:12.467339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.825 [2024-11-26 05:26:12.467493] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.825 [2024-11-26 05:26:12.467518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.825 [2024-11-26 05:26:12.467535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.825 [2024-11-26 05:26:12.469772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.825 [2024-11-26 05:26:12.479048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.825 [2024-11-26 05:26:12.479470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.479632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.479661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.825 [2024-11-26 05:26:12.479679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.825 [2024-11-26 05:26:12.479878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.825 [2024-11-26 05:26:12.480068] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.825 [2024-11-26 05:26:12.480094] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.825 [2024-11-26 05:26:12.480110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.825 [2024-11-26 05:26:12.482552] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.825 [2024-11-26 05:26:12.491749] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.825 [2024-11-26 05:26:12.492147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.492287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.825 [2024-11-26 05:26:12.492315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.825 [2024-11-26 05:26:12.492333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.825 [2024-11-26 05:26:12.492462] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.825 [2024-11-26 05:26:12.492615] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.825 [2024-11-26 05:26:12.492639] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.825 [2024-11-26 05:26:12.492654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.825 [2024-11-26 05:26:12.495179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.826 [2024-11-26 05:26:12.504217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.826 [2024-11-26 05:26:12.504668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.504879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.504907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.826 [2024-11-26 05:26:12.504925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.826 [2024-11-26 05:26:12.505090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.826 [2024-11-26 05:26:12.505262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.826 [2024-11-26 05:26:12.505287] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.826 [2024-11-26 05:26:12.505303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.826 [2024-11-26 05:26:12.507675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.826 [2024-11-26 05:26:12.516857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.826 [2024-11-26 05:26:12.517129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.517279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.517311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.826 [2024-11-26 05:26:12.517329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.826 [2024-11-26 05:26:12.517497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.826 [2024-11-26 05:26:12.517698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.826 [2024-11-26 05:26:12.517724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.826 [2024-11-26 05:26:12.517741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.826 [2024-11-26 05:26:12.520018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.826 [2024-11-26 05:26:12.529494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.826 [2024-11-26 05:26:12.529902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.530029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.530054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.826 [2024-11-26 05:26:12.530071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.826 [2024-11-26 05:26:12.530183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.826 [2024-11-26 05:26:12.530361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.826 [2024-11-26 05:26:12.530387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.826 [2024-11-26 05:26:12.530403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.826 [2024-11-26 05:26:12.532714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.826 [2024-11-26 05:26:12.542224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.826 [2024-11-26 05:26:12.542680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.542830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.542855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.826 [2024-11-26 05:26:12.542872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.826 [2024-11-26 05:26:12.543070] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.826 [2024-11-26 05:26:12.543240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.826 [2024-11-26 05:26:12.543266] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.826 [2024-11-26 05:26:12.543281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.826 [2024-11-26 05:26:12.545619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.826 [2024-11-26 05:26:12.554857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.826 [2024-11-26 05:26:12.555226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.555389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.555418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.826 [2024-11-26 05:26:12.555442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.826 [2024-11-26 05:26:12.555591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.826 [2024-11-26 05:26:12.555757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.826 [2024-11-26 05:26:12.555782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.826 [2024-11-26 05:26:12.555797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.826 [2024-11-26 05:26:12.558201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.826 [2024-11-26 05:26:12.567415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.826 [2024-11-26 05:26:12.567770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.567909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.567951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.826 [2024-11-26 05:26:12.567969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.826 [2024-11-26 05:26:12.568100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.826 [2024-11-26 05:26:12.568235] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.826 [2024-11-26 05:26:12.568260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.826 [2024-11-26 05:26:12.568276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.826 [2024-11-26 05:26:12.570673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:10.826 [2024-11-26 05:26:12.580069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:10.826 [2024-11-26 05:26:12.580435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.580581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 05:26:12.580609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:10.826 [2024-11-26 05:26:12.580628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:10.826 [2024-11-26 05:26:12.580824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:10.826 [2024-11-26 05:26:12.580977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:10.826 [2024-11-26 05:26:12.581002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:10.826 [2024-11-26 05:26:12.581018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:10.826 [2024-11-26 05:26:12.583222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.086 [2024-11-26 05:26:12.592734] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.086 [2024-11-26 05:26:12.593021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.086 [2024-11-26 05:26:12.593176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.086 [2024-11-26 05:26:12.593211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.086 [2024-11-26 05:26:12.593246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.086 [2024-11-26 05:26:12.593456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.086 [2024-11-26 05:26:12.593645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.086 [2024-11-26 05:26:12.593670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.086 [2024-11-26 05:26:12.593694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.086 [2024-11-26 05:26:12.596042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.086 [2024-11-26 05:26:12.605662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.086 [2024-11-26 05:26:12.605999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.086 [2024-11-26 05:26:12.606173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.086 [2024-11-26 05:26:12.606200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.086 [2024-11-26 05:26:12.606217] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.086 [2024-11-26 05:26:12.606419] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.086 [2024-11-26 05:26:12.606618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.086 [2024-11-26 05:26:12.606643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.086 [2024-11-26 05:26:12.606659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.086 [2024-11-26 05:26:12.609018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.086 [2024-11-26 05:26:12.618306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.086 [2024-11-26 05:26:12.618709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.086 [2024-11-26 05:26:12.618872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.086 [2024-11-26 05:26:12.618901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.086 [2024-11-26 05:26:12.618919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.086 [2024-11-26 05:26:12.619048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.086 [2024-11-26 05:26:12.619201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.086 [2024-11-26 05:26:12.619226] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.086 [2024-11-26 05:26:12.619242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.086 [2024-11-26 05:26:12.621572] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.086 [2024-11-26 05:26:12.631093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.086 [2024-11-26 05:26:12.631461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.086 [2024-11-26 05:26:12.631632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.086 [2024-11-26 05:26:12.631661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.086 [2024-11-26 05:26:12.631679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.086 [2024-11-26 05:26:12.631892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.086 [2024-11-26 05:26:12.632052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.086 [2024-11-26 05:26:12.632077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.086 [2024-11-26 05:26:12.632093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.086 [2024-11-26 05:26:12.634458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.086 [2024-11-26 05:26:12.643697] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.086 [2024-11-26 05:26:12.644029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.086 [2024-11-26 05:26:12.644198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.644227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.087 [2024-11-26 05:26:12.644246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.087 [2024-11-26 05:26:12.644412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.087 [2024-11-26 05:26:12.644601] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.087 [2024-11-26 05:26:12.644626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.087 [2024-11-26 05:26:12.644642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.087 [2024-11-26 05:26:12.647108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.087 [2024-11-26 05:26:12.656420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.087 [2024-11-26 05:26:12.656728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.656864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.656893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.087 [2024-11-26 05:26:12.656910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.087 [2024-11-26 05:26:12.657058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.087 [2024-11-26 05:26:12.657193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.087 [2024-11-26 05:26:12.657218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.087 [2024-11-26 05:26:12.657233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.087 [2024-11-26 05:26:12.659419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.087 [2024-11-26 05:26:12.668953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.087 [2024-11-26 05:26:12.669253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.669394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.669436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.087 [2024-11-26 05:26:12.669452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.087 [2024-11-26 05:26:12.669717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.087 [2024-11-26 05:26:12.669889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.087 [2024-11-26 05:26:12.669919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.087 [2024-11-26 05:26:12.669936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.087 [2024-11-26 05:26:12.672289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.087 [2024-11-26 05:26:12.681563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.087 [2024-11-26 05:26:12.681913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.682084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.682113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.087 [2024-11-26 05:26:12.682132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.087 [2024-11-26 05:26:12.682316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.087 [2024-11-26 05:26:12.682524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.087 [2024-11-26 05:26:12.682549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.087 [2024-11-26 05:26:12.682565] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.087 [2024-11-26 05:26:12.685012] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.087 [2024-11-26 05:26:12.694139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.087 [2024-11-26 05:26:12.694459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.694638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.694682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.087 [2024-11-26 05:26:12.694710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.087 [2024-11-26 05:26:12.694877] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.087 [2024-11-26 05:26:12.695057] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.087 [2024-11-26 05:26:12.695082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.087 [2024-11-26 05:26:12.695098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.087 [2024-11-26 05:26:12.697084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.087 [2024-11-26 05:26:12.706769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.087 [2024-11-26 05:26:12.707176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.707338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.707385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.087 [2024-11-26 05:26:12.707403] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.087 [2024-11-26 05:26:12.707569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.087 [2024-11-26 05:26:12.707763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.087 [2024-11-26 05:26:12.707787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.087 [2024-11-26 05:26:12.707807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.087 [2024-11-26 05:26:12.710146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.087 [2024-11-26 05:26:12.719200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.087 [2024-11-26 05:26:12.719568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.719710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.719755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.087 [2024-11-26 05:26:12.719772] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.087 [2024-11-26 05:26:12.719953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.087 [2024-11-26 05:26:12.720122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.087 [2024-11-26 05:26:12.720147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.087 [2024-11-26 05:26:12.720163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.087 [2024-11-26 05:26:12.722676] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.087 [2024-11-26 05:26:12.731705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.087 [2024-11-26 05:26:12.732035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.732211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.732240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.087 [2024-11-26 05:26:12.732258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.087 [2024-11-26 05:26:12.732388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.087 [2024-11-26 05:26:12.732595] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.087 [2024-11-26 05:26:12.732619] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.087 [2024-11-26 05:26:12.732636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.087 [2024-11-26 05:26:12.734958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.087 [2024-11-26 05:26:12.744271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.087 [2024-11-26 05:26:12.744595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.744772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.744803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.087 [2024-11-26 05:26:12.744821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.087 [2024-11-26 05:26:12.744970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.087 [2024-11-26 05:26:12.745176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.087 [2024-11-26 05:26:12.745201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.087 [2024-11-26 05:26:12.745218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.087 [2024-11-26 05:26:12.747410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.087 [2024-11-26 05:26:12.756715] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.087 [2024-11-26 05:26:12.757011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.757192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.087 [2024-11-26 05:26:12.757219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.087 [2024-11-26 05:26:12.757235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.088 [2024-11-26 05:26:12.757395] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.088 [2024-11-26 05:26:12.757605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.088 [2024-11-26 05:26:12.757630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.088 [2024-11-26 05:26:12.757646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.088 [2024-11-26 05:26:12.759931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.088 [2024-11-26 05:26:12.769333] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.088 [2024-11-26 05:26:12.769680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.769855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.769884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.088 [2024-11-26 05:26:12.769903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.088 [2024-11-26 05:26:12.770086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.088 [2024-11-26 05:26:12.770257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.088 [2024-11-26 05:26:12.770282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.088 [2024-11-26 05:26:12.770298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.088 [2024-11-26 05:26:12.772763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.088 [2024-11-26 05:26:12.781971] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.088 [2024-11-26 05:26:12.782313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.782496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.782523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.088 [2024-11-26 05:26:12.782557] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.088 [2024-11-26 05:26:12.782716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.088 [2024-11-26 05:26:12.782852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.088 [2024-11-26 05:26:12.782877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.088 [2024-11-26 05:26:12.782893] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.088 [2024-11-26 05:26:12.785203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.088 [2024-11-26 05:26:12.794418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.088 [2024-11-26 05:26:12.794731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.794873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.794903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.088 [2024-11-26 05:26:12.794921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.088 [2024-11-26 05:26:12.795068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.088 [2024-11-26 05:26:12.795239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.088 [2024-11-26 05:26:12.795264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.088 [2024-11-26 05:26:12.795280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.088 [2024-11-26 05:26:12.797726] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.088 [2024-11-26 05:26:12.806954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.088 [2024-11-26 05:26:12.807206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.807382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.807407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.088 [2024-11-26 05:26:12.807423] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.088 [2024-11-26 05:26:12.807618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.088 [2024-11-26 05:26:12.807840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.088 [2024-11-26 05:26:12.807866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.088 [2024-11-26 05:26:12.807882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.088 [2024-11-26 05:26:12.810441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.088 [2024-11-26 05:26:12.819411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.088 [2024-11-26 05:26:12.819734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.819908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.819935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.088 [2024-11-26 05:26:12.819951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.088 [2024-11-26 05:26:12.820147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.088 [2024-11-26 05:26:12.820301] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.088 [2024-11-26 05:26:12.820326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.088 [2024-11-26 05:26:12.820342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.088 [2024-11-26 05:26:12.822670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.088 [2024-11-26 05:26:12.832114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.088 [2024-11-26 05:26:12.832484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.832628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.832657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.088 [2024-11-26 05:26:12.832676] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.088 [2024-11-26 05:26:12.832832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.088 [2024-11-26 05:26:12.833039] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.088 [2024-11-26 05:26:12.833064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.088 [2024-11-26 05:26:12.833080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.088 [2024-11-26 05:26:12.835298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.088 [2024-11-26 05:26:12.844792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.088 [2024-11-26 05:26:12.845108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.845252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.088 [2024-11-26 05:26:12.845282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.088 [2024-11-26 05:26:12.845301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.088 [2024-11-26 05:26:12.845520] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.088 [2024-11-26 05:26:12.845673] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.088 [2024-11-26 05:26:12.845708] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.088 [2024-11-26 05:26:12.845725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.088 [2024-11-26 05:26:12.848233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.348 [2024-11-26 05:26:12.857378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.348 [2024-11-26 05:26:12.857703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.348 [2024-11-26 05:26:12.857850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.348 [2024-11-26 05:26:12.857879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.349 [2024-11-26 05:26:12.857897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.349 [2024-11-26 05:26:12.858100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.349 [2024-11-26 05:26:12.858271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.349 [2024-11-26 05:26:12.858296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.349 [2024-11-26 05:26:12.858311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.349 [2024-11-26 05:26:12.860645] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.349 [2024-11-26 05:26:12.870065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.349 [2024-11-26 05:26:12.870385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.870536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.870567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.349 [2024-11-26 05:26:12.870601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.349 [2024-11-26 05:26:12.870780] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.349 [2024-11-26 05:26:12.870971] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.349 [2024-11-26 05:26:12.870995] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.349 [2024-11-26 05:26:12.871011] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.349 [2024-11-26 05:26:12.873466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.349 [2024-11-26 05:26:12.882651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.349 [2024-11-26 05:26:12.883024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.883181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.883210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.349 [2024-11-26 05:26:12.883228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.349 [2024-11-26 05:26:12.883394] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.349 [2024-11-26 05:26:12.883583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.349 [2024-11-26 05:26:12.883608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.349 [2024-11-26 05:26:12.883623] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.349 [2024-11-26 05:26:12.886030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.349 [2024-11-26 05:26:12.895134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.349 [2024-11-26 05:26:12.895444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.895615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.895644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.349 [2024-11-26 05:26:12.895662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.349 [2024-11-26 05:26:12.895857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.349 [2024-11-26 05:26:12.895993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.349 [2024-11-26 05:26:12.896017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.349 [2024-11-26 05:26:12.896033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.349 [2024-11-26 05:26:12.898486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.349 [2024-11-26 05:26:12.907721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.349 [2024-11-26 05:26:12.908004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.908203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.908230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.349 [2024-11-26 05:26:12.908251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.349 [2024-11-26 05:26:12.908434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.349 [2024-11-26 05:26:12.908605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.349 [2024-11-26 05:26:12.908630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.349 [2024-11-26 05:26:12.908646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.349 [2024-11-26 05:26:12.911076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.349 [2024-11-26 05:26:12.920247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.349 [2024-11-26 05:26:12.920593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.920733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.920764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.349 [2024-11-26 05:26:12.920782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.349 [2024-11-26 05:26:12.920949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.349 [2024-11-26 05:26:12.921139] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.349 [2024-11-26 05:26:12.921163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.349 [2024-11-26 05:26:12.921180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.349 [2024-11-26 05:26:12.923453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.349 [2024-11-26 05:26:12.932977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.349 [2024-11-26 05:26:12.933340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.933494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.933523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.349 [2024-11-26 05:26:12.933542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.349 [2024-11-26 05:26:12.933702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.349 [2024-11-26 05:26:12.933910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.349 [2024-11-26 05:26:12.933934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.349 [2024-11-26 05:26:12.933950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.349 [2024-11-26 05:26:12.936419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.349 [2024-11-26 05:26:12.945551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.349 [2024-11-26 05:26:12.945889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.946051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.946099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.349 [2024-11-26 05:26:12.946117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.349 [2024-11-26 05:26:12.946253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.349 [2024-11-26 05:26:12.946388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.349 [2024-11-26 05:26:12.946413] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.349 [2024-11-26 05:26:12.946428] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.349 [2024-11-26 05:26:12.948716] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.349 [2024-11-26 05:26:12.958221] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.349 [2024-11-26 05:26:12.958512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.958696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.958726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.349 [2024-11-26 05:26:12.958744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.349 [2024-11-26 05:26:12.958892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.349 [2024-11-26 05:26:12.959028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.349 [2024-11-26 05:26:12.959052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.349 [2024-11-26 05:26:12.959068] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.349 [2024-11-26 05:26:12.961612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.349 [2024-11-26 05:26:12.970872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.349 [2024-11-26 05:26:12.971158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.971332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.349 [2024-11-26 05:26:12.971359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.349 [2024-11-26 05:26:12.971376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.350 [2024-11-26 05:26:12.971547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.350 [2024-11-26 05:26:12.971761] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.350 [2024-11-26 05:26:12.971786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.350 [2024-11-26 05:26:12.971802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.350 [2024-11-26 05:26:12.973951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.350 [2024-11-26 05:26:12.983370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.350 [2024-11-26 05:26:12.983682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:12.983832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:12.983862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.350 [2024-11-26 05:26:12.983881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.350 [2024-11-26 05:26:12.984064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.350 [2024-11-26 05:26:12.984245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.350 [2024-11-26 05:26:12.984270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.350 [2024-11-26 05:26:12.984286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.350 [2024-11-26 05:26:12.986616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.350 [2024-11-26 05:26:12.996002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.350 [2024-11-26 05:26:12.996349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:12.996515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:12.996545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.350 [2024-11-26 05:26:12.996563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.350 [2024-11-26 05:26:12.996740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.350 [2024-11-26 05:26:12.996876] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.350 [2024-11-26 05:26:12.996900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.350 [2024-11-26 05:26:12.996916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.350 [2024-11-26 05:26:12.999228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.350 [2024-11-26 05:26:13.008486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.350 [2024-11-26 05:26:13.008851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.009024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.009053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.350 [2024-11-26 05:26:13.009071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.350 [2024-11-26 05:26:13.009273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.350 [2024-11-26 05:26:13.009390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.350 [2024-11-26 05:26:13.009414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.350 [2024-11-26 05:26:13.009430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.350 [2024-11-26 05:26:13.011651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.350 [2024-11-26 05:26:13.021173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.350 [2024-11-26 05:26:13.021474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.021612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.021641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.350 [2024-11-26 05:26:13.021659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.350 [2024-11-26 05:26:13.021836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.350 [2024-11-26 05:26:13.022026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.350 [2024-11-26 05:26:13.022057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.350 [2024-11-26 05:26:13.022074] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.350 [2024-11-26 05:26:13.024401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.350 [2024-11-26 05:26:13.033598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.350 [2024-11-26 05:26:13.033915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.034059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.034088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.350 [2024-11-26 05:26:13.034106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.350 [2024-11-26 05:26:13.034272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.350 [2024-11-26 05:26:13.034442] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.350 [2024-11-26 05:26:13.034467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.350 [2024-11-26 05:26:13.034484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.350 [2024-11-26 05:26:13.036806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.350 [2024-11-26 05:26:13.046172] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.350 [2024-11-26 05:26:13.046500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.046669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.046709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.350 [2024-11-26 05:26:13.046729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.350 [2024-11-26 05:26:13.046876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.350 [2024-11-26 05:26:13.047029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.350 [2024-11-26 05:26:13.047053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.350 [2024-11-26 05:26:13.047070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.350 [2024-11-26 05:26:13.049499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.350 [2024-11-26 05:26:13.058851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.350 [2024-11-26 05:26:13.059147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.059316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.059345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.350 [2024-11-26 05:26:13.059364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.350 [2024-11-26 05:26:13.059511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.350 [2024-11-26 05:26:13.059664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.350 [2024-11-26 05:26:13.059698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.350 [2024-11-26 05:26:13.059723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.350 [2024-11-26 05:26:13.062015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.350 [2024-11-26 05:26:13.071400] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.350 [2024-11-26 05:26:13.071731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.071917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.071944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.350 [2024-11-26 05:26:13.071960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.350 [2024-11-26 05:26:13.072140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.350 [2024-11-26 05:26:13.072294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.350 [2024-11-26 05:26:13.072319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.350 [2024-11-26 05:26:13.072335] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.350 [2024-11-26 05:26:13.074778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.350 [2024-11-26 05:26:13.083843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.350 [2024-11-26 05:26:13.084229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.084427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.350 [2024-11-26 05:26:13.084461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.350 [2024-11-26 05:26:13.084499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.350 [2024-11-26 05:26:13.084647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.350 [2024-11-26 05:26:13.084829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.350 [2024-11-26 05:26:13.084855] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.350 [2024-11-26 05:26:13.084871] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.351 [2024-11-26 05:26:13.087289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.351 [2024-11-26 05:26:13.096437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.351 [2024-11-26 05:26:13.096740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.351 [2024-11-26 05:26:13.096968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.351 [2024-11-26 05:26:13.097002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.351 [2024-11-26 05:26:13.097036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.351 [2024-11-26 05:26:13.097148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.351 [2024-11-26 05:26:13.097300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.351 [2024-11-26 05:26:13.097325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.351 [2024-11-26 05:26:13.097341] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.351 [2024-11-26 05:26:13.099820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.351 [2024-11-26 05:26:13.109088] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.351 [2024-11-26 05:26:13.109386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.351 [2024-11-26 05:26:13.109519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.351 [2024-11-26 05:26:13.109546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.351 [2024-11-26 05:26:13.109563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.351 [2024-11-26 05:26:13.109735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.351 [2024-11-26 05:26:13.109900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.351 [2024-11-26 05:26:13.109925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.351 [2024-11-26 05:26:13.109941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.611 [2024-11-26 05:26:13.112251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.611 [2024-11-26 05:26:13.121925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.611 [2024-11-26 05:26:13.122233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.611 [2024-11-26 05:26:13.122457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.611 [2024-11-26 05:26:13.122510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.611 [2024-11-26 05:26:13.122528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.611 [2024-11-26 05:26:13.122658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.611 [2024-11-26 05:26:13.122858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.611 [2024-11-26 05:26:13.122885] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.611 [2024-11-26 05:26:13.122901] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.611 [2024-11-26 05:26:13.125157] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.611 [2024-11-26 05:26:13.134603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.611 [2024-11-26 05:26:13.134896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.611 [2024-11-26 05:26:13.135036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.611 [2024-11-26 05:26:13.135062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.611 [2024-11-26 05:26:13.135078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.611 [2024-11-26 05:26:13.135270] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.611 [2024-11-26 05:26:13.135441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.611 [2024-11-26 05:26:13.135466] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.611 [2024-11-26 05:26:13.135482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.611 [2024-11-26 05:26:13.137800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.611 [2024-11-26 05:26:13.147319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.611 [2024-11-26 05:26:13.147727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.611 [2024-11-26 05:26:13.147913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.611 [2024-11-26 05:26:13.148008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.611 [2024-11-26 05:26:13.148027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.611 [2024-11-26 05:26:13.148138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.611 [2024-11-26 05:26:13.148310] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.611 [2024-11-26 05:26:13.148334] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.611 [2024-11-26 05:26:13.148350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.611 [2024-11-26 05:26:13.150703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.611 [2024-11-26 05:26:13.159856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.611 [2024-11-26 05:26:13.160211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.611 [2024-11-26 05:26:13.160351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.611 [2024-11-26 05:26:13.160379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.611 [2024-11-26 05:26:13.160395] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.611 [2024-11-26 05:26:13.160574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.611 [2024-11-26 05:26:13.160795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.611 [2024-11-26 05:26:13.160821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.611 [2024-11-26 05:26:13.160837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.611 [2024-11-26 05:26:13.163181] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.611 [2024-11-26 05:26:13.172272] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.611 [2024-11-26 05:26:13.172545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.611 [2024-11-26 05:26:13.172697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.611 [2024-11-26 05:26:13.172727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.611 [2024-11-26 05:26:13.172745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.612 [2024-11-26 05:26:13.172894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.612 [2024-11-26 05:26:13.173083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.612 [2024-11-26 05:26:13.173108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.612 [2024-11-26 05:26:13.173124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.612 [2024-11-26 05:26:13.175578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.612 [2024-11-26 05:26:13.185007] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.612 [2024-11-26 05:26:13.185337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.185499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.185525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.612 [2024-11-26 05:26:13.185541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.612 [2024-11-26 05:26:13.185760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.612 [2024-11-26 05:26:13.186005] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.612 [2024-11-26 05:26:13.186030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.612 [2024-11-26 05:26:13.186046] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.612 [2024-11-26 05:26:13.188248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.612 [2024-11-26 05:26:13.197467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.612 [2024-11-26 05:26:13.197798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.197981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.198007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.612 [2024-11-26 05:26:13.198039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.612 [2024-11-26 05:26:13.198171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.612 [2024-11-26 05:26:13.198342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.612 [2024-11-26 05:26:13.198366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.612 [2024-11-26 05:26:13.198382] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.612 [2024-11-26 05:26:13.200701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.612 [2024-11-26 05:26:13.210016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.612 [2024-11-26 05:26:13.210357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.210502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.210533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.612 [2024-11-26 05:26:13.210551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.612 [2024-11-26 05:26:13.210754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.612 [2024-11-26 05:26:13.210981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.612 [2024-11-26 05:26:13.211006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.612 [2024-11-26 05:26:13.211022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.612 [2024-11-26 05:26:13.213385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.612 [2024-11-26 05:26:13.222516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.612 [2024-11-26 05:26:13.222864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.223007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.223041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.612 [2024-11-26 05:26:13.223082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.612 [2024-11-26 05:26:13.223268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.612 [2024-11-26 05:26:13.223439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.612 [2024-11-26 05:26:13.223464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.612 [2024-11-26 05:26:13.223480] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.612 [2024-11-26 05:26:13.225785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.612 [2024-11-26 05:26:13.235084] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.612 [2024-11-26 05:26:13.235484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.235656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.235693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.612 [2024-11-26 05:26:13.235729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.612 [2024-11-26 05:26:13.235911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.612 [2024-11-26 05:26:13.236058] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.612 [2024-11-26 05:26:13.236082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.612 [2024-11-26 05:26:13.236099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.612 [2024-11-26 05:26:13.238528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.612 [2024-11-26 05:26:13.247804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.612 [2024-11-26 05:26:13.248185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.248318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.248343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.612 [2024-11-26 05:26:13.248359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.612 [2024-11-26 05:26:13.248559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.612 [2024-11-26 05:26:13.248773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.612 [2024-11-26 05:26:13.248796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.612 [2024-11-26 05:26:13.248811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.612 [2024-11-26 05:26:13.251236] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.612 [2024-11-26 05:26:13.260500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.612 [2024-11-26 05:26:13.260839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.260948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.260974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.612 [2024-11-26 05:26:13.260991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.612 [2024-11-26 05:26:13.261216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.612 [2024-11-26 05:26:13.261370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.612 [2024-11-26 05:26:13.261395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.612 [2024-11-26 05:26:13.261410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.612 [2024-11-26 05:26:13.263677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.612 [2024-11-26 05:26:13.273196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.612 [2024-11-26 05:26:13.273553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.273703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.273747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.612 [2024-11-26 05:26:13.273764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.612 [2024-11-26 05:26:13.273865] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.612 [2024-11-26 05:26:13.274104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.612 [2024-11-26 05:26:13.274129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.612 [2024-11-26 05:26:13.274145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.612 [2024-11-26 05:26:13.276377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.612 [2024-11-26 05:26:13.285854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.612 [2024-11-26 05:26:13.286139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.286282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.612 [2024-11-26 05:26:13.286309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.612 [2024-11-26 05:26:13.286325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.612 [2024-11-26 05:26:13.286522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.612 [2024-11-26 05:26:13.286621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.612 [2024-11-26 05:26:13.286645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.613 [2024-11-26 05:26:13.286661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.613 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3424908 Killed "${NVMF_APP[@]}" "$@" 00:30:11.613 05:26:13 -- host/bdevperf.sh@36 -- # tgt_init 00:30:11.613 05:26:13 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:11.613 05:26:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:11.613 05:26:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:11.613 05:26:13 -- common/autotest_common.sh@10 -- # set +x 00:30:11.613 [2024-11-26 05:26:13.288968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.613 05:26:13 -- nvmf/common.sh@469 -- # nvmfpid=3425967 00:30:11.613 05:26:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:11.613 05:26:13 -- nvmf/common.sh@470 -- # waitforlisten 3425967 00:30:11.613 05:26:13 -- common/autotest_common.sh@829 -- # '[' -z 3425967 ']' 00:30:11.613 05:26:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:11.613 05:26:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:11.613 05:26:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:11.613 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:11.613 05:26:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:11.613 05:26:13 -- common/autotest_common.sh@10 -- # set +x 00:30:11.613 [2024-11-26 05:26:13.298417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.613 [2024-11-26 05:26:13.298754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.298866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.298895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.613 [2024-11-26 05:26:13.298911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.613 [2024-11-26 05:26:13.299088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.613 [2024-11-26 05:26:13.299259] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.613 [2024-11-26 05:26:13.299284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.613 [2024-11-26 05:26:13.299301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.613 [2024-11-26 05:26:13.301720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.613 [2024-11-26 05:26:13.310915] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.613 [2024-11-26 05:26:13.311251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.311394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.311420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.613 [2024-11-26 05:26:13.311437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.613 [2024-11-26 05:26:13.311587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.613 [2024-11-26 05:26:13.311796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.613 [2024-11-26 05:26:13.311820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.613 [2024-11-26 05:26:13.311835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.613 [2024-11-26 05:26:13.313941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.613 [2024-11-26 05:26:13.323272] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.613 [2024-11-26 05:26:13.323576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.324351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.324383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.613 [2024-11-26 05:26:13.324417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.613 [2024-11-26 05:26:13.324586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.613 [2024-11-26 05:26:13.324734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.613 [2024-11-26 05:26:13.324764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.613 [2024-11-26 05:26:13.324780] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.613 [2024-11-26 05:26:13.326798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.613 [2024-11-26 05:26:13.335746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.613 [2024-11-26 05:26:13.336031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.336180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.336207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.613 [2024-11-26 05:26:13.336224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.613 [2024-11-26 05:26:13.336374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.613 [2024-11-26 05:26:13.336525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.613 [2024-11-26 05:26:13.336547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.613 [2024-11-26 05:26:13.336561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.613 [2024-11-26 05:26:13.336611] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:11.613 [2024-11-26 05:26:13.336676] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:11.613 [2024-11-26 05:26:13.338770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.613 [2024-11-26 05:26:13.348236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.613 [2024-11-26 05:26:13.348604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.348768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.348795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.613 [2024-11-26 05:26:13.348812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.613 [2024-11-26 05:26:13.348946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.613 [2024-11-26 05:26:13.349140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.613 [2024-11-26 05:26:13.349161] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.613 [2024-11-26 05:26:13.349174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.613 [2024-11-26 05:26:13.351270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.613 [2024-11-26 05:26:13.360546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.613 [2024-11-26 05:26:13.360828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.360961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.360998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.613 [2024-11-26 05:26:13.361015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.613 [2024-11-26 05:26:13.361099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.613 [2024-11-26 05:26:13.361269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.613 [2024-11-26 05:26:13.361289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.613 [2024-11-26 05:26:13.361302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.613 [2024-11-26 05:26:13.363361] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.613 [2024-11-26 05:26:13.372933] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.613 [2024-11-26 05:26:13.373280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.373436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.613 [2024-11-26 05:26:13.373461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.613 [2024-11-26 05:26:13.373477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.613 [2024-11-26 05:26:13.373577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.613 [2024-11-26 05:26:13.373739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.613 [2024-11-26 05:26:13.373761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.613 [2024-11-26 05:26:13.373775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.876 EAL: No free 2048 kB hugepages reported on node 1 00:30:11.876 [2024-11-26 05:26:13.375747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.876 [2024-11-26 05:26:13.385630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.876 [2024-11-26 05:26:13.385982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.386120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.386146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.876 [2024-11-26 05:26:13.386162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.876 [2024-11-26 05:26:13.386311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.876 [2024-11-26 05:26:13.386487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.876 [2024-11-26 05:26:13.386506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.876 [2024-11-26 05:26:13.386520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.876 [2024-11-26 05:26:13.388882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.876 [2024-11-26 05:26:13.398351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.876 [2024-11-26 05:26:13.398741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.398911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.398937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.876 [2024-11-26 05:26:13.398953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.876 [2024-11-26 05:26:13.399102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.876 [2024-11-26 05:26:13.399268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.876 [2024-11-26 05:26:13.399288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.876 [2024-11-26 05:26:13.399300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.876 [2024-11-26 05:26:13.401600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.876 [2024-11-26 05:26:13.408681] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:11.876 [2024-11-26 05:26:13.410762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.876 [2024-11-26 05:26:13.411110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.411275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.411300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.876 [2024-11-26 05:26:13.411316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.876 [2024-11-26 05:26:13.411447] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.876 [2024-11-26 05:26:13.411577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.876 [2024-11-26 05:26:13.411596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.876 [2024-11-26 05:26:13.411609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.876 [2024-11-26 05:26:13.413935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.876 [2024-11-26 05:26:13.423067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.876 [2024-11-26 05:26:13.423606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.423773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.423803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.876 [2024-11-26 05:26:13.423824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.876 [2024-11-26 05:26:13.424001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.876 [2024-11-26 05:26:13.424162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.876 [2024-11-26 05:26:13.424183] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.876 [2024-11-26 05:26:13.424199] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.876 [2024-11-26 05:26:13.426304] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.876 [2024-11-26 05:26:13.435239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.876 [2024-11-26 05:26:13.435540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.435722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.435748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.876 [2024-11-26 05:26:13.435764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.876 [2024-11-26 05:26:13.435947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.876 [2024-11-26 05:26:13.436158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.876 [2024-11-26 05:26:13.436187] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.876 [2024-11-26 05:26:13.436201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.876 [2024-11-26 05:26:13.438289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.876 [2024-11-26 05:26:13.447400] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.876 [2024-11-26 05:26:13.447699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.447877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.447903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.876 [2024-11-26 05:26:13.447920] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.876 [2024-11-26 05:26:13.448103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.876 [2024-11-26 05:26:13.448250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.876 [2024-11-26 05:26:13.448270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.876 [2024-11-26 05:26:13.448284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.876 [2024-11-26 05:26:13.450387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.876 [2024-11-26 05:26:13.460121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.876 [2024-11-26 05:26:13.460622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.460796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.460823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.876 [2024-11-26 05:26:13.460844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.876 [2024-11-26 05:26:13.460985] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.876 [2024-11-26 05:26:13.461179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.876 [2024-11-26 05:26:13.461204] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.876 [2024-11-26 05:26:13.461222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.876 [2024-11-26 05:26:13.463569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.876 [2024-11-26 05:26:13.472864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.876 [2024-11-26 05:26:13.473257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.473392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.876 [2024-11-26 05:26:13.473417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.876 [2024-11-26 05:26:13.473436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.876 [2024-11-26 05:26:13.473570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.876 [2024-11-26 05:26:13.473810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.876 [2024-11-26 05:26:13.473832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.876 [2024-11-26 05:26:13.473858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.877 [2024-11-26 05:26:13.476115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.877 [2024-11-26 05:26:13.485570] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.877 [2024-11-26 05:26:13.485992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.486148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.486176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.877 [2024-11-26 05:26:13.486194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.877 [2024-11-26 05:26:13.486361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.877 [2024-11-26 05:26:13.486550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.877 [2024-11-26 05:26:13.486574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.877 [2024-11-26 05:26:13.486590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.877 [2024-11-26 05:26:13.488941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.877 [2024-11-26 05:26:13.498164] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:11.877 [2024-11-26 05:26:13.498227] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.877 [2024-11-26 05:26:13.498291] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:11.877 [2024-11-26 05:26:13.498309] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:11.877 [2024-11-26 05:26:13.498321] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:11.877 [2024-11-26 05:26:13.498383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:11.877 [2024-11-26 05:26:13.498486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.498464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:11.877 [2024-11-26 05:26:13.498467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:11.877 [2024-11-26 05:26:13.498683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.498717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.877 [2024-11-26 05:26:13.498733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.877 [2024-11-26 05:26:13.498866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.877 [2024-11-26 05:26:13.499035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.877 [2024-11-26 05:26:13.499056] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.877 [2024-11-26 05:26:13.499071] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.877 [2024-11-26 05:26:13.501254] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.877 [2024-11-26 05:26:13.510496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.877 [2024-11-26 05:26:13.510994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.511147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.511173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.877 [2024-11-26 05:26:13.511207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.877 [2024-11-26 05:26:13.511351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.877 [2024-11-26 05:26:13.511538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.877 [2024-11-26 05:26:13.511560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.877 [2024-11-26 05:26:13.511577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.877 [2024-11-26 05:26:13.513606] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.877 [2024-11-26 05:26:13.522655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.877 [2024-11-26 05:26:13.523091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.523244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.523270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.877 [2024-11-26 05:26:13.523290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.877 [2024-11-26 05:26:13.523467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.877 [2024-11-26 05:26:13.523621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.877 [2024-11-26 05:26:13.523642] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.877 [2024-11-26 05:26:13.523660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.877 [2024-11-26 05:26:13.525848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.877 [2024-11-26 05:26:13.534957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.877 [2024-11-26 05:26:13.535468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.535598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.535624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.877 [2024-11-26 05:26:13.535644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.877 [2024-11-26 05:26:13.535843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.877 [2024-11-26 05:26:13.536019] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.877 [2024-11-26 05:26:13.536041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.877 [2024-11-26 05:26:13.536058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.877 [2024-11-26 05:26:13.538355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.877 [2024-11-26 05:26:13.547145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.877 [2024-11-26 05:26:13.547591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.547770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.547799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.877 [2024-11-26 05:26:13.547819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.877 [2024-11-26 05:26:13.547991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.877 [2024-11-26 05:26:13.548145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.877 [2024-11-26 05:26:13.548166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.877 [2024-11-26 05:26:13.548183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.877 [2024-11-26 05:26:13.550272] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.877 [2024-11-26 05:26:13.559309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.877 [2024-11-26 05:26:13.559760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.559908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.559934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.877 [2024-11-26 05:26:13.559952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.877 [2024-11-26 05:26:13.560150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.877 [2024-11-26 05:26:13.560271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.877 [2024-11-26 05:26:13.560293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.877 [2024-11-26 05:26:13.560309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.877 [2024-11-26 05:26:13.562383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.877 [2024-11-26 05:26:13.571691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.877 [2024-11-26 05:26:13.572179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.572377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.572403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.877 [2024-11-26 05:26:13.572425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.877 [2024-11-26 05:26:13.572633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.877 [2024-11-26 05:26:13.572832] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.877 [2024-11-26 05:26:13.572856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.877 [2024-11-26 05:26:13.572874] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.877 [2024-11-26 05:26:13.575097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.877 [2024-11-26 05:26:13.584076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.877 [2024-11-26 05:26:13.584295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.584440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.877 [2024-11-26 05:26:13.584466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.877 [2024-11-26 05:26:13.584482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.877 [2024-11-26 05:26:13.584617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.877 [2024-11-26 05:26:13.584809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.878 [2024-11-26 05:26:13.584832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.878 [2024-11-26 05:26:13.584846] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.878 [2024-11-26 05:26:13.586905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.878 [2024-11-26 05:26:13.596309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.878 [2024-11-26 05:26:13.596681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.878 [2024-11-26 05:26:13.596828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.878 [2024-11-26 05:26:13.596853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.878 [2024-11-26 05:26:13.596869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.878 [2024-11-26 05:26:13.596969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.878 [2024-11-26 05:26:13.597121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.878 [2024-11-26 05:26:13.597142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.878 [2024-11-26 05:26:13.597155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.878 [2024-11-26 05:26:13.599306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.878 [2024-11-26 05:26:13.608551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.878 [2024-11-26 05:26:13.608825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.878 [2024-11-26 05:26:13.608931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.878 [2024-11-26 05:26:13.608956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.878 [2024-11-26 05:26:13.608972] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.878 [2024-11-26 05:26:13.609104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.878 [2024-11-26 05:26:13.609271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.878 [2024-11-26 05:26:13.609293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.878 [2024-11-26 05:26:13.609306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.878 [2024-11-26 05:26:13.611499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.878 [2024-11-26 05:26:13.620634] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.878 [2024-11-26 05:26:13.620916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.878 [2024-11-26 05:26:13.621041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.878 [2024-11-26 05:26:13.621067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.878 [2024-11-26 05:26:13.621083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.878 [2024-11-26 05:26:13.621232] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.878 [2024-11-26 05:26:13.621399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.878 [2024-11-26 05:26:13.621425] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.878 [2024-11-26 05:26:13.621439] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.878 [2024-11-26 05:26:13.623374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:11.878 [2024-11-26 05:26:13.633037] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:11.878 [2024-11-26 05:26:13.633314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.878 [2024-11-26 05:26:13.633450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.878 [2024-11-26 05:26:13.633475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:11.878 [2024-11-26 05:26:13.633491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:11.878 [2024-11-26 05:26:13.633639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:11.878 [2024-11-26 05:26:13.633834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:11.878 [2024-11-26 05:26:13.633856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:11.878 [2024-11-26 05:26:13.633870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:11.878 [2024-11-26 05:26:13.635763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.140 [2024-11-26 05:26:13.645422] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.140 [2024-11-26 05:26:13.645765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.140 [2024-11-26 05:26:13.645901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.140 [2024-11-26 05:26:13.645927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.140 [2024-11-26 05:26:13.645942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.140 [2024-11-26 05:26:13.646092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.141 [2024-11-26 05:26:13.646227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.141 [2024-11-26 05:26:13.646248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.141 [2024-11-26 05:26:13.646261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.141 [2024-11-26 05:26:13.648300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.141 [2024-11-26 05:26:13.657750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.141 [2024-11-26 05:26:13.658039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.658159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.658184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.141 [2024-11-26 05:26:13.658200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.141 [2024-11-26 05:26:13.658364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.141 [2024-11-26 05:26:13.658498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.141 [2024-11-26 05:26:13.658518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.141 [2024-11-26 05:26:13.658537] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.141 [2024-11-26 05:26:13.660553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.141 [2024-11-26 05:26:13.670139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.141 [2024-11-26 05:26:13.670472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.670574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.670599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.141 [2024-11-26 05:26:13.670615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.141 [2024-11-26 05:26:13.670772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.141 [2024-11-26 05:26:13.670923] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.141 [2024-11-26 05:26:13.670944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.141 [2024-11-26 05:26:13.670957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.141 [2024-11-26 05:26:13.673083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.141 [2024-11-26 05:26:13.682534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.141 [2024-11-26 05:26:13.682886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.682986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.683011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.141 [2024-11-26 05:26:13.683027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.141 [2024-11-26 05:26:13.683176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.141 [2024-11-26 05:26:13.683327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.141 [2024-11-26 05:26:13.683347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.141 [2024-11-26 05:26:13.683361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.141 [2024-11-26 05:26:13.685267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.141 [2024-11-26 05:26:13.694888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.141 [2024-11-26 05:26:13.695165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.695266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.695291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.141 [2024-11-26 05:26:13.695307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.141 [2024-11-26 05:26:13.695502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.141 [2024-11-26 05:26:13.695620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.141 [2024-11-26 05:26:13.695641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.141 [2024-11-26 05:26:13.695654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.141 [2024-11-26 05:26:13.697805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.141 [2024-11-26 05:26:13.707335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.141 [2024-11-26 05:26:13.707587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.707713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.707739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.141 [2024-11-26 05:26:13.707765] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.141 [2024-11-26 05:26:13.707946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.141 [2024-11-26 05:26:13.708126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.141 [2024-11-26 05:26:13.708147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.141 [2024-11-26 05:26:13.708160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.141 [2024-11-26 05:26:13.710345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.141 [2024-11-26 05:26:13.719440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.141 [2024-11-26 05:26:13.719711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.719868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.719893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.141 [2024-11-26 05:26:13.719909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.141 [2024-11-26 05:26:13.720057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.141 [2024-11-26 05:26:13.720255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.141 [2024-11-26 05:26:13.720275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.141 [2024-11-26 05:26:13.720288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.141 [2024-11-26 05:26:13.722326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.141 [2024-11-26 05:26:13.731773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.141 [2024-11-26 05:26:13.732027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.732137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.732162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.141 [2024-11-26 05:26:13.732178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.141 [2024-11-26 05:26:13.732310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.141 [2024-11-26 05:26:13.732492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.141 [2024-11-26 05:26:13.732513] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.141 [2024-11-26 05:26:13.732526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.141 [2024-11-26 05:26:13.734535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.141 [2024-11-26 05:26:13.743926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.141 [2024-11-26 05:26:13.744244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.744347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.744373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.141 [2024-11-26 05:26:13.744388] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.141 [2024-11-26 05:26:13.744537] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.141 [2024-11-26 05:26:13.744711] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.141 [2024-11-26 05:26:13.744734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.141 [2024-11-26 05:26:13.744748] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.141 [2024-11-26 05:26:13.746886] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.141 [2024-11-26 05:26:13.756155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.141 [2024-11-26 05:26:13.756434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.756559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.141 [2024-11-26 05:26:13.756585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.141 [2024-11-26 05:26:13.756600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.141 [2024-11-26 05:26:13.756775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.141 [2024-11-26 05:26:13.756896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.141 [2024-11-26 05:26:13.756918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.142 [2024-11-26 05:26:13.756931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.142 [2024-11-26 05:26:13.759035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.142 [2024-11-26 05:26:13.768371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.142 [2024-11-26 05:26:13.768665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.768777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.768803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.142 [2024-11-26 05:26:13.768818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.142 [2024-11-26 05:26:13.768951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.142 [2024-11-26 05:26:13.769149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.142 [2024-11-26 05:26:13.769170] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.142 [2024-11-26 05:26:13.769183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.142 [2024-11-26 05:26:13.771162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.142 [2024-11-26 05:26:13.780760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.142 [2024-11-26 05:26:13.781085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.781202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.781228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.142 [2024-11-26 05:26:13.781243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.142 [2024-11-26 05:26:13.781376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.142 [2024-11-26 05:26:13.781556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.142 [2024-11-26 05:26:13.781577] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.142 [2024-11-26 05:26:13.781590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.142 [2024-11-26 05:26:13.783568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.142 [2024-11-26 05:26:13.792903] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.142 [2024-11-26 05:26:13.793199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.793321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.793347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.142 [2024-11-26 05:26:13.793362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.142 [2024-11-26 05:26:13.793494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.142 [2024-11-26 05:26:13.793661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.142 [2024-11-26 05:26:13.793681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.142 [2024-11-26 05:26:13.793720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.142 [2024-11-26 05:26:13.795826] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.142 [2024-11-26 05:26:13.805380] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.142 [2024-11-26 05:26:13.805673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.805789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.805814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.142 [2024-11-26 05:26:13.805829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.142 [2024-11-26 05:26:13.805961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.142 [2024-11-26 05:26:13.806143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.142 [2024-11-26 05:26:13.806164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.142 [2024-11-26 05:26:13.806177] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.142 [2024-11-26 05:26:13.808158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.142 [2024-11-26 05:26:13.817858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.142 [2024-11-26 05:26:13.818177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.818282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.818313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.142 [2024-11-26 05:26:13.818329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.142 [2024-11-26 05:26:13.818478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.142 [2024-11-26 05:26:13.818641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.142 [2024-11-26 05:26:13.818662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.142 [2024-11-26 05:26:13.818675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.142 [2024-11-26 05:26:13.820835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.142 [2024-11-26 05:26:13.830197] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.142 [2024-11-26 05:26:13.830488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.830625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.830651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.142 [2024-11-26 05:26:13.830667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.142 [2024-11-26 05:26:13.830808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.142 [2024-11-26 05:26:13.830961] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.142 [2024-11-26 05:26:13.830983] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.142 [2024-11-26 05:26:13.830996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.142 [2024-11-26 05:26:13.832992] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.142 [2024-11-26 05:26:13.842554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.142 [2024-11-26 05:26:13.842850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.842980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.843006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.142 [2024-11-26 05:26:13.843022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.142 [2024-11-26 05:26:13.843186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.142 [2024-11-26 05:26:13.843319] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.142 [2024-11-26 05:26:13.843341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.142 [2024-11-26 05:26:13.843354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.142 [2024-11-26 05:26:13.845531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.142 [2024-11-26 05:26:13.854874] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.142 [2024-11-26 05:26:13.855210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.855313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.855339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.142 [2024-11-26 05:26:13.855363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.142 [2024-11-26 05:26:13.855512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.142 [2024-11-26 05:26:13.855675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.142 [2024-11-26 05:26:13.855705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.142 [2024-11-26 05:26:13.855719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.142 [2024-11-26 05:26:13.857751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.142 [2024-11-26 05:26:13.867148] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.142 [2024-11-26 05:26:13.867513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.867672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.142 [2024-11-26 05:26:13.867704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.142 [2024-11-26 05:26:13.867721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.142 [2024-11-26 05:26:13.867918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.142 [2024-11-26 05:26:13.868099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.142 [2024-11-26 05:26:13.868119] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.142 [2024-11-26 05:26:13.868132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.142 [2024-11-26 05:26:13.870137] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.142 [2024-11-26 05:26:13.879324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.142 [2024-11-26 05:26:13.879600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.143 [2024-11-26 05:26:13.879727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.143 [2024-11-26 05:26:13.879763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.143 [2024-11-26 05:26:13.879779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.143 [2024-11-26 05:26:13.879993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.143 [2024-11-26 05:26:13.880142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.143 [2024-11-26 05:26:13.880162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.143 [2024-11-26 05:26:13.880175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.143 [2024-11-26 05:26:13.882411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.143 [2024-11-26 05:26:13.891604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.143 [2024-11-26 05:26:13.891910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.143 [2024-11-26 05:26:13.892018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.143 [2024-11-26 05:26:13.892043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.143 [2024-11-26 05:26:13.892059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.143 [2024-11-26 05:26:13.892213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.143 [2024-11-26 05:26:13.892378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.143 [2024-11-26 05:26:13.892399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.143 [2024-11-26 05:26:13.892412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.143 [2024-11-26 05:26:13.894562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.403 [2024-11-26 05:26:13.904161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.403 [2024-11-26 05:26:13.904522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.403 [2024-11-26 05:26:13.904655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.403 [2024-11-26 05:26:13.904680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.403 [2024-11-26 05:26:13.904707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.403 [2024-11-26 05:26:13.904856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.403 [2024-11-26 05:26:13.905055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.403 [2024-11-26 05:26:13.905076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.403 [2024-11-26 05:26:13.905089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.403 [2024-11-26 05:26:13.907178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.403 [2024-11-26 05:26:13.916486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.403 [2024-11-26 05:26:13.916771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.403 [2024-11-26 05:26:13.916875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.403 [2024-11-26 05:26:13.916900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.403 [2024-11-26 05:26:13.916916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.403 [2024-11-26 05:26:13.917048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.403 [2024-11-26 05:26:13.917245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.403 [2024-11-26 05:26:13.917266] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.403 [2024-11-26 05:26:13.917279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.403 [2024-11-26 05:26:13.919183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.403 [2024-11-26 05:26:13.928935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.403 [2024-11-26 05:26:13.929230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.403 [2024-11-26 05:26:13.929339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.403 [2024-11-26 05:26:13.929366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.403 [2024-11-26 05:26:13.929382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.403 [2024-11-26 05:26:13.929530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.403 [2024-11-26 05:26:13.929693] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.403 [2024-11-26 05:26:13.929714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.403 [2024-11-26 05:26:13.929727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.403 [2024-11-26 05:26:13.931744] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.403 [2024-11-26 05:26:13.941109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.403 [2024-11-26 05:26:13.941399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.403 [2024-11-26 05:26:13.941531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.403 [2024-11-26 05:26:13.941557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.403 [2024-11-26 05:26:13.941572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.404 [2024-11-26 05:26:13.941780] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.404 [2024-11-26 05:26:13.941976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.404 [2024-11-26 05:26:13.941997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.404 [2024-11-26 05:26:13.942010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.404 [2024-11-26 05:26:13.944125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.404 [2024-11-26 05:26:13.953372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.404 [2024-11-26 05:26:13.953673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:13.953773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:13.953798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.404 [2024-11-26 05:26:13.953814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.404 [2024-11-26 05:26:13.953979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.404 [2024-11-26 05:26:13.954159] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.404 [2024-11-26 05:26:13.954180] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.404 [2024-11-26 05:26:13.954192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.404 [2024-11-26 05:26:13.956204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.404 [2024-11-26 05:26:13.965821] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.404 [2024-11-26 05:26:13.966090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:13.966222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:13.966247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.404 [2024-11-26 05:26:13.966263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.404 [2024-11-26 05:26:13.966396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.404 [2024-11-26 05:26:13.966562] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.404 [2024-11-26 05:26:13.966588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.404 [2024-11-26 05:26:13.966602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.404 [2024-11-26 05:26:13.968633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.404 [2024-11-26 05:26:13.978207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.404 [2024-11-26 05:26:13.978516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:13.978663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:13.978696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.404 [2024-11-26 05:26:13.978714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.404 [2024-11-26 05:26:13.978863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.404 [2024-11-26 05:26:13.979030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.404 [2024-11-26 05:26:13.979050] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.404 [2024-11-26 05:26:13.979063] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.404 [2024-11-26 05:26:13.981270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.404 [2024-11-26 05:26:13.990467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.404 [2024-11-26 05:26:13.990755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:13.990869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:13.990894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.404 [2024-11-26 05:26:13.990910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.404 [2024-11-26 05:26:13.991059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.404 [2024-11-26 05:26:13.991223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.404 [2024-11-26 05:26:13.991244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.404 [2024-11-26 05:26:13.991257] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.404 [2024-11-26 05:26:13.993339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.404 [2024-11-26 05:26:14.002948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.404 [2024-11-26 05:26:14.003251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:14.003378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:14.003404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.404 [2024-11-26 05:26:14.003420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.404 [2024-11-26 05:26:14.003584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.404 [2024-11-26 05:26:14.003776] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.404 [2024-11-26 05:26:14.003797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.404 [2024-11-26 05:26:14.003815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.404 [2024-11-26 05:26:14.005759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.404 [2024-11-26 05:26:14.015249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.404 [2024-11-26 05:26:14.015576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:14.015734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:14.015761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.404 [2024-11-26 05:26:14.015777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.404 [2024-11-26 05:26:14.015942] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.404 [2024-11-26 05:26:14.016092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.404 [2024-11-26 05:26:14.016112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.404 [2024-11-26 05:26:14.016125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.404 [2024-11-26 05:26:14.018175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.404 [2024-11-26 05:26:14.027511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.404 [2024-11-26 05:26:14.027807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:14.027918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:14.027945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.404 [2024-11-26 05:26:14.027961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.404 [2024-11-26 05:26:14.028126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.404 [2024-11-26 05:26:14.028322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.404 [2024-11-26 05:26:14.028342] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.404 [2024-11-26 05:26:14.028355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.404 [2024-11-26 05:26:14.030432] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.404 [2024-11-26 05:26:14.039827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.404 [2024-11-26 05:26:14.040085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:14.040186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:14.040212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.404 [2024-11-26 05:26:14.040228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.404 [2024-11-26 05:26:14.040360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.404 [2024-11-26 05:26:14.040512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.404 [2024-11-26 05:26:14.040532] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.404 [2024-11-26 05:26:14.040545] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.404 [2024-11-26 05:26:14.042646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.404 [2024-11-26 05:26:14.052179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.404 [2024-11-26 05:26:14.052488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:14.052614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.404 [2024-11-26 05:26:14.052640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.404 [2024-11-26 05:26:14.052655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.404 [2024-11-26 05:26:14.052814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.404 [2024-11-26 05:26:14.052998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.405 [2024-11-26 05:26:14.053019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.405 [2024-11-26 05:26:14.053032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.405 [2024-11-26 05:26:14.055118] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.405 [2024-11-26 05:26:14.064526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.405 [2024-11-26 05:26:14.064836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.064966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.064992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.405 [2024-11-26 05:26:14.065008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.405 [2024-11-26 05:26:14.065189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.405 [2024-11-26 05:26:14.065323] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.405 [2024-11-26 05:26:14.065344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.405 [2024-11-26 05:26:14.065358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.405 [2024-11-26 05:26:14.067493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.405 [2024-11-26 05:26:14.076858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.405 [2024-11-26 05:26:14.077112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.077218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.077244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.405 [2024-11-26 05:26:14.077260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.405 [2024-11-26 05:26:14.077375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.405 [2024-11-26 05:26:14.077540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.405 [2024-11-26 05:26:14.077561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.405 [2024-11-26 05:26:14.077575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.405 [2024-11-26 05:26:14.079804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.405 [2024-11-26 05:26:14.089171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.405 [2024-11-26 05:26:14.089463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.089593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.089619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.405 [2024-11-26 05:26:14.089635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.405 [2024-11-26 05:26:14.089825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.405 [2024-11-26 05:26:14.089980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.405 [2024-11-26 05:26:14.090001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.405 [2024-11-26 05:26:14.090016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.405 [2024-11-26 05:26:14.092128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.405 [2024-11-26 05:26:14.101804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.405 [2024-11-26 05:26:14.102117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.102259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.102285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.405 [2024-11-26 05:26:14.102300] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.405 [2024-11-26 05:26:14.102449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.405 [2024-11-26 05:26:14.102663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.405 [2024-11-26 05:26:14.102692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.405 [2024-11-26 05:26:14.102707] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.405 [2024-11-26 05:26:14.104876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.405 [2024-11-26 05:26:14.114135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.405 [2024-11-26 05:26:14.114434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.114543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.114569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.405 [2024-11-26 05:26:14.114584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.405 [2024-11-26 05:26:14.114777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.405 [2024-11-26 05:26:14.114914] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.405 [2024-11-26 05:26:14.114936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.405 [2024-11-26 05:26:14.114950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.405 [2024-11-26 05:26:14.117098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.405 [2024-11-26 05:26:14.126560] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.405 [2024-11-26 05:26:14.126847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.126952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.126978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.405 [2024-11-26 05:26:14.126993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.405 [2024-11-26 05:26:14.127142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.405 [2024-11-26 05:26:14.127275] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.405 [2024-11-26 05:26:14.127296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.405 [2024-11-26 05:26:14.127310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.405 [2024-11-26 05:26:14.129357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.405 [2024-11-26 05:26:14.138866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.405 [2024-11-26 05:26:14.139179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.139303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.139328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.405 [2024-11-26 05:26:14.139344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.405 [2024-11-26 05:26:14.139492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.405 [2024-11-26 05:26:14.139627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.405 [2024-11-26 05:26:14.139648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.405 [2024-11-26 05:26:14.139662] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.405 [2024-11-26 05:26:14.141783] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.405 [2024-11-26 05:26:14.151301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.405 [2024-11-26 05:26:14.151607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.151712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.151739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.405 [2024-11-26 05:26:14.151755] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.405 [2024-11-26 05:26:14.151920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.405 [2024-11-26 05:26:14.152101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.405 [2024-11-26 05:26:14.152123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.405 [2024-11-26 05:26:14.152136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.405 [2024-11-26 05:26:14.154180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.405 [2024-11-26 05:26:14.163720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.405 [2024-11-26 05:26:14.164024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.164158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.405 [2024-11-26 05:26:14.164184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.405 [2024-11-26 05:26:14.164205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.405 [2024-11-26 05:26:14.164322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.405 [2024-11-26 05:26:14.164489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.405 [2024-11-26 05:26:14.164510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.405 [2024-11-26 05:26:14.164523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.666 [2024-11-26 05:26:14.166615] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.666 [2024-11-26 05:26:14.176085] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.666 [2024-11-26 05:26:14.176374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.176530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.176556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.666 [2024-11-26 05:26:14.176573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.666 [2024-11-26 05:26:14.176697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.666 [2024-11-26 05:26:14.176850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.666 [2024-11-26 05:26:14.176871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.666 [2024-11-26 05:26:14.176884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.666 [2024-11-26 05:26:14.178902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.666 [2024-11-26 05:26:14.188442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.666 [2024-11-26 05:26:14.188721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.188846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.188872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.666 [2024-11-26 05:26:14.188888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.666 [2024-11-26 05:26:14.189069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.666 [2024-11-26 05:26:14.189219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.666 [2024-11-26 05:26:14.189240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.666 [2024-11-26 05:26:14.189252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.666 [2024-11-26 05:26:14.191333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.666 [2024-11-26 05:26:14.200775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.666 [2024-11-26 05:26:14.201085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.201215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.201241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.666 [2024-11-26 05:26:14.201257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.666 [2024-11-26 05:26:14.201429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.666 [2024-11-26 05:26:14.201564] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.666 [2024-11-26 05:26:14.201585] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.666 [2024-11-26 05:26:14.201598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.666 [2024-11-26 05:26:14.203627] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.666 [2024-11-26 05:26:14.213203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.666 [2024-11-26 05:26:14.213422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.213514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.213540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.666 [2024-11-26 05:26:14.213555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.666 [2024-11-26 05:26:14.213746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.666 [2024-11-26 05:26:14.213867] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.666 [2024-11-26 05:26:14.213888] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.666 [2024-11-26 05:26:14.213902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.666 [2024-11-26 05:26:14.216009] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.666 [2024-11-26 05:26:14.225574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.666 [2024-11-26 05:26:14.225865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.225977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.226003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.666 [2024-11-26 05:26:14.226018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.666 [2024-11-26 05:26:14.226216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.666 [2024-11-26 05:26:14.226381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.666 [2024-11-26 05:26:14.226401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.666 [2024-11-26 05:26:14.226414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.666 [2024-11-26 05:26:14.228459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.666 [2024-11-26 05:26:14.237921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.666 [2024-11-26 05:26:14.238194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.238324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.238349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.666 [2024-11-26 05:26:14.238365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.666 [2024-11-26 05:26:14.238482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.666 [2024-11-26 05:26:14.238638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.666 [2024-11-26 05:26:14.238660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.666 [2024-11-26 05:26:14.238674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.666 [2024-11-26 05:26:14.240641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.666 [2024-11-26 05:26:14.250284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.666 [2024-11-26 05:26:14.250552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.250647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.250673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.666 [2024-11-26 05:26:14.250698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.666 [2024-11-26 05:26:14.250864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.666 [2024-11-26 05:26:14.251018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.666 [2024-11-26 05:26:14.251038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.666 [2024-11-26 05:26:14.251051] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.666 [2024-11-26 05:26:14.253177] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.666 [2024-11-26 05:26:14.262743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.666 [2024-11-26 05:26:14.263061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.263190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.666 [2024-11-26 05:26:14.263216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.666 [2024-11-26 05:26:14.263233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.666 [2024-11-26 05:26:14.263382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.666 [2024-11-26 05:26:14.263532] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.666 [2024-11-26 05:26:14.263553] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.667 [2024-11-26 05:26:14.263567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.667 [2024-11-26 05:26:14.265740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.667 [2024-11-26 05:26:14.274905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.667 [2024-11-26 05:26:14.275221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.275327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.275353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.667 [2024-11-26 05:26:14.275369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.667 [2024-11-26 05:26:14.275501] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.667 [2024-11-26 05:26:14.275637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.667 [2024-11-26 05:26:14.275662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.667 [2024-11-26 05:26:14.275677] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.667 [2024-11-26 05:26:14.277843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.667 [2024-11-26 05:26:14.287269] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.667 [2024-11-26 05:26:14.287568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.287659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.287693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.667 [2024-11-26 05:26:14.287710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.667 [2024-11-26 05:26:14.287859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.667 [2024-11-26 05:26:14.288058] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.667 [2024-11-26 05:26:14.288079] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.667 [2024-11-26 05:26:14.288092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.667 [2024-11-26 05:26:14.290264] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.667 [2024-11-26 05:26:14.299698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.667 [2024-11-26 05:26:14.299979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.300078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.300104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.667 [2024-11-26 05:26:14.300119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.667 [2024-11-26 05:26:14.300235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.667 [2024-11-26 05:26:14.300386] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.667 [2024-11-26 05:26:14.300407] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.667 [2024-11-26 05:26:14.300421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.667 [2024-11-26 05:26:14.302438] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.667 [2024-11-26 05:26:14.312246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.667 [2024-11-26 05:26:14.312528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.312634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.312658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.667 [2024-11-26 05:26:14.312673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.667 [2024-11-26 05:26:14.312829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.667 [2024-11-26 05:26:14.313046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.667 [2024-11-26 05:26:14.313067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.667 [2024-11-26 05:26:14.313087] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.667 [2024-11-26 05:26:14.315073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.667 [2024-11-26 05:26:14.324477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.667 [2024-11-26 05:26:14.324775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.324898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.324923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.667 [2024-11-26 05:26:14.324939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.667 [2024-11-26 05:26:14.325087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.667 [2024-11-26 05:26:14.325254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.667 [2024-11-26 05:26:14.325275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.667 [2024-11-26 05:26:14.325288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.667 [2024-11-26 05:26:14.327301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.667 [2024-11-26 05:26:14.336823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.667 [2024-11-26 05:26:14.337035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.337141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.337168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.667 [2024-11-26 05:26:14.337183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.667 [2024-11-26 05:26:14.337347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.667 [2024-11-26 05:26:14.337468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.667 [2024-11-26 05:26:14.337489] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.667 [2024-11-26 05:26:14.337503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.667 [2024-11-26 05:26:14.339495] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.667 [2024-11-26 05:26:14.349050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.667 [2024-11-26 05:26:14.349322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.349423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.349449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.667 [2024-11-26 05:26:14.349464] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.667 [2024-11-26 05:26:14.349628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.667 [2024-11-26 05:26:14.349790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.667 [2024-11-26 05:26:14.349812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.667 [2024-11-26 05:26:14.349826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.667 [2024-11-26 05:26:14.351967] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.667 05:26:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:12.667 05:26:14 -- common/autotest_common.sh@862 -- # return 0 00:30:12.667 05:26:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:12.667 05:26:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:12.667 05:26:14 -- common/autotest_common.sh@10 -- # set +x 00:30:12.667 [2024-11-26 05:26:14.361244] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.667 [2024-11-26 05:26:14.361554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.361661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.361695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.667 [2024-11-26 05:26:14.361713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.667 [2024-11-26 05:26:14.361846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.667 [2024-11-26 05:26:14.362030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.667 [2024-11-26 05:26:14.362051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.667 [2024-11-26 05:26:14.362064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.667 [2024-11-26 05:26:14.364229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.667 [2024-11-26 05:26:14.373482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.667 [2024-11-26 05:26:14.373809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.373939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.667 [2024-11-26 05:26:14.373965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.667 [2024-11-26 05:26:14.373981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.667 [2024-11-26 05:26:14.374131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.667 [2024-11-26 05:26:14.374266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.667 [2024-11-26 05:26:14.374287] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.667 [2024-11-26 05:26:14.374300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.668 05:26:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:12.668 05:26:14 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:12.668 05:26:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.668 [2024-11-26 05:26:14.376378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.668 05:26:14 -- common/autotest_common.sh@10 -- # set +x 00:30:12.668 [2024-11-26 05:26:14.380097] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:12.668 05:26:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.668 05:26:14 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:12.668 05:26:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.668 [2024-11-26 05:26:14.386228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.668 05:26:14 -- common/autotest_common.sh@10 -- # set +x 00:30:12.668 [2024-11-26 05:26:14.386488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.668 [2024-11-26 05:26:14.386599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.668 [2024-11-26 05:26:14.386630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.668 [2024-11-26 05:26:14.386646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.668 [2024-11-26 05:26:14.386820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.668 [2024-11-26 05:26:14.386942] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.668 [2024-11-26 05:26:14.386964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.668 [2024-11-26 05:26:14.386978] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.668 [2024-11-26 05:26:14.389175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.668 [2024-11-26 05:26:14.398572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.668 [2024-11-26 05:26:14.398900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.668 [2024-11-26 05:26:14.399042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.668 [2024-11-26 05:26:14.399068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.668 [2024-11-26 05:26:14.399084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.668 [2024-11-26 05:26:14.399200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.668 [2024-11-26 05:26:14.399379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.668 [2024-11-26 05:26:14.399399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.668 [2024-11-26 05:26:14.399411] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.668 [2024-11-26 05:26:14.401455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.668 [2024-11-26 05:26:14.410877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.668 [2024-11-26 05:26:14.411138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.668 [2024-11-26 05:26:14.411275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.668 [2024-11-26 05:26:14.411305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.668 [2024-11-26 05:26:14.411321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.668 [2024-11-26 05:26:14.411486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.668 [2024-11-26 05:26:14.411639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.668 [2024-11-26 05:26:14.411660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.668 [2024-11-26 05:26:14.411674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.668 [2024-11-26 05:26:14.413790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.668 [2024-11-26 05:26:14.423284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.668 [2024-11-26 05:26:14.423833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.668 [2024-11-26 05:26:14.423991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.668 [2024-11-26 05:26:14.424017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.668 [2024-11-26 05:26:14.424064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.668 [2024-11-26 05:26:14.424192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.668 [2024-11-26 05:26:14.424319] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.668 [2024-11-26 05:26:14.424340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.668 [2024-11-26 05:26:14.424368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.668 [2024-11-26 05:26:14.426633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.927 Malloc0 00:30:12.927 05:26:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.927 05:26:14 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:12.927 05:26:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.927 05:26:14 -- common/autotest_common.sh@10 -- # set +x 00:30:12.927 [2024-11-26 05:26:14.435988] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.927 [2024-11-26 05:26:14.436290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.927 [2024-11-26 05:26:14.436449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.927 [2024-11-26 05:26:14.436475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.927 [2024-11-26 05:26:14.436491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.927 [2024-11-26 05:26:14.436672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.927 [2024-11-26 05:26:14.436859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.927 [2024-11-26 05:26:14.436881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.927 [2024-11-26 05:26:14.436895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.927 05:26:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.927 05:26:14 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:12.927 05:26:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.927 05:26:14 -- common/autotest_common.sh@10 -- # set +x 00:30:12.927 [2024-11-26 05:26:14.439208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.927 05:26:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.927 05:26:14 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:12.927 05:26:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.927 05:26:14 -- common/autotest_common.sh@10 -- # set +x 00:30:12.927 [2024-11-26 05:26:14.448531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.927 [2024-11-26 05:26:14.448890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.927 [2024-11-26 05:26:14.449026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.927 [2024-11-26 05:26:14.449059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x680870 with addr=10.0.0.2, port=4420 00:30:12.927 [2024-11-26 05:26:14.449076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x680870 is same with the state(5) to be set 00:30:12.928 [2024-11-26 05:26:14.449240] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x680870 (9): Bad file descriptor 00:30:12.928 [2024-11-26 05:26:14.449373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:12.928 [2024-11-26 05:26:14.449394] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:12.928 [2024-11-26 05:26:14.449413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:12.928 [2024-11-26 05:26:14.450478] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:12.928 [2024-11-26 05:26:14.451551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:12.928 05:26:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.928 05:26:14 -- host/bdevperf.sh@38 -- # wait 3425216 00:30:12.928 [2024-11-26 05:26:14.460759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:12.928 [2024-11-26 05:26:14.496111] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:21.047 00:30:21.047 Latency(us) 00:30:21.047 [2024-11-26T04:26:22.815Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:21.047 [2024-11-26T04:26:22.815Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:21.047 Verification LBA range: start 0x0 length 0x4000 00:30:21.047 Nvme1n1 : 15.01 9298.42 36.32 15989.97 0.00 5046.85 649.29 21359.88 00:30:21.047 [2024-11-26T04:26:22.815Z] =================================================================================================================== 00:30:21.047 [2024-11-26T04:26:22.815Z] Total : 9298.42 36.32 15989.97 0.00 5046.85 649.29 21359.88 00:30:21.308 05:26:22 -- host/bdevperf.sh@39 -- # sync 00:30:21.308 05:26:22 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:21.308 05:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:21.308 05:26:22 -- common/autotest_common.sh@10 -- # set +x 00:30:21.308 05:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:21.308 05:26:22 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:21.308 05:26:22 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:21.308 05:26:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:21.308 05:26:22 -- nvmf/common.sh@116 -- # sync 00:30:21.308 05:26:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:21.308 05:26:22 -- nvmf/common.sh@119 -- # set +e 00:30:21.308 05:26:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:21.308 05:26:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:21.308 rmmod nvme_tcp 00:30:21.308 rmmod nvme_fabrics 00:30:21.308 rmmod nvme_keyring 00:30:21.308 05:26:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:21.308 05:26:22 -- nvmf/common.sh@123 -- # set -e 00:30:21.308 05:26:22 -- nvmf/common.sh@124 -- # return 0 00:30:21.308 05:26:22 -- nvmf/common.sh@477 -- # '[' -n 3425967 ']' 00:30:21.308 05:26:22 -- nvmf/common.sh@478 -- # killprocess 3425967 00:30:21.308 05:26:22 -- common/autotest_common.sh@936 -- # '[' -z 3425967 ']' 00:30:21.308 05:26:22 -- common/autotest_common.sh@940 -- # kill -0 3425967 00:30:21.308 05:26:22 -- common/autotest_common.sh@941 -- # uname 00:30:21.308 05:26:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:21.308 05:26:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3425967 00:30:21.308 05:26:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:21.308 05:26:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:21.308 05:26:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3425967' 00:30:21.308 killing process with pid 3425967 00:30:21.308 05:26:23 -- common/autotest_common.sh@955 -- # kill 3425967 00:30:21.308 05:26:23 -- common/autotest_common.sh@960 -- # wait 3425967 00:30:21.568 05:26:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:21.568 05:26:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:21.568 05:26:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:21.568 05:26:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:21.568 05:26:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:21.568 05:26:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:21.568 05:26:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:21.568 05:26:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:24.113 05:26:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:24.113 00:30:24.113 real 0m23.236s 00:30:24.113 user 1m0.848s 00:30:24.113 sys 0m5.088s 00:30:24.113 05:26:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:24.113 05:26:25 -- common/autotest_common.sh@10 -- # set +x 00:30:24.113 ************************************ 00:30:24.113 END TEST nvmf_bdevperf 00:30:24.113 ************************************ 00:30:24.113 05:26:25 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:24.113 05:26:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:24.113 05:26:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:24.113 05:26:25 -- common/autotest_common.sh@10 -- # set +x 00:30:24.113 ************************************ 00:30:24.113 START TEST nvmf_target_disconnect 00:30:24.113 ************************************ 00:30:24.113 05:26:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:24.113 * Looking for test storage... 00:30:24.113 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:24.113 05:26:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:24.113 05:26:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:24.113 05:26:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:24.113 05:26:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:24.113 05:26:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:24.113 05:26:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:24.113 05:26:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:24.113 05:26:25 -- scripts/common.sh@335 -- # IFS=.-: 00:30:24.113 05:26:25 -- scripts/common.sh@335 -- # read -ra ver1 00:30:24.113 05:26:25 -- scripts/common.sh@336 -- # IFS=.-: 00:30:24.113 05:26:25 -- scripts/common.sh@336 -- # read -ra ver2 00:30:24.113 05:26:25 -- scripts/common.sh@337 -- # local 'op=<' 00:30:24.113 05:26:25 -- scripts/common.sh@339 -- # ver1_l=2 00:30:24.113 05:26:25 -- scripts/common.sh@340 -- # ver2_l=1 00:30:24.113 05:26:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:24.113 05:26:25 -- scripts/common.sh@343 -- # case "$op" in 00:30:24.113 05:26:25 -- scripts/common.sh@344 -- # : 1 00:30:24.113 05:26:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:24.113 05:26:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:24.113 05:26:25 -- scripts/common.sh@364 -- # decimal 1 00:30:24.113 05:26:25 -- scripts/common.sh@352 -- # local d=1 00:30:24.113 05:26:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:24.113 05:26:25 -- scripts/common.sh@354 -- # echo 1 00:30:24.113 05:26:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:24.113 05:26:25 -- scripts/common.sh@365 -- # decimal 2 00:30:24.113 05:26:25 -- scripts/common.sh@352 -- # local d=2 00:30:24.113 05:26:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:24.113 05:26:25 -- scripts/common.sh@354 -- # echo 2 00:30:24.113 05:26:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:24.113 05:26:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:24.113 05:26:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:24.113 05:26:25 -- scripts/common.sh@367 -- # return 0 00:30:24.113 05:26:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:24.113 05:26:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:24.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:24.113 --rc genhtml_branch_coverage=1 00:30:24.113 --rc genhtml_function_coverage=1 00:30:24.113 --rc genhtml_legend=1 00:30:24.113 --rc geninfo_all_blocks=1 00:30:24.113 --rc geninfo_unexecuted_blocks=1 00:30:24.113 00:30:24.113 ' 00:30:24.113 05:26:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:24.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:24.113 --rc genhtml_branch_coverage=1 00:30:24.113 --rc genhtml_function_coverage=1 00:30:24.113 --rc genhtml_legend=1 00:30:24.113 --rc geninfo_all_blocks=1 00:30:24.113 --rc geninfo_unexecuted_blocks=1 00:30:24.113 00:30:24.113 ' 00:30:24.113 05:26:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:24.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:24.114 --rc genhtml_branch_coverage=1 00:30:24.114 --rc genhtml_function_coverage=1 00:30:24.114 --rc genhtml_legend=1 00:30:24.114 --rc geninfo_all_blocks=1 00:30:24.114 --rc geninfo_unexecuted_blocks=1 00:30:24.114 00:30:24.114 ' 00:30:24.114 05:26:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:24.114 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:24.114 --rc genhtml_branch_coverage=1 00:30:24.114 --rc genhtml_function_coverage=1 00:30:24.114 --rc genhtml_legend=1 00:30:24.114 --rc geninfo_all_blocks=1 00:30:24.114 --rc geninfo_unexecuted_blocks=1 00:30:24.114 00:30:24.114 ' 00:30:24.114 05:26:25 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:24.114 05:26:25 -- nvmf/common.sh@7 -- # uname -s 00:30:24.114 05:26:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:24.114 05:26:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:24.114 05:26:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:24.114 05:26:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:24.114 05:26:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:24.114 05:26:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:24.114 05:26:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:24.114 05:26:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:24.114 05:26:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:24.114 05:26:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:24.114 05:26:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:24.114 05:26:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:24.114 05:26:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:24.114 05:26:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:24.114 05:26:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:24.114 05:26:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:24.114 05:26:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:24.114 05:26:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:24.114 05:26:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:24.114 05:26:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:24.114 05:26:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:24.114 05:26:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:24.114 05:26:25 -- paths/export.sh@5 -- # export PATH 00:30:24.114 05:26:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:24.114 05:26:25 -- nvmf/common.sh@46 -- # : 0 00:30:24.114 05:26:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:24.114 05:26:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:24.114 05:26:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:24.114 05:26:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:24.114 05:26:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:24.114 05:26:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:24.114 05:26:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:24.114 05:26:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:24.114 05:26:25 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:24.114 05:26:25 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:24.114 05:26:25 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:24.114 05:26:25 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:24.114 05:26:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:24.114 05:26:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:24.114 05:26:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:24.114 05:26:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:24.114 05:26:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:24.114 05:26:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:24.114 05:26:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:24.114 05:26:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:24.114 05:26:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:24.114 05:26:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:24.114 05:26:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:24.114 05:26:25 -- common/autotest_common.sh@10 -- # set +x 00:30:26.025 05:26:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:26.025 05:26:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:26.025 05:26:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:26.025 05:26:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:26.025 05:26:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:26.025 05:26:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:26.025 05:26:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:26.025 05:26:27 -- nvmf/common.sh@294 -- # net_devs=() 00:30:26.025 05:26:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:26.025 05:26:27 -- nvmf/common.sh@295 -- # e810=() 00:30:26.025 05:26:27 -- nvmf/common.sh@295 -- # local -ga e810 00:30:26.025 05:26:27 -- nvmf/common.sh@296 -- # x722=() 00:30:26.025 05:26:27 -- nvmf/common.sh@296 -- # local -ga x722 00:30:26.026 05:26:27 -- nvmf/common.sh@297 -- # mlx=() 00:30:26.026 05:26:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:26.026 05:26:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:26.026 05:26:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:26.026 05:26:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:26.026 05:26:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:26.026 05:26:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:26.026 05:26:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:26.026 05:26:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:26.026 05:26:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:26.026 05:26:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:26.026 05:26:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:26.026 05:26:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:26.026 05:26:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:26.026 05:26:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:26.026 05:26:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:26.026 05:26:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:26.026 05:26:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:26.026 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:26.026 05:26:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:26.026 05:26:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:26.026 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:26.026 05:26:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:26.026 05:26:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:26.026 05:26:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:26.026 05:26:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:26.026 05:26:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:26.026 05:26:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:26.026 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:26.026 05:26:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:26.026 05:26:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:26.026 05:26:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:26.026 05:26:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:26.026 05:26:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:26.026 05:26:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:26.026 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:26.026 05:26:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:26.026 05:26:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:26.026 05:26:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:26.026 05:26:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:26.026 05:26:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:26.026 05:26:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:26.026 05:26:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:26.026 05:26:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:26.026 05:26:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:26.026 05:26:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:26.026 05:26:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:26.026 05:26:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:26.026 05:26:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:26.026 05:26:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:26.026 05:26:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:26.026 05:26:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:26.026 05:26:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:26.026 05:26:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:26.026 05:26:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:26.026 05:26:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:26.026 05:26:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:26.026 05:26:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:26.026 05:26:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:26.026 05:26:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:26.026 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:26.026 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.282 ms 00:30:26.026 00:30:26.026 --- 10.0.0.2 ping statistics --- 00:30:26.026 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:26.026 rtt min/avg/max/mdev = 0.282/0.282/0.282/0.000 ms 00:30:26.026 05:26:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:26.026 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:26.026 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:30:26.026 00:30:26.026 --- 10.0.0.1 ping statistics --- 00:30:26.026 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:26.026 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:30:26.026 05:26:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:26.026 05:26:27 -- nvmf/common.sh@410 -- # return 0 00:30:26.026 05:26:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:26.026 05:26:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:26.026 05:26:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:26.026 05:26:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:26.026 05:26:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:26.026 05:26:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:26.026 05:26:27 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:26.026 05:26:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:26.026 05:26:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:26.026 05:26:27 -- common/autotest_common.sh@10 -- # set +x 00:30:26.026 ************************************ 00:30:26.026 START TEST nvmf_target_disconnect_tc1 00:30:26.026 ************************************ 00:30:26.026 05:26:27 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:26.026 05:26:27 -- host/target_disconnect.sh@32 -- # set +e 00:30:26.026 05:26:27 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:26.026 EAL: No free 2048 kB hugepages reported on node 1 00:30:26.026 [2024-11-26 05:26:27.744068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:26.026 [2024-11-26 05:26:27.744281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:26.026 [2024-11-26 05:26:27.744309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xba1df0 with addr=10.0.0.2, port=4420 00:30:26.026 [2024-11-26 05:26:27.744347] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:26.026 [2024-11-26 05:26:27.744371] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:26.026 [2024-11-26 05:26:27.744385] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:26.026 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:26.026 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:26.026 Initializing NVMe Controllers 00:30:26.026 05:26:27 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:26.026 05:26:27 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:26.026 05:26:27 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:26.026 05:26:27 -- common/autotest_common.sh@1142 -- # return 0 00:30:26.026 05:26:27 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:26.026 05:26:27 -- host/target_disconnect.sh@41 -- # set -e 00:30:26.026 00:30:26.026 real 0m0.098s 00:30:26.026 user 0m0.041s 00:30:26.026 sys 0m0.057s 00:30:26.026 05:26:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:26.026 05:26:27 -- common/autotest_common.sh@10 -- # set +x 00:30:26.026 ************************************ 00:30:26.026 END TEST nvmf_target_disconnect_tc1 00:30:26.026 ************************************ 00:30:26.026 05:26:27 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:26.026 05:26:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:26.026 05:26:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:26.026 05:26:27 -- common/autotest_common.sh@10 -- # set +x 00:30:26.026 ************************************ 00:30:26.026 START TEST nvmf_target_disconnect_tc2 00:30:26.026 ************************************ 00:30:26.026 05:26:27 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:26.026 05:26:27 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:26.026 05:26:27 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:26.026 05:26:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:26.026 05:26:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:26.026 05:26:27 -- common/autotest_common.sh@10 -- # set +x 00:30:26.026 05:26:27 -- nvmf/common.sh@469 -- # nvmfpid=3429095 00:30:26.026 05:26:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:26.026 05:26:27 -- nvmf/common.sh@470 -- # waitforlisten 3429095 00:30:26.027 05:26:27 -- common/autotest_common.sh@829 -- # '[' -z 3429095 ']' 00:30:26.027 05:26:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:26.027 05:26:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:26.027 05:26:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:26.027 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:26.027 05:26:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:26.027 05:26:27 -- common/autotest_common.sh@10 -- # set +x 00:30:26.286 [2024-11-26 05:26:27.827745] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:26.286 [2024-11-26 05:26:27.827836] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:26.286 EAL: No free 2048 kB hugepages reported on node 1 00:30:26.286 [2024-11-26 05:26:27.895343] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:26.286 [2024-11-26 05:26:27.982228] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:26.286 [2024-11-26 05:26:27.982393] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:26.286 [2024-11-26 05:26:27.982412] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:26.286 [2024-11-26 05:26:27.982424] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:26.286 [2024-11-26 05:26:27.982639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:26.286 [2024-11-26 05:26:27.982706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:26.286 [2024-11-26 05:26:27.982767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:26.286 [2024-11-26 05:26:27.982770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:27.224 05:26:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:27.224 05:26:28 -- common/autotest_common.sh@862 -- # return 0 00:30:27.224 05:26:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:27.224 05:26:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:27.224 05:26:28 -- common/autotest_common.sh@10 -- # set +x 00:30:27.224 05:26:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:27.224 05:26:28 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:27.224 05:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:27.224 05:26:28 -- common/autotest_common.sh@10 -- # set +x 00:30:27.224 Malloc0 00:30:27.224 05:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:27.224 05:26:28 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:27.224 05:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:27.224 05:26:28 -- common/autotest_common.sh@10 -- # set +x 00:30:27.224 [2024-11-26 05:26:28.852262] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:27.224 05:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:27.224 05:26:28 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:27.224 05:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:27.224 05:26:28 -- common/autotest_common.sh@10 -- # set +x 00:30:27.224 05:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:27.224 05:26:28 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:27.224 05:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:27.224 05:26:28 -- common/autotest_common.sh@10 -- # set +x 00:30:27.224 05:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:27.224 05:26:28 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:27.224 05:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:27.224 05:26:28 -- common/autotest_common.sh@10 -- # set +x 00:30:27.224 [2024-11-26 05:26:28.880575] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:27.224 05:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:27.224 05:26:28 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:27.224 05:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:27.224 05:26:28 -- common/autotest_common.sh@10 -- # set +x 00:30:27.224 05:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:27.224 05:26:28 -- host/target_disconnect.sh@50 -- # reconnectpid=3429255 00:30:27.224 05:26:28 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:27.224 05:26:28 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:27.224 EAL: No free 2048 kB hugepages reported on node 1 00:30:29.143 05:26:30 -- host/target_disconnect.sh@53 -- # kill -9 3429095 00:30:29.143 05:26:30 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:29.426 Read completed with error (sct=0, sc=8) 00:30:29.426 starting I/O failed 00:30:29.426 Read completed with error (sct=0, sc=8) 00:30:29.426 starting I/O failed 00:30:29.426 Read completed with error (sct=0, sc=8) 00:30:29.426 starting I/O failed 00:30:29.426 Read completed with error (sct=0, sc=8) 00:30:29.426 starting I/O failed 00:30:29.426 Read completed with error (sct=0, sc=8) 00:30:29.426 starting I/O failed 00:30:29.426 Read completed with error (sct=0, sc=8) 00:30:29.426 starting I/O failed 00:30:29.426 Read completed with error (sct=0, sc=8) 00:30:29.426 starting I/O failed 00:30:29.426 Read completed with error (sct=0, sc=8) 00:30:29.426 starting I/O failed 00:30:29.426 Read completed with error (sct=0, sc=8) 00:30:29.426 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 [2024-11-26 05:26:30.906033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 [2024-11-26 05:26:30.906359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Read completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.427 starting I/O failed 00:30:29.427 Write completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Write completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Write completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 [2024-11-26 05:26:30.906675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Write completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Write completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Write completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Write completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Write completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Write completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Write completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Write completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Write completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 Read completed with error (sct=0, sc=8) 00:30:29.428 starting I/O failed 00:30:29.428 [2024-11-26 05:26:30.907030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:29.428 [2024-11-26 05:26:30.907254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.907441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.907469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.428 qpair failed and we were unable to recover it. 00:30:29.428 [2024-11-26 05:26:30.907608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.907714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.907749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.428 qpair failed and we were unable to recover it. 00:30:29.428 [2024-11-26 05:26:30.907889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.907990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.908017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.428 qpair failed and we were unable to recover it. 00:30:29.428 [2024-11-26 05:26:30.908126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.908253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.908278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.428 qpair failed and we were unable to recover it. 00:30:29.428 [2024-11-26 05:26:30.908385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.908500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.908525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.428 qpair failed and we were unable to recover it. 00:30:29.428 [2024-11-26 05:26:30.908659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.908789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.908815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.428 qpair failed and we were unable to recover it. 00:30:29.428 [2024-11-26 05:26:30.908925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.909040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.909065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.428 qpair failed and we were unable to recover it. 00:30:29.428 [2024-11-26 05:26:30.909212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.909342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.909368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.428 qpair failed and we were unable to recover it. 00:30:29.428 [2024-11-26 05:26:30.909488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.909624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.909652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.428 qpair failed and we were unable to recover it. 00:30:29.428 [2024-11-26 05:26:30.909794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.909907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.909932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.428 qpair failed and we were unable to recover it. 00:30:29.428 [2024-11-26 05:26:30.910037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.910185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.910211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.428 qpair failed and we were unable to recover it. 00:30:29.428 [2024-11-26 05:26:30.910310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.910445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.428 [2024-11-26 05:26:30.910470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.428 qpair failed and we were unable to recover it. 00:30:29.428 [2024-11-26 05:26:30.910611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.910727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.910753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.910854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.911018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.911044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.911168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.911331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.911356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.911497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.911621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.911650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.911792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.911925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.911951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.912059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.912197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.912225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.912376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.912528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.912557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.912701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.912831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.912859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.912958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.913087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.913113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.913213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.913319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.913346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.913532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.913667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.913700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.913815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.913917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.913942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.914047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.914207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.914233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.914363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.914498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.914524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.914616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.914748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.914774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.914892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.915001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.915026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.915179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.915306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.915332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.915482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.915607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.915632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.915770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.915875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.915902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.916058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.916170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.916200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.916358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.916528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.916557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.916709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.916815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.429 [2024-11-26 05:26:30.916840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.429 qpair failed and we were unable to recover it. 00:30:29.429 [2024-11-26 05:26:30.916967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.917108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.917135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.917247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.917364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.917389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.917515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.917608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.917634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.917733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.917825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.917850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.918011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.918163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.918187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.918314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.918418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.918442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.918547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.918676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.918712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.918816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.918940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.918967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.919093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.919222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.919247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.919340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.919465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.919490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.919614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.919758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.919784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.919884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.920008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.920033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.920125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.920215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.920240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.920364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.920494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.920519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.920641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.920754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.920780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.920869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.920967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.920991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.921147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.921277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.921309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.921442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.921571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.921596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.921741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.921876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.921904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.922035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.922138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.922165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.922287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.922423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.922451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.430 [2024-11-26 05:26:30.922584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.922709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.430 [2024-11-26 05:26:30.922738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.430 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.922843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.922968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.922994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.923121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.923243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.923269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.923371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.923498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.923523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.923627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.923783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.923809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.923938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.924074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.924105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.924256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.924417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.924446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.924598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.924723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.924749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.924858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.924963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.924989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.925121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.925243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.925268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.925393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.925518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.925544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.925671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.925782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.925808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.925938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.926032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.926057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.926157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.926258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.926284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.926410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.926536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.926561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.926697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.926798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.926824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.926940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.927038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.927063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.927162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.927256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.927282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.927445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.927542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.927567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.927669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.927775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.927801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.927901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.928062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.928088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.928187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.928339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.928364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.928472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.928629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.928654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.928779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.928890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.431 [2024-11-26 05:26:30.928915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.431 qpair failed and we were unable to recover it. 00:30:29.431 [2024-11-26 05:26:30.929024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.929142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.929168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.929267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.929394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.929420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.929553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.929678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.929725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.929859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.929956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.929980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.930129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.930248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.930273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.930398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.930530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.930555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.930705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.930811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.930839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.930957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.931056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.931082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.931213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.931336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.931362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.931492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.931622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.931647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.931792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.931931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.931957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.932080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.932185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.932211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.932314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.932442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.932467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.932596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.932733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.932759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.932895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.933022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.933048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.933180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.933282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.933309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.933439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.933563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.933588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.933717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.933818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.933843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.432 qpair failed and we were unable to recover it. 00:30:29.432 [2024-11-26 05:26:30.933968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.432 [2024-11-26 05:26:30.934070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.934097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.934228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.934352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.934377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.934504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.934628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.934653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.934803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.934931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.934957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.935092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.935190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.935215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.935368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.935497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.935523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.935678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.935832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.935859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.935960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.936117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.936143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.936243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.936366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.936392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.936520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.936617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.936644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.936751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.936846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.936871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.936999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.937130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.937155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.937254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.937389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.937414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.937569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.937723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.937755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.937902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.937996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.938021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.938129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.938251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.938277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.938402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.938533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.938558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.938654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.938771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.938797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.938926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.939079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.939104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.939229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.939339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.939367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.939497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.939625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.939650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.433 qpair failed and we were unable to recover it. 00:30:29.433 [2024-11-26 05:26:30.939764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.433 [2024-11-26 05:26:30.939892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.939917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.940042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.940147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.940173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.940298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.940403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.940429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.940567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.940736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.940762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.940861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.940988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.941013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.941138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.941235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.941260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.941365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.941483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.941508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.941670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.941800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.941825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.941934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.942036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.942062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.942197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.942289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.942332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.942476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.942628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.942670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.942859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.942965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.942989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.943121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.943245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.943271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.943377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.943532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.943557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.943661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.943772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.943798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.943934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.944059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.944083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.944212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.944338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.944364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.944558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.944694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.944720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.944826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.944995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.945021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.945148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.945301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.945326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.945451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.945634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.945662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.945876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.946013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.946059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.946171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.946300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.946326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.434 qpair failed and we were unable to recover it. 00:30:29.434 [2024-11-26 05:26:30.946459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.434 [2024-11-26 05:26:30.946592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.946618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.946726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.946831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.946856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.946984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.947122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.947148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.947294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.947421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.947446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.947551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.947682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.947715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.947821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.947923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.947948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.948049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.948170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.948212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.948310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.948407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.948432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.948563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.948658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.948693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.948799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.948936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.948962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.949090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.949237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.949262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.949357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.949464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.949490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.949609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.949743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.949771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.949869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.950025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.950051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.950175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.950305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.950330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.950453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.950633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.950659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.950797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.950905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.950930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.951033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.951164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.951189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.951289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.951476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.951502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.951603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.951771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.951797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.951902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.952007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.952038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.952164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.952286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.952312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.952413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.952541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.952567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.435 qpair failed and we were unable to recover it. 00:30:29.435 [2024-11-26 05:26:30.952699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.952802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.435 [2024-11-26 05:26:30.952827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.952949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.953119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.953147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.953281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.953457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.953482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.953632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.953735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.953761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.953865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.953967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.954020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.954198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.954391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.954416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.954518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.954637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.954662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.954795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.954920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.954946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.955040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.955134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.955159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.955355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.955484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.955510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.955646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.955790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.955816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.955940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.956074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.956100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.956239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.956367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.956394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.956544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.956711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.956740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.956932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.957096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.957121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.957246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.957375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.957401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.957581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.957669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.957700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.957857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.958009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.958034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.958135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.958290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.958316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.958420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.958624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.958649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.958842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.958973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.958998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.959120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.959243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.959268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.436 qpair failed and we were unable to recover it. 00:30:29.436 [2024-11-26 05:26:30.959390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.436 [2024-11-26 05:26:30.959486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.959512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.959636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.959776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.959803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.959927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.960023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.960048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.960189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.960321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.960364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.960467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.960602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.960644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.960818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.960945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.960970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.961076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.961199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.961224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.961356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.961483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.961508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.961611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.961762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.961789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.961925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.962083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.962108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.962236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.962359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.962384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.962491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.962643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.962669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.962800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.962953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.962978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.963110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.963209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.963236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.963377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.963504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.963530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.963660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.963801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.963827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.963951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.964085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.964111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.964242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.964367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.964392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.964483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.964625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.964653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.964771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.964891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.964918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.965042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.965168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.965193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.965345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.965502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.437 [2024-11-26 05:26:30.965527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.437 qpair failed and we were unable to recover it. 00:30:29.437 [2024-11-26 05:26:30.965696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.965859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.965885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.966018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.966114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.966140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.966268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.966424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.966450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.966565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.966701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.966742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.966891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.967014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.967043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.967160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.967298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.967326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.967495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.967594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.967619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.967777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.967884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.967910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.968085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.968227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.968256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.968401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.968546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.968572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.968670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.968799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.968825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.968928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.969028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.969054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.969209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.969317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.969346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.969489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.969617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.969642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.969859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.969955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.969985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.970158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.970286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.970311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.970438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.970556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.970581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.970699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.970855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.970881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.438 qpair failed and we were unable to recover it. 00:30:29.438 [2024-11-26 05:26:30.971002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.438 [2024-11-26 05:26:30.971100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.971126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.971246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.971398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.971423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.971561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.971696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.971722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.971858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.972044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.972069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.972196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.972290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.972316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.972445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.972541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.972566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.972668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.972776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.972802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.972905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.973057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.973083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.973240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.973370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.973395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.973525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.973680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.973714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.973870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.973997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.974022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.974120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.974220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.974245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.974373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.974502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.974527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.974630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.974720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.974746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.974898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.975024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.975050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.975156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.975325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.975353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.975494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.975615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.975640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.975782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.975905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.975930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.976044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.976205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.976231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.976384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.976539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.976565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.976695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.976788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.976813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.976908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.977035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.977060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.439 qpair failed and we were unable to recover it. 00:30:29.439 [2024-11-26 05:26:30.977184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.977323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.439 [2024-11-26 05:26:30.977349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.977446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.977558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.977588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.977747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.977878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.977903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.978042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.978192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.978217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.978347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.978473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.978499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.978652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.978786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.978812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.978914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.979066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.979091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.979192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.979338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.979364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.979519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.979618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.979644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.979749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.979902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.979928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.980021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.980169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.980197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.980307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.980449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.980477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.980599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.980696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.980722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.980820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.980942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.980967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.981155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.981262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.981287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.981386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.981517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.981543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.981662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.981856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.981886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.982039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.982165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.982190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.982293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.982448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.982473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.982612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.982796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.982823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.982964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.983141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.983166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.983297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.983429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.983455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.983586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.983750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.440 [2024-11-26 05:26:30.983776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.440 qpair failed and we were unable to recover it. 00:30:29.440 [2024-11-26 05:26:30.983903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.984029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.984054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.984173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.984297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.984322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.984468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.984637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.984670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.984822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.984915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.984940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.985069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.985220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.985246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.985356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.985497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.985525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.985715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.985811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.985836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.985956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.986078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.986103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.986253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.986381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.986406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.986534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.986622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.986648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.986789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.986889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.986915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.987047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.987171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.987197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.987326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.987466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.987494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.987606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.987758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.987784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.987930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.988119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.988145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.988239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.988385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.988414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.988559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.988715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.988758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.988876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.989018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.989046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.989191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.989312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.989337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.989454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.989605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.989630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.989730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.989828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.989853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.441 [2024-11-26 05:26:30.989983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.990108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.441 [2024-11-26 05:26:30.990134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.441 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.990290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.990410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.990453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.990563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.990694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.990719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.990817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.990908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.990933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.991061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.991163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.991189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.991282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.991409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.991434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.991530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.991661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.991693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.991814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.991943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.991969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.992091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.992222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.992249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.992339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.992502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.992527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.992678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.992818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.992843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.992992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.993110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.993135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.993242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.993392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.993433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.993586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.993734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.993775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.993928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.994049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.994077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.994244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.994414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.994440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.994570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.994660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.994692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.994791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.994893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.994918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.995054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.995195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.995223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.995371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.995493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.995519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.995615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.995708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.995734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.442 qpair failed and we were unable to recover it. 00:30:29.442 [2024-11-26 05:26:30.995840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.442 [2024-11-26 05:26:30.995959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.995987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:30.996139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.996270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.996295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:30.996488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.996580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.996607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:30.996737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.996893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.996918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:30.997047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.997177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.997203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:30.997332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.997487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.997512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:30.997667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.997800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.997825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:30.997921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.998075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.998100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:30.998223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.998394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.998423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:30.998556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.998698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.998727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:30.998897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.999051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.999076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:30.999202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.999355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.999385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:30.999516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.999620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.999645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:30.999781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.999908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:30.999933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:31.000081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.000256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.000281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:31.000391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.000543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.000568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:31.000727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.000834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.000861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:31.000964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.001087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.001113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:31.001206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.001332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.001375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:31.001510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.001637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.001663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:31.001808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.001916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.001941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:31.002096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.002218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.002243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.443 qpair failed and we were unable to recover it. 00:30:29.443 [2024-11-26 05:26:31.002375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.443 [2024-11-26 05:26:31.002467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.002494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.002615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.002783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.002809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.002938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.003073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.003098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.003224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.003324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.003350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.003500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.003693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.003719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.003824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.003978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.004004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.004108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.004233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.004259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.004382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.004534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.004560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.004656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.004819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.004845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.004976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.005076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.005101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.005248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.005429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.005454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.005553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.005651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.005677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.005807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.005936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.005961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.006096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.006182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.006208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.006330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.006451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.006476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.006605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.006728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.006754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.006901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.007038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.007086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.007185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.007365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.007391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.444 qpair failed and we were unable to recover it. 00:30:29.444 [2024-11-26 05:26:31.007500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.007632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.444 [2024-11-26 05:26:31.007657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.007766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.007922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.007948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.008082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.008228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.008257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.008406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.008559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.008585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.008742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.008919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.008944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.009068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.009174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.009216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.009371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.009506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.009532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.009657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.009831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.009858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.009990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.010132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.010157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.010275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.010371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.010396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.010547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.010639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.010664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.010801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.010957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.010983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.011105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.011202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.011229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.011357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.011482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.011507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.011634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.011746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.011776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.011953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.012118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.012143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.012299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.012425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.012451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.012571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.012725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.012751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.012872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.012969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.012996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.013128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.013252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.013277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.013409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.013541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.013567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.013654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.013763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.013789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.445 qpair failed and we were unable to recover it. 00:30:29.445 [2024-11-26 05:26:31.013921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.445 [2024-11-26 05:26:31.014109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.014138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.014270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.014360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.014386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.014514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.014615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.014640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.014772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.014860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.014886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.015011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.015129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.015154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.015272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.015396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.015422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.015523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.015698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.015741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.015836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.015954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.015980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.016133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.016257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.016283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.016388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.016511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.016536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.016663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.016860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.016886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.017013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.017113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.017139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.017232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.017380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.017408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.017570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.017674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.017730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.017859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.017956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.017982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.018078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.018233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.018258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.018385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.018480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.018506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.018602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.018726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.018753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.018878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.019055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.019081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.019215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.019309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.019335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.019462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.019588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.019613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.019749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.019851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.019876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.019969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.020097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.446 [2024-11-26 05:26:31.020123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.446 qpair failed and we were unable to recover it. 00:30:29.446 [2024-11-26 05:26:31.020227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.020351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.020376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.020484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.020614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.020639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.020745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.020878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.020903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.021034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.021183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.021225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.021339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.021472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.021514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.021641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.021744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.021772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.021875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.021996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.022022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.022154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.022306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.022332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.022485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.022658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.022691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.022797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.022919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.022945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.023096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.023255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.023280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.023389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.023545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.023570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.023678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.023835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.023860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.023974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.024113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.024142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.024281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.024445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.024470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.024569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.024701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.024728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.024854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.024953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.024996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.025099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.025238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.025266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.025437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.025595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.025638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.025804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.025949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.025975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.026121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.026250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.026276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.026371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.026521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.026546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.447 [2024-11-26 05:26:31.026697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.026818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.447 [2024-11-26 05:26:31.026844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.447 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.026971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.027125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.027150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.027252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.027378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.027404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.027541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.027662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.027693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.027830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.027972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.028001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.028153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.028259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.028284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.028456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.028627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.028657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.028887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.029043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.029069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.029192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.029287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.029313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.029434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.029610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.029638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.029774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.029904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.029929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.030023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.030146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.030171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.030343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.030517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.030543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.030665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.030817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.030846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.030967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.031092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.031117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.031284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.031416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.031445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.031592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.031749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.031779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.031901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.032055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.032080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.032233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.032362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.032390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.032535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.032634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.032660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.032822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.032918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.032944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.033118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.033235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.033261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.033420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.033530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.033558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.033730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.033855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.033881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.448 qpair failed and we were unable to recover it. 00:30:29.448 [2024-11-26 05:26:31.034024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.448 [2024-11-26 05:26:31.034178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.034203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.034303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.034399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.034424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.034638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.034797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.034823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.034974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.035134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.035160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.035286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.035430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.035458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.035612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.035711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.035738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.035843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.036007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.036035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.036209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.036386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.036412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.036509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.036612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.036638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.036788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.036891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.036917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.037071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.037256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.037282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.037435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.037565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.037608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.037748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.037892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.037917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.038080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.038201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.038229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.038354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.038478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.038503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.038694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.038827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.038853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.038953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.039111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.039137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.039261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.039354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.039380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.039521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.039703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.039746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.039880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.040032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.040074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.040204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.040305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.040331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.449 qpair failed and we were unable to recover it. 00:30:29.449 [2024-11-26 05:26:31.040511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.449 [2024-11-26 05:26:31.040661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.040692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.040791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.040897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.040922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.041046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.041175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.041201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.041298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.041429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.041455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.041563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.041683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.041749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.041905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.042057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.042083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.042182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.042282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.042308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.042450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.042562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.042591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.042740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.042835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.042860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.042989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.043134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.043163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.043303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.043420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.043450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.043629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.043780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.043807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.043924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.044071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.044100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.044246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.044414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.044440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.044566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.044696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.044722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.044811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.044935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.044960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.045133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.045278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.045307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.045479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.045612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.045653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.045816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.045925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.045950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.046109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.046236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.046262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.046390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.046542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.046568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.046744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.046874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.046903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.047036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.047145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.047182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.047322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.047420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.450 [2024-11-26 05:26:31.047446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.450 qpair failed and we were unable to recover it. 00:30:29.450 [2024-11-26 05:26:31.047547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.047674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.047707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.047807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.047933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.047958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.048080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.048209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.048234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.048354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.048489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.048517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.048683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.048842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.048869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.048995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.049126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.049152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.049306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.049399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.049425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.049580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.049724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.049754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.049878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.049965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.049990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.050092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.050224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.050249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.050376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.050519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.050548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.050727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.050836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.050862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.050989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.051160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.051188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.051325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.051489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.051517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.051696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.051800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.051827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.052025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.052148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.052174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.052294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.052393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.052435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.052586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.052716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.052742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.052837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.052939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.052965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.053069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.053197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.053224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.053332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.053459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.053484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.053611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.053746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.053775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.053911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.054063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.054089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.054183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.054288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.054314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.054416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.054544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.054569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.054738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.054848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.054876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.055058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.055157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.055183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.055286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.055419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.055445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.451 [2024-11-26 05:26:31.055536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.055657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.451 [2024-11-26 05:26:31.055683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.451 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.055836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.056038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.056092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.056217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.056384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.056432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.056559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.056701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.056728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.056847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.057015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.057058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.057157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.057263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.057288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.057450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.057584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.057610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.057791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.057956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.057985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.058161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.058336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.058365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.058486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.058640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.058665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.058860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.058984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.059009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.059167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.059320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.059350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.059487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.059599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.059627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.059769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.059898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.059924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.060068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.060227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.060255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.060396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.060530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.060558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.060700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.060859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.060884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.060990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.061154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.061182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.061315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.061415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.061443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.061588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.061712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.061739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.061837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.061936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.061977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.062143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.062280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.062309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.062475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.062641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.062669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.062826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.062955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.062980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.063115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.063217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.063245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.063416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.063548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.063574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.063674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.063822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.063848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.063955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.064089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.064130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.064257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.064364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.064390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.452 qpair failed and we were unable to recover it. 00:30:29.452 [2024-11-26 05:26:31.064510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.064653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.452 [2024-11-26 05:26:31.064681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.064812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.064945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.064971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.065090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.065211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.065240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.065341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.065470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.065495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.065654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.065820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.065846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.065970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.066088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.066117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.066251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.066389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.066419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.066571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.066698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.066724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.066853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.066976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.067002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.067152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.067317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.067345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.067455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.067625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.067653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.067786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.067934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.067959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.068105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.068247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.068275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.068385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.068519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.068548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.068725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.068854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.068879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.068973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.069100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.069126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.069220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.069321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.069347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.069522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.069661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.069707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.069828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.069925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.069951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.070103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.070268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.070296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.070411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.070531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.070557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.070707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.070813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.070842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.070952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.071126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.071154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.071284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.071409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.071435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.071529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.071656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.071681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.071864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.071980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.072008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.072125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.072222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.072247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.072343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.072472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.072514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.072656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.072783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.072810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.453 qpair failed and we were unable to recover it. 00:30:29.453 [2024-11-26 05:26:31.072951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.453 [2024-11-26 05:26:31.073074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.073100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.073252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.073381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.073411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.073523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.073656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.073699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.073850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.073974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.073999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.074131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.074284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.074310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.074446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.074559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.074588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.074763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.074882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.074908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.075053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.075195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.075223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.075336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.075476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.075503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.075633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.075782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.075808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.075955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.076051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.076077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.076219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.076356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.076385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.076530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.076651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.076676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.076813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.076940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.076968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.077109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.077236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.077262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.077380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.077493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.077520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.077651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.077780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.077809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.077975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.078084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.078113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.078237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.078370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.078395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.078558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.078678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.078733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.078888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.079039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.079065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.079257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.079344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.079370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.079516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.079675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.079726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.079836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.079932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.079958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.080145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.080244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.080273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.080418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.080554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.080583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.080702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.080803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.080828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.080941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.081042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.081070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.081206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.081313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.081354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.454 qpair failed and we were unable to recover it. 00:30:29.454 [2024-11-26 05:26:31.081488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.454 [2024-11-26 05:26:31.081602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.081630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.081786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.081913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.081938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.082076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.082271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.082300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.082438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.082548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.082576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.082697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.082877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.082902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.083057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.083155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.083182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.083323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.083462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.083490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.083630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.083798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.083827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.083933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.084075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.084102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.084260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.084390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.084416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.084510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.084636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.084661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.084802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.084900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.084926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.085043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.085214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.085239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.085337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.085463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.085489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.085628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.085778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.085804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.085956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.086123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.086186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.086360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.086501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.086530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.086649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.086780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.086806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.086938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.087072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.087097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.087245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.087362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.087387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.087486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.087606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.087636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.087769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.087895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.087922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.088073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.088220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.088248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.088413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.088561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.088587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.088682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.088810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.088836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.455 qpair failed and we were unable to recover it. 00:30:29.455 [2024-11-26 05:26:31.088969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.089064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.455 [2024-11-26 05:26:31.089089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.089244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.089425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.089451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.089608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.089759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.089785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.089911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.090089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.090117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.090240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.090332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.090358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.090503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.090665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.090700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.090803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.090968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.090996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.091132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.091299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.091327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.091475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.091581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.091606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.091752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.091884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.091927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.092049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.092162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.092191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.092293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.092432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.092461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.092608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.092700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.092725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.092853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.093020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.093049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.093163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.093330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.093358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.093489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.093622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.093650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.093777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.093902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.093928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.094045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.094185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.094213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.094361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.094491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.094520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.094635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.094775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.094804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.094983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.095110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.095135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.095311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.095413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.095446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.095555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.095725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.095751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.095850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.095968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.095993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.096113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.096238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.096263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.096442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.096609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.096634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.096740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.096838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.096865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.097034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.097168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.097196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.097372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.097459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.097485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.456 qpair failed and we were unable to recover it. 00:30:29.456 [2024-11-26 05:26:31.097628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.456 [2024-11-26 05:26:31.097751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.097777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.097928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.098040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.098069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.098236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.098347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.098375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.098543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.098674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.098711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.098836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.098963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.098988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.099136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.099271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.099299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.099438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.099567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.099595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.099703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.099796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.099821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.099941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.100141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.100191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.100368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.100467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.100494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.100594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.100699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.100726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.100857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.100974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.101000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.101104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.101246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.101275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.101383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.101569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.101597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.101747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.101881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.101906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.102034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.102187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.102213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.102356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.102485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.102513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.102614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.102762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.102789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.102915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.103028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.103055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.103178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.103298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.103326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.103467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.103592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.103617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.103832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.103953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.103980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.104134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.104269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.104298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.104474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.104603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.104628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.104788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.104890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.104920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.105065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.105249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.105310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.105477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.105590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.105618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.105732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.105839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.105865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.105995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.106149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.106201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.457 qpair failed and we were unable to recover it. 00:30:29.457 [2024-11-26 05:26:31.106306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.457 [2024-11-26 05:26:31.106435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.106463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.106600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.106740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.106769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.106893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.107019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.107046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.107190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.107341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.107367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.107499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.107660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.107696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.107805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.107918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.107946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.108069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.108198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.108224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.108410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.108539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.108565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.108705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.108812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.108840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.108971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.109114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.109143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.109289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.109411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.109436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.109547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.109719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.109749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.109895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.110002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.110032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.110164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.110279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.110307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.110425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.110556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.110586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.110709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.110808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.110834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.110932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.111073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.111102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.111214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.111312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.111340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.111457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.111591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.111617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.111760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.111928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.111956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.112138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.112238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.112264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.112393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.112519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.112547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.112721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.112874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.112915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.113017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.113124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.113152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.113279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.113395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.113428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.113571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.113712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.113739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.113862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.114016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.114058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.114190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.114325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.114353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.114492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.114627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.114655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.458 qpair failed and we were unable to recover it. 00:30:29.458 [2024-11-26 05:26:31.114810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.458 [2024-11-26 05:26:31.114944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.114970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.115122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.115215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.115241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.115340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.115460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.115502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.115644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.115811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.115840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.115980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.116089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.116117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.116268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.116393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.116418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.116584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.116715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.116741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.116861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.116973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.117001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.117144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.117246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.117274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.117397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.117524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.117550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.117709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.117844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.117873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.118011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.118122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.118150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.118261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.118423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.118451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.118565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.118696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.118722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.118911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.119030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.119058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.119235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.119357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.119382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.119478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.119606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.119632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.119753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.119848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.119873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.120019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.120185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.120214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.120352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.120488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.120516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.120619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.120752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.120781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.120921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.121051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.121076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.121216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.121413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.121442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.121620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.121746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.121772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.121938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.122084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.122112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.122289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.122424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.459 [2024-11-26 05:26:31.122449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.459 qpair failed and we were unable to recover it. 00:30:29.459 [2024-11-26 05:26:31.122577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.122669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.122718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.122861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.122994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.123022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.123161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.123269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.123299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.123478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.123604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.123648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.123791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.123950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.123975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.124098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.124235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.124263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.124403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.124539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.124567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.124709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.124833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.124858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.125074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.125253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.125282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.125401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.125505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.125534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.125641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.125830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.125860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.126007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.126134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.126160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.126289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.126461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.126487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.126611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.126732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.126761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.126895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.126997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.127025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.127152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.127269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.127294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.127445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.127600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.127628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.127743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.127881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.127909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.128012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.128116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.128144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.128290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.128406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.128431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.128581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.128727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.128764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.128894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.129054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.129082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.129225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.129366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.129394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.129546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.129679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.129744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.129887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.130026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.130069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.130193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.130368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.130397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.130534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.130667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.130700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.130858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.130957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.460 [2024-11-26 05:26:31.130983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.460 qpair failed and we were unable to recover it. 00:30:29.460 [2024-11-26 05:26:31.131119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.131237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.131265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.131416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.131544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.131569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.131710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.131896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.131922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.132083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.132184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.132210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.132362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.132500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.132528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.132663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.132801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.132830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.132936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.133110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.133135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.133260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.133360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.133386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.133544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.133655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.133683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.133836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.133973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.134002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.134112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.134283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.134311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.134438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.134571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.134597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.134714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.134826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.134854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.134996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.135126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.135154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.135254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.135419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.135448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.135579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.135737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.135763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.135941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.136079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.136108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.136273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.136416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.136444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.136573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.136726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.136753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.136880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.136976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.137002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.137185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.137340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.137365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.137512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.137659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.137693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.137809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.137911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.137939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.138070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.138195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.138221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.138343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.138453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.138481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.138653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.138788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.138814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.138940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.139096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.139125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.139277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.139400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.139426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.139604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.139769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.461 [2024-11-26 05:26:31.139799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.461 qpair failed and we were unable to recover it. 00:30:29.461 [2024-11-26 05:26:31.139967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.140081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.140110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.140217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.140383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.140411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.140541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.140638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.140664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.140777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.140865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.140890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.140997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.141167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.141195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.141334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.141464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.141492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.141614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.141780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.141806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.141984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.142093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.142121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.142259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.142388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.142417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.142591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.142682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.142714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.142845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.142971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.142997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.143125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.143267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.143295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.143438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.143543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.143572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.143715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.143833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.143859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.143962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.144086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.144116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.144265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.144411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.144439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.144565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.144741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.144770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.144886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.145004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.145032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.145183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.145312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.145337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.145478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.145653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.145678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.145814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.145962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.145991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.146127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.146290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.146319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.146434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.146570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.146596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.146732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.146899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.146927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.147105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.147205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.147230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.147329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.147426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.147452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.147555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.147679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.147712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.147811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.147903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.147930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.462 qpair failed and we were unable to recover it. 00:30:29.462 [2024-11-26 05:26:31.148090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.148274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.462 [2024-11-26 05:26:31.148299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.148419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.148565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.148594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.148766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.148872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.148898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.149002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.149128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.149172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.149287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.149440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.149466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.149562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.149707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.149750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.149902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.150031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.150057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.150238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.150348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.150377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.150481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.150630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.150656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.150794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.150936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.150965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.151113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.151264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.151289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.151478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.151585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.151613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.151725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.151873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.151902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.152011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.152155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.152183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.152326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.152480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.152523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.152665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.152787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.152816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.152997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.153146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.153172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.153366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.153519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.153545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.153718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.153843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.153868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.154063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.154219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.154247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.154383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.154522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.154551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.154727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.154858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.154886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.155057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.155180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.155206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.155361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.155465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.155495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.155632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.155774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.155803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.155916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.156054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.156082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.156202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.156328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.156354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.156525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.156674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.156705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.156859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.157019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.157045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.463 qpair failed and we were unable to recover it. 00:30:29.463 [2024-11-26 05:26:31.157197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.463 [2024-11-26 05:26:31.157323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.157351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.157473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.157583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.157609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.157715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.157870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.157898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.158069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.158207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.158236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.158377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.158538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.158567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.158714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.158839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.158865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.159035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.159190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.159238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.159375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.159490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.159518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.159669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.159773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.159803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.159910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.160005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.160030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.160151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.160300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.160326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.160486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.160664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.160698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.160841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.160950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.160979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.161132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.161225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.161250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.161370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.161507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.161536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.161671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.161835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.161864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.161977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.162109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.162135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.162263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.162366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.162392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.162519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.162660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.162702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.162848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.162988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.163017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.163131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.163239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.163267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.163393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.163522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.163548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.163677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.163831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.163860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.163999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.164135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.164163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.164273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.164415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.164443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.464 qpair failed and we were unable to recover it. 00:30:29.464 [2024-11-26 05:26:31.164593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.464 [2024-11-26 05:26:31.164700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.164726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.164864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.164973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.165002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.165129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.165227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.165252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.165400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.165564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.165593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.165710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.165827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.165853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.165979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.166128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.166154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.166277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.166373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.166399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.166537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.166651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.166680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.166820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.166948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.166973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.167092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.167231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.167259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.167398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.167509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.167537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.167651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.167794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.167823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.167972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.168105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.168131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.168230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.168324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.168350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.168454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.168580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.168623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.465 [2024-11-26 05:26:31.168729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.168875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.465 [2024-11-26 05:26:31.168904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.465 qpair failed and we were unable to recover it. 00:30:29.791 [2024-11-26 05:26:31.169086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.791 [2024-11-26 05:26:31.169192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.791 [2024-11-26 05:26:31.169219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.791 qpair failed and we were unable to recover it. 00:30:29.791 [2024-11-26 05:26:31.169314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.791 [2024-11-26 05:26:31.169442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.791 [2024-11-26 05:26:31.169467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.791 qpair failed and we were unable to recover it. 00:30:29.791 [2024-11-26 05:26:31.169599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.791 [2024-11-26 05:26:31.169710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.791 [2024-11-26 05:26:31.169741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.791 qpair failed and we were unable to recover it. 00:30:29.791 [2024-11-26 05:26:31.169909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.791 [2024-11-26 05:26:31.170057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.791 [2024-11-26 05:26:31.170083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.791 qpair failed and we were unable to recover it. 00:30:29.791 [2024-11-26 05:26:31.170213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.791 [2024-11-26 05:26:31.170317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.791 [2024-11-26 05:26:31.170343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.791 qpair failed and we were unable to recover it. 00:30:29.791 [2024-11-26 05:26:31.170474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.791 [2024-11-26 05:26:31.170591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.791 [2024-11-26 05:26:31.170620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.791 qpair failed and we were unable to recover it. 00:30:29.791 [2024-11-26 05:26:31.170740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.791 [2024-11-26 05:26:31.170877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.170906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.171072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.171186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.171215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.171373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.171481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.171507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.171621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.171747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.171776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.171891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.172008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.172036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.172182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.172324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.172352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.172480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.172606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.172632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.172783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.172892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.172920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.173056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.173167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.173196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.173333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.173431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.173459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.173580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.173695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.173723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.173866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.173976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.174004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.174112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.174255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.174283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.174395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.174532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.174561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.174681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.174818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.174844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.174990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.175161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.175186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.175308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.175429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.175458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.175608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.175736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.175761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.175888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.176013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.176039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.792 [2024-11-26 05:26:31.176158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.176264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.792 [2024-11-26 05:26:31.176293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.792 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.176435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.176572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.176602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.176756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.176882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.176907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.177012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.177111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.177141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.177258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.177362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.177391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.177563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.177654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.177679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.177816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.177957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.177985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.178139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.178243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.178269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.178384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.178519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.178547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.178692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.178793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.178822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.178972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.179104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.179130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.179248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.179339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.179365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.179484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.179619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.179645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.179762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.179863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.179888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.179987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.180089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.180114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.180219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.180321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.180346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.180445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.180590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.180618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.180757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.180897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.180926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.181058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.181241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.181267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.181384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.181512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.793 [2024-11-26 05:26:31.181537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.793 qpair failed and we were unable to recover it. 00:30:29.793 [2024-11-26 05:26:31.181648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.181799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.181828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.181935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.182081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.182107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.182213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.182337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.182362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.182489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.182611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.182636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.182764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.182869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.182897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.183051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.183146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.183172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.183274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.183428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.183457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.183601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.183731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.183757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.183907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.184054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.184079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.184179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.184282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.184325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.184482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.184609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.184634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.184765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.184867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.184892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.184998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.185164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.185192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.185303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.185416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.185446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.185605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.185719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.185746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.185843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.185965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.185991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.186117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.186235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.186264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.186377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.186513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.186541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.186698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.186818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.186843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.794 qpair failed and we were unable to recover it. 00:30:29.794 [2024-11-26 05:26:31.186975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.794 [2024-11-26 05:26:31.187131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.187175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.187288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.187435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.187460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.187611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.187764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.187793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.187901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.188006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.188034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.188185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.188309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.188335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.188458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.188596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.188625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.188795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.188912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.188938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.189090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.189230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.189259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.189383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.189512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.189537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.189667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.189817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.189848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.190033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.190125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.190151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.190255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.190401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.190429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.190588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.190713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.190739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.190835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.190959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.190985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.191122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.191255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.191283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.191390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.191562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.191592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.191700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.191831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.191857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.191985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.192128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.192157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.192263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.192373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.192402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.795 [2024-11-26 05:26:31.192555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.192681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.795 [2024-11-26 05:26:31.192716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.795 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.192837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.192935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.192961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.193093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.193198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.193226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.193334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.193442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.193471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.193610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.193734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.193763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.193908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.194032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.194057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.194213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.194350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.194379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.194496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.194633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.194676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.194779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.194927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.194955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.195076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.195196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.195221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.195362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.195502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.195530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.195670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.195843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.195872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.195981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.196118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.196146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.196295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.196396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.196421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.196559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.196667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.196725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.196871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.197037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.197066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.197176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.197284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.197312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.197463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.197594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.197620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.197742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.197839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.197881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.198028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.198160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.198186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.796 qpair failed and we were unable to recover it. 00:30:29.796 [2024-11-26 05:26:31.198309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.796 [2024-11-26 05:26:31.198404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.198429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.198587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.198718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.198763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.198864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.198980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.199009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.199109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.199256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.199281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.199407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.199506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.199531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.199635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.199742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.199767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.199890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.200009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.200038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.200169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.200325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.200371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.200572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.200751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.200793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.200999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.201126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.201179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.201355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.201499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.201534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.201647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.201776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.201806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.201924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.202027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.202070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.202200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.202329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.202354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.202483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.202598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.202627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.202772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.202890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.202919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.203094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.203202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.203230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.203381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.203478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.203505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.203649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.203774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.203804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.797 qpair failed and we were unable to recover it. 00:30:29.797 [2024-11-26 05:26:31.203923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.204083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.797 [2024-11-26 05:26:31.204109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.204240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.204365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.204390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.204519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.204621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.204647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.204795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.204907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.204936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.205055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.205200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.205228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.205334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.205468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.205497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.205614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.205710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.205736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.205885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.206027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.206056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.206194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.206304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.206337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.206448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.206563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.206595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.206717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.206838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.206863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.206974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.207074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.207102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.207248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.207379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.207407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.207552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.207692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.207721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.207868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.207974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.208000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.208124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.208230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.798 [2024-11-26 05:26:31.208259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.798 qpair failed and we were unable to recover it. 00:30:29.798 [2024-11-26 05:26:31.208397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.208501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.208530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.208699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.208836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.208864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.208983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.209082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.209113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.209255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.209357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.209385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.209520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.209695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.209721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.209848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.210024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.210052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.210166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.210267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.210292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.210401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.210503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.210528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.210700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.210843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.210871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.211007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.211123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.211152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.211324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.211453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.211479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.211618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.211741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.211770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.211874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.212012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.212040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.212195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.212319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.212344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.212473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.212595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.212621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.212758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.212925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.212954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.213060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.213191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.213220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.213327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.213434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.213462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.213623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.213727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.213753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.799 qpair failed and we were unable to recover it. 00:30:29.799 [2024-11-26 05:26:31.213865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.214004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.799 [2024-11-26 05:26:31.214033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.214177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.214343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.214371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.214489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.214592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.214620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.214765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.214864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.214890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.215014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.215191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.215216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.215350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.215466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.215494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.215635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.215745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.215775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.215927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.216029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.216054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.216156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.216292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.216317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.216465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.216574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.216603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.216717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.216865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.216891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.217030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.217130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.217156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.217304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.217412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.217440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.217580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.217680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.217717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.217883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.218019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.218045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.218165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.218264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.218289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.218416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.218560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.218588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.218733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.218874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.218903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.219014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.219158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.219187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.219321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.219412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.219438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.800 qpair failed and we were unable to recover it. 00:30:29.800 [2024-11-26 05:26:31.219576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.800 [2024-11-26 05:26:31.219702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.219730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.219827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.219978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.220006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.220155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.220301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.220330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.220446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.220575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.220601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.220725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.220879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.220905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.221042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.221151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.221179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.221286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.221416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.221445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.221571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.221674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.221707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.221803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.221932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.221957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.222065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.222236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.222264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.222402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.222534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.222563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.222701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.222798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.222823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.222963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.223062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.223089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.223208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.223319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.223347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.223495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.223638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.223672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.223795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.223948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.223973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.224124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.224224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.224252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.224354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.224492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.224520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.224666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.224789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.224818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.801 [2024-11-26 05:26:31.224973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.225098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.801 [2024-11-26 05:26:31.225124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.801 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.225230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.225348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.225376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.225514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.225651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.225679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.225862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.225989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.226015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.226110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.226237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.226263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.226405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.226536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.226565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.226677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.226808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.226837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.226956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.227069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.227097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.227227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.227352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.227378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.227497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.227608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.227636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.227787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.227924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.227952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.228064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.228173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.228201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.228353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.228477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.228503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.228648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.228786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.228815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.228927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.229041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.229069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.229236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.229361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.229386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.229528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.229650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.229676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.229811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.229920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.229948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.230115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.230226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.230255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.230371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.230525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.230553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.802 qpair failed and we were unable to recover it. 00:30:29.802 [2024-11-26 05:26:31.230683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.802 [2024-11-26 05:26:31.230824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.230850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.230974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.231091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.231119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.231257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.231391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.231420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.231586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.231735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.231764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.231884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.232010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.232035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.232160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.232261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.232289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.232403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.232545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.232573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.232709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.232824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.232853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.233003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.233108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.233133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.233280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.233386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.233414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.233557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.233669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.233707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.233848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.233957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.233986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.234107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.234243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.234269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.234391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.234571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.234597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.234717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.234817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.234859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.235031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.235123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.235148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.235269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.235378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.235403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.235543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.235652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.235681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.235795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.235933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.235961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.236065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.236168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.803 [2024-11-26 05:26:31.236196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.803 qpair failed and we were unable to recover it. 00:30:29.803 [2024-11-26 05:26:31.236325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.236449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.236474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.236595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.236706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.236736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.236841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.236976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.237005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.237110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.237263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.237289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.237383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.237510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.237536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.237658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.237803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.237831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.237947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.238055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.238089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.238197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.238358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.238387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.238530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.238660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.238700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.238852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.238955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.238983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.239091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.239208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.239236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.239343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.239481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.239510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.239631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.239751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.239778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.239894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.240024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.240052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.240195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.240373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.240401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.240509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.240617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.240645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.240798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.240925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.240951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.241109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.241246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.241274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.241418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.241513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.241538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.241662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.241801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.241829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.804 qpair failed and we were unable to recover it. 00:30:29.804 [2024-11-26 05:26:31.241960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.242055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.804 [2024-11-26 05:26:31.242080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.242179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.242301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.242329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.242488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.242587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.242615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.242754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.242874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.242903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.243021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.243116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.243142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.243261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.243365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.243394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.243543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.243666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.243699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.243856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.243968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.243997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.244118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.244217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.244242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.244349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.244494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.244523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.244664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.244807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.244836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.244942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.245088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.245116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.245231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.245336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.245362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.245493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.245623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.245649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.245790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.245960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.245989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.246176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.246302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.246327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.246422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.246521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.246546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.246717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.246886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.246915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.247059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.247195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.247225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.247368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.247469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.247497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.247648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.247788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.247815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.247976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.248102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.248128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.248264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.248373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.248402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.248568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.248671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.248707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.248841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.248935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.248961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.249147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.249287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.249316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.249456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.249566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.249594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.805 qpair failed and we were unable to recover it. 00:30:29.805 [2024-11-26 05:26:31.249705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.805 [2024-11-26 05:26:31.249861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.249890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.250013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.250165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.250190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.250323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.250433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.250463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.250604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.250739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.250769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.250948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.251081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.251106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.251229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.251354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.251380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.251531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.251678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.251714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.251883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.252028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.252057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.252238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.252370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.252395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.252519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.252620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.252646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.252752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.252858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.252888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.253006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.253127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.253156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.253310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.253438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.253464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.253559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.253656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.253682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.253826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.253931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.253959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.254091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.254228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.254255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.254394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.254528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.254558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.254704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.254833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.254858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.255011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.255157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.255185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.255324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.255432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.255460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.255572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.255726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.255763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.255904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.256006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.256031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.256152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.256292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.256320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.256429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.256568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.256598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.256780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.256924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.256952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.257124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.257228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.257253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.257352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.257516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.257544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.257677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.257803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.257832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.806 qpair failed and we were unable to recover it. 00:30:29.806 [2024-11-26 05:26:31.257971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.806 [2024-11-26 05:26:31.258120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.258145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.258274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.258398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.258424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.258519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.258656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.258692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.258803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.258971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.259000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.259139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.259278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.259307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.259429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.259537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.259563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.259698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.259795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.259838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.259970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.260134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.260162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.260272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.260383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.260411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.260528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.260618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.260644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.260796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.260915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.260944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.261102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.261229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.261255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.261356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.261479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.261522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.261652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.261758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.261785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.261937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.262075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.262104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.262249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.262351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.262378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.262494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.262595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.262623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.262744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.262885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.262911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.263041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.263195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.263221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.263352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.263449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.263493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.263601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.263741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.263770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.263926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.264022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.264048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.264178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.264290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.264318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.264436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.264550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.264579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.264695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.264798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.264826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.264984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.265088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.265113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.265216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.265356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.265381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.265503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.265604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.265633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.265756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.265873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.265902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.807 qpair failed and we were unable to recover it. 00:30:29.807 [2024-11-26 05:26:31.266051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.807 [2024-11-26 05:26:31.266179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.266205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.266324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.266435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.266464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.266601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.266751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.266777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.266906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.267061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.267090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.267205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.267333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.267359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.267476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.267622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.267648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.267826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.267947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.267988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.268166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.268289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.268315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.268411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.268511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.268536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.268656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.268773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.268799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.268941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.269078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.269106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.269219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.269320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.269348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.269499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.269594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.269620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.269775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.269889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.269917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.270059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.270168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.270201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.270311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.270423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.270451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.270603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.270730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.270757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.270886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.271053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.271081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.271217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.271363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.271392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.271504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.271614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.271642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.271770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.271874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.271899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.272013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.272178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.272206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.272321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.272433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.272462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.272597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.272740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.272770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.272926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.273060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.273085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.273195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.273337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.273366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.273508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.273618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.273647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.273798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.273915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.273941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.274074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.274204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.808 [2024-11-26 05:26:31.274230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.808 qpair failed and we were unable to recover it. 00:30:29.808 [2024-11-26 05:26:31.274332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.274460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.274486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.274587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.274717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.274746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.274886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.275034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.275059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.275154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.275253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.275279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.275440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.275586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.275614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.275732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.275837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.275865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.276013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.276143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.276168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.276298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.276419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.276444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.276551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.276652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.276678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.276783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.276878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.276904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.277028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.277120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.277162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.277279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.277384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.277410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.277518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.277616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.277642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.277767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.277868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.277896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.278013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.278148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.278176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.278322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.278448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.278474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.278637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.278744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.278771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.278874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.279030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.279059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.279214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.279367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.279393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.279498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.279625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.279650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.279811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.279935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.279960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.280059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.280220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.280248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.280394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.280529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.280558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.280711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.280805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.280831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.809 [2024-11-26 05:26:31.280938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.281094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.809 [2024-11-26 05:26:31.281123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.809 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.281230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.281336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.281364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.281468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.281579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.281607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.281755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.281857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.281883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.282036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.282141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.282170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.282305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.282454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.282479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.282583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.282676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.282710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.282874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.282998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.283024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.283152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.283274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.283300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.283418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.283552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.283581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.283738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.283841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.283870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.283996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.284131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.284157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.284270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.284387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.284421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.284563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.284703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.284732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.284842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.284953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.284981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.285106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.285198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.285224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.285336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.285480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.285506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.285604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.285701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.285745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.285901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.286032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.286058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.286182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.286315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.286341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.286522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.286665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.286714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.286855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.287017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.287045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.287196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.287293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.287319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.287450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.287604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.287646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.287808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.287920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.287945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.288071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.288178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.288206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.288386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.288505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.288531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.288653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.288765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.288792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.288948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.289049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.289075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.810 qpair failed and we were unable to recover it. 00:30:29.810 [2024-11-26 05:26:31.289171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.289325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.810 [2024-11-26 05:26:31.289354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.289479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.289587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.289612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.289723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.289831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.289857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.289978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.290084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.290112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.290221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.290362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.290390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.290493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.290614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.290642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.290774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.290874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.290901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.291014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.291193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.291219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.291323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.291444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.291488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.291622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.291728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.291757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.291873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.291974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.292000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.292149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.292294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.292319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.292477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.292617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.292645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.292765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.292941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.292966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.293108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.293208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.293234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.293409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.293525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.293550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.293681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.293776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.293802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.293908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.294011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.294054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.294233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.294338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.294364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.294522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.294635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.294664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.294800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.294913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.294943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.295056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.295234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.295260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.295386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.295504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.295530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.295683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.295832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.295861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.295963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.296072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.296114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.296240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.296346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.296375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.296496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.296624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.296649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.296781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.296957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.296986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.297095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.297233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.297262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.811 qpair failed and we were unable to recover it. 00:30:29.811 [2024-11-26 05:26:31.297377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.297478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.811 [2024-11-26 05:26:31.297507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.297632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.297736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.297763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.297885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.298041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.298066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.298223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.298371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.298399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.298549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.298694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.298723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.298855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.298952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.298982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.299110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.299206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.299250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.299383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.299491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.299519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.299657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.299810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.299836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.299929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.300054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.300080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.300184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.300290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.300316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.300507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.300660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.300692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.300812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.300915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.300941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.301074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.301175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.301200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.301313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.301455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.301484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.301628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.301770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.301805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.301948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.302079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.302108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.302239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.302336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.302361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.302457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.302596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.302621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.302745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.302916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.302942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.303038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.303181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.303210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.303365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.303464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.303490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.303629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.303737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.303765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.303903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.304041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.304069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.304187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.304330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.304358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.304502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.304629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.304655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.304765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.304860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.304885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.304982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.305116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.305145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.305318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.305449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.305474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.812 qpair failed and we were unable to recover it. 00:30:29.812 [2024-11-26 05:26:31.305605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.812 [2024-11-26 05:26:31.305702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.305729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.305871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.305983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.306026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.306124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.306220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.306261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.306381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.306517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.306545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.306662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.306763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.306790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.306972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.307075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.307102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.307232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.307384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.307412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.307520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.307660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.307694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.307853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.307981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.308007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.308169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.308306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.308334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.308441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.308582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.308611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.308747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.308860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.308885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.309040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.309151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.309177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.309303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.309403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.309432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.309573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.309671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.309709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.309851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.309960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.309988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.310107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.310230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.310257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.310381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.310512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.310541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.310647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.310806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.310836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.310980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.311089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.311117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.311271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.311398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.311424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.311543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.311708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.311737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.311876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.312042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.312070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.312214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.312342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.312367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.312465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.312562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.312587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.312693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.312864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.312889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.313016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.313130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.313158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.313306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.313427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.313457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.313582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.313697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.813 [2024-11-26 05:26:31.313723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.813 qpair failed and we were unable to recover it. 00:30:29.813 [2024-11-26 05:26:31.313847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.313958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.313987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.314098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.314232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.314260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.314373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.314494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.314522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.314667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.314823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.314849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.314974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.315074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.315103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.315241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.315411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.315437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.315565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.315693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.315724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.315885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.316014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.316040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.316173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.316287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.316320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.316433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.316574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.316603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.316757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.316881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.316907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.317008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.317112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.317138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.317256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.317358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.317386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.317530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.317633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.317661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.317779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.317879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.317908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.318036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.318137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.318162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.318274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.318436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.318464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.318610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.318750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.318779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.318892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.318998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.319026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.319206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.319341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.319381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.319530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.319664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.319698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.319841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.319992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.320019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.320145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.320266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.320294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.320436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.320536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.320562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.814 qpair failed and we were unable to recover it. 00:30:29.814 [2024-11-26 05:26:31.320683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.814 [2024-11-26 05:26:31.320805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.320834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.320930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.321105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.321131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.321245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.321385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.321413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.321563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.321667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.321701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.321804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.321900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.321925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.322057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.322179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.322207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.322333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.322477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.322506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.322634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.322737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.322763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.322859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.323002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.323031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.323168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.323304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.323333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.323483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.323582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.323607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.323709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.323863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.323889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.324018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.324139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.324165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.324303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.324416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.324444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.324584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.324724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.324753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.324875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.325014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.325040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.325196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.325351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.325379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.325519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.325662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.325701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.325852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.325958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.325986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.326132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.326240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.326265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.326423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.326560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.326589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.326717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.326814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.326839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.326974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.327098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.327126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.327275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.327407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.327433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.327581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.327696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.327725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.327903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.328061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.328086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.328207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.328344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.328372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.328519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.328621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.328646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.328810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.328912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.328938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.815 qpair failed and we were unable to recover it. 00:30:29.815 [2024-11-26 05:26:31.329039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.815 [2024-11-26 05:26:31.329188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.329216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.329359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.329496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.329524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.329699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.329827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.329852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.329972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.330126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.330151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.330281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.330425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.330454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.330556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.330672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.330719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.330841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.330951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.330981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.331084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.331232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.331260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.331404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.331539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.331568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.331671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.331785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.331814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.331940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.332058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.332083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.332191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.332285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.332311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.332407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.332528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.332556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.332659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.332787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.332815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.332947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.333050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.333075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.333178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.333278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.333304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.333431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.333590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.333618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.333761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.333870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.333899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.334032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.334136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.334161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.334311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.334424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.334452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.334557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.334665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.334699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.334880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.334984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.335009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.335106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.335232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.335257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.335403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.335535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.335564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.335729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.335867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.335896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.336010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.336139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.336167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.336316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.336412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.336437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.336567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.336707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.336736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.336878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.336983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.337012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.816 qpair failed and we were unable to recover it. 00:30:29.816 [2024-11-26 05:26:31.337163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.816 [2024-11-26 05:26:31.337263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.337288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.337425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.337520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.337545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.337646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.337747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.337791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.337904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.338011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.338040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.338189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.338325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.338353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.338506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.338606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.338631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.338759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.338926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.338951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.339055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.339182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.339210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.339363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.339521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.339547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.339640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.339744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.339771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.339923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.340030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.340059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.340215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.340344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.340369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.340498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.340597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.340640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.340800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.340939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.340964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.341094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.341200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.341229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.341338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.341445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.341474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.341628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.341764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.341790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.341893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.341986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.342012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.342163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.342295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.342323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.342463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.342630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.342658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.342824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.342917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.342943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.343046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.343200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.343226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.343372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.343491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.343516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.343621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.343719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.343746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.343849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.343950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.343976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.344120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.344221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.344247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.344377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.344552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.344578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.344727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.344892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.344918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.345040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.345152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.817 [2024-11-26 05:26:31.345185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.817 qpair failed and we were unable to recover it. 00:30:29.817 [2024-11-26 05:26:31.345338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.345491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.345533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.345690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.345799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.345825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.345982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.346128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.346156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.346265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.346408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.346436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.346567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.346667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.346713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.346866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.347033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.347060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.347229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.347362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.347387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.347494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.347633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.347663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.347805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.347907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.347933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.348030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.348146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.348175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.348352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.348491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.348521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.348660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.348810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.348839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.348993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.349120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.349146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.349262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.349404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.349432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.349546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.349672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.349708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.349857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.349977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.350005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.350155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.350294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.350319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.350496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.350632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.350660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.350788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.350911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.350936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.351089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.351234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.351263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.351447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.351546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.351572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.351679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.351849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.351876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.352025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.352132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.352160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.352273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.352382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.352412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.352540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.352668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.352702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.818 qpair failed and we were unable to recover it. 00:30:29.818 [2024-11-26 05:26:31.352826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.818 [2024-11-26 05:26:31.352933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.352962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.353061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.353209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.353237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.353378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.353516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.353542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.353670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.353775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.353802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.353923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.354059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.354088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.354230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.354342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.354371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.354481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.354621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.354649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.354782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.354886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.354913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.355025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.355157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.355185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.355321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.355430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.355458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.355567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.355740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.355767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.355896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.356027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.356052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.356218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.356356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.356381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.356527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.356664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.356698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.356808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.356941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.356969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.357085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.357241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.357266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.357417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.357548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.357573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.357750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.357894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.357919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.358018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.358163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.358191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.358330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.358456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.358483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.358645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.358758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.358785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.358921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.359030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.359056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.359153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.359248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.359291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.359469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.359598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.359624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.359766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.359868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.359893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.360032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.360167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.360201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.360341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.360456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.360484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.360609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.360761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.360787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.360912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.361075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.819 [2024-11-26 05:26:31.361103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.819 qpair failed and we were unable to recover it. 00:30:29.819 [2024-11-26 05:26:31.361255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.361354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.361380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.361494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.361640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.361665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.361794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.361915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.361941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.362070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.362225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.362254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.362367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.362498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.362526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.362637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.362785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.362811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.362910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.363042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.363072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.363188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.363373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.363401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.363533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.363671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.363728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.363880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.363979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.364004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.364170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.364274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.364301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.364431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.364574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.364602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.364710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.364854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.364880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.364980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.365076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.365101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.365229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.365328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.365353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.365497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.365611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.365638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.365800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.365931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.365956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.366058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.366199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.366227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.366377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.366507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.366533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.366635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.366784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.366811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.366939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.367089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.367117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.367262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.367402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.367430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.367583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.367710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.367746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.367846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.367999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.368028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.368157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.368294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.368322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.368433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.368577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.368606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.368783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.368912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.368937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.369095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.369252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.369278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.369404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.369551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.820 [2024-11-26 05:26:31.369581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.820 qpair failed and we were unable to recover it. 00:30:29.820 [2024-11-26 05:26:31.369680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.369808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.369833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.369963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.370070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.370096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.370217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.370381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.370409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.370523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.370648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.370673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.370783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.370888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.370913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.371042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.371164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.371190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.371351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.371476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.371501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.371622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.371800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.371826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.371929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.372076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.372105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.372230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.372358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.372384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.372527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.372666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.372703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.372859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.373028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.373055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.373206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.373331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.373359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.373485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.373608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.373634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.373773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.373903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.373929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.374084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.374230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.374258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.374364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.374484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.374512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.374626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.374749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.374775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.374919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.375093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.375121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.375233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.375367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.375395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.375534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.375663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.375717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.375858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.375953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.375978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.376082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.376254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.376283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.376419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.376534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.376562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.376726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.376815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.376840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.376941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.377064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.377089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.377228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.377404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.377429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.377531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.377695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.377721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.377821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.377928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.821 [2024-11-26 05:26:31.377958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.821 qpair failed and we were unable to recover it. 00:30:29.821 [2024-11-26 05:26:31.378091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.378212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.378237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.378353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.378511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.378536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.378716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.378850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.378874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.379036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.379180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.379208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.379337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.379438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.379464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.379610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.379764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.379790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.379929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.380103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.380131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.380272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.380384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.380413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.380537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.380663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.380696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.380846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.380959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.381001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.381125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.381266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.381294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.381471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.381592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.381617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.381775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.381877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.381904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.382029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.382127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.382155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.382268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.382436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.382464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.382629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.382754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.382780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.382919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.383023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.383049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.383167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.383301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.383330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.383462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.383569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.383598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.383729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.383837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.383865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.383976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.384092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.384117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.384246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.384385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.384413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.384547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.384721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.384747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.384885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.384986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.385029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.385180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.385335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.385360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.385484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.385629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.385658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.385808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.385907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.385933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.386110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.386219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.386247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.822 [2024-11-26 05:26:31.386386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.386477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.822 [2024-11-26 05:26:31.386503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.822 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.386625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.386723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.386752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.386928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.387028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.387054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.387162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.387327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.387356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.387477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.387605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.387631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.387740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.387905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.387933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.388047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.388197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.388225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.388367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.388478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.388506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.388646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.388777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.388803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.388944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.389054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.389083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.389198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.389334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.389363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.389466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.389578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.389606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.389773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.389905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.389930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.390057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.390226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.390251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.390425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.390561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.390586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.390730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.390857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.390886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.391041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.391192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.391217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.391345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.391518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.391544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.391647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.391763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.391790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.391898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.392090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.392116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.392243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.392346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.392371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.392525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.392636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.392664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.392788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.392922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.392958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.393099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.393242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.393270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.393415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.393515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.393541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.393653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.393806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.393835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.823 qpair failed and we were unable to recover it. 00:30:29.823 [2024-11-26 05:26:31.393968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.823 [2024-11-26 05:26:31.394106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.394135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.394277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.394440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.394468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.394615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.394723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.394749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.394876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.394984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.395013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.395185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.395331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.395357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.395487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.395593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.395621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.395748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.395850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.395875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.395982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.396124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.396152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.396298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.396403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.396431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.396581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.396704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.396730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.396881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.396979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.397005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.397132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.397225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.397253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.397385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.397494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.397522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.397637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.397780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.397809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.397957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.398085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.398111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.398219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.398365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.398394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.398501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.398628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.398656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.398803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.398939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.398967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.399116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.399254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.399280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.399428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.399541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.399569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.399715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.399859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.399884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.400010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.400113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.400157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.400304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.400434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.400460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.400575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.400710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.400755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.400856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.400988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.401013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.401128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.401273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.401298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.401396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.401524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.401550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.401672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.401820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.401846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.401951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.402145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.824 [2024-11-26 05:26:31.402171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.824 qpair failed and we were unable to recover it. 00:30:29.824 [2024-11-26 05:26:31.402266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.402372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.402399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.402580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.402705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.402731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.402857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.402971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.402999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.403108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.403256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.403285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.403402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.403566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.403594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.403719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.403874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.403900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.404086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.404173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.404198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.404352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.404468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.404497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.404598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.404707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.404737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.404861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.404989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.405015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.405151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.405261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.405289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.405390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.405492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.405521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.405639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.405760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.405789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.405936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.406044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.406070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.406161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.406300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.406343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.406508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.406613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.406655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.406769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.406872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.406898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.407021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.407158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.407184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.407354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.407479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.407510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.407636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.407760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.407789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.407962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.408098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.408124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.408258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.408383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.408408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.408591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.408733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.408764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.408943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.409035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.409060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.409155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.409313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.409338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.409462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.409602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.409631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.409763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.409866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.409892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.410041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.410137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.410162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.410290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.410419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.825 [2024-11-26 05:26:31.410452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.825 qpair failed and we were unable to recover it. 00:30:29.825 [2024-11-26 05:26:31.410587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.410682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.410715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.410862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.411010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.411035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.411131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.411309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.411337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.411452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.411595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.411623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.411765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.411864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.411889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.411996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.412121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.412147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.412274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.412389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.412418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.412530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.412692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.412718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.412851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.412953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.412979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.413137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.413243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.413269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.413394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.413504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.413533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.413648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.413772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.413801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.413923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.414024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.414050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.414192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.414299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.414329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.414471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.414616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.414641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.414748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.414873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.414902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.415018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.415118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.415143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.415268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.415378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.415406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.415545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.415715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.415745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.415911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.416063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.416088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.416220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.416313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.416338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.416479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.416640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.416666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.416798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.416936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.416964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.417080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.417210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.417238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.417390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.417497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.417522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.417674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.417799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.417825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.417932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.418066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.418092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.418196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.418341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.418371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.826 [2024-11-26 05:26:31.418486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.418613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.826 [2024-11-26 05:26:31.418638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.826 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.418752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.418867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.418895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.419035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.419143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.419172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.419290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.419399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.419442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.419544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.419645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.419670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.419795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.419930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.419958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.420108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.420206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.420232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.420337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.420481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.420509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.420631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.420739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.420766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.420902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.421034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.421062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.421176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.421280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.421309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.421455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.421562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.421590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.421718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.421823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.421848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.421995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.422147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.422173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.422328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.422473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.422501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.422609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.422714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.422742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.422874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.422972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.422998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.423130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.423230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.423256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.423360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.423485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.423511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.423610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.423723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.423750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.423851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.423972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.423997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.424090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.424224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.424252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.424400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.424538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.424572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.424683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.424844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.424869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.424968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.425090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.425116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.425245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.425364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.425389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.425510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.425616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.827 [2024-11-26 05:26:31.425644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.827 qpair failed and we were unable to recover it. 00:30:29.827 [2024-11-26 05:26:31.425832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.425928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.425955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.426094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.426233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.426259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.426444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.426548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.426577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.426696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.426811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.426839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.426973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.427083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.427111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.427229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.427333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.427359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.427504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.427653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.427679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.427811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.427939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.427968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.428106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.428253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.428281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.428402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.428496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.428521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.428615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.428766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.428795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.428966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.429104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.429133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.429268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.429382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.429410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.429539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.429632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.429657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.429786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.429893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.429937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.430068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.430184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.430213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.430355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.430505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.430544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.430675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.430787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.430813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.430911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.431090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.431138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.431250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.431364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.431392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.431530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.431631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.431660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.431816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.431943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.431968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.432088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.432217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.432245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.432400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.432539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.432567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.432725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.432824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.432850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.432978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.433086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.433112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.433236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.433369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.433398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.828 qpair failed and we were unable to recover it. 00:30:29.828 [2024-11-26 05:26:31.433506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.433617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.828 [2024-11-26 05:26:31.433646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.433793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.433927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.433955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.434106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.434233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.434258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.434381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.434493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.434522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.434633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.434783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.434813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.434934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.435067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.435095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.435251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.435350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.435376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.435514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.435613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.435641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.435826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.435967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.435996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.436105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.436251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.436279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.436435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.436560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.436586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.436714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.436828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.436856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.437000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.437106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.437135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.437272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.437447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.437473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.437612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.437794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.437821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.437933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.438034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.438059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.438156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.438272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.438301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.438411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.438545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.438573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.438717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.438857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.438882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.439043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.439146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.439175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.439274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.439403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.439445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.439547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.439670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.439703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.439860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.439959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.439984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.440118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.440258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.440287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.440390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.440499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.440528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.440683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.440802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.440828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.440953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.441048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.441074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.441175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.441317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.441345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.441444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.441583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.441611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.829 qpair failed and we were unable to recover it. 00:30:29.829 [2024-11-26 05:26:31.441737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.829 [2024-11-26 05:26:31.441838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.441866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.441997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.442120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.442146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.442264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.442436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.442462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.442559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.442675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.442706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.442814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.442945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.442974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.443074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.443196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.443222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.443348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.443486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.443514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.443709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.443808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.443833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.443962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.444086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.444115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.444232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.444327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.444353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.444496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.444633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.444662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.444851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.444981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.445006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.445127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.445240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.445269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.445394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.445527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.445553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.445708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.445868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.445894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.446049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.446167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.446195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.446355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.446490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.446518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.446645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.446758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.446784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.446881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.447026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.447062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.447183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.447317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.447346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.447455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.447572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.447601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.447732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.447826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.447852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.448003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.448139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.448167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.448338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.448484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.448512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.448627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.448745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.448776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.448899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.449027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.449053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.449199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.449337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.449366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.449506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.449612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.449641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.449795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.449932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-26 05:26:31.449961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.830 qpair failed and we were unable to recover it. 00:30:29.830 [2024-11-26 05:26:31.450095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.450227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.450253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.450407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.450562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.450591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.450700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.450829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.450855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.450956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.451073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.451101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.451288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.451408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.451433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.451553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.451724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.451753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.451875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.452003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.452028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.452170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.452285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.452313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.452441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.452544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.452570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.452679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.452831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.452860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.452977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.453115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.453143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.453275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.453426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.453452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.453608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.453710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.453740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.453892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.454002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.454031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.454173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.454310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.454338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.454469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.454587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.454614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.454776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.454874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.454900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.455015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.455156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.455185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.455332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.455459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.455485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.455590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.455747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.455778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.455943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.456070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.456096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.456246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.456358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.456386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.456518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.456626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.456654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.456808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.456951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.456985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.457120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.457228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.457254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.457375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.457521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.457550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.457692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.457856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.457883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.457980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.458074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.458100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.831 [2024-11-26 05:26:31.458204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.458364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-26 05:26:31.458390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.831 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.458581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.458677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.458711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.458877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.459006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.459032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.459178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.459338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.459366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.459489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.459609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.459634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.459792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.459968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.459997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.460165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.460322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.460348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.460469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.460642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.460670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.460790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.460887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.460913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.461012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.461137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.461166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.461272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.461371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.461413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.461524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.461625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.461650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.461768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.461892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.461918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.462052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.462190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.462219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.462362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.462518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.462547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.462699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.462826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.462852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.462959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.463086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.463111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.463214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.463382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.463411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.463534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.463676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.463715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.463813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.463967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.463993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.464125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.464221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.464248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.464376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.464529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.464555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.464648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.464820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.464846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.464943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.465048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.465076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.465225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.465320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.465346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.832 qpair failed and we were unable to recover it. 00:30:29.832 [2024-11-26 05:26:31.465463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-26 05:26:31.465608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.465636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.465786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.465899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.465928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.466066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.466178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.466209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.466332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.466456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.466483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.466652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.466774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.466804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.466912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.467087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.467113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.467234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.467386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.467412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.467549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.467712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.467739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.467895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.468053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.468101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.468197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.468311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.468341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.468487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.468611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.468641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.468774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.468905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.468930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.469079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.469217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.469245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.469388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.469563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.469588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.469698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.469806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.469832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.469959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.470052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.470077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.470223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.470329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.470360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.470500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.470641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.470670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.470816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.470955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.470984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.471132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.471256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.471281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.471432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.471539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.471572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.471737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.471891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.471916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.472027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.472139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.472168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.472300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.472431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.472457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.472596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.472731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.472759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.472865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.472968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.472997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.473104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.473258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.473284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.473381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.473505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.473531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.473698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.473817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-26 05:26:31.473846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.833 qpair failed and we were unable to recover it. 00:30:29.833 [2024-11-26 05:26:31.473986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.474144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.474170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.474262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.474354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.474380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.474486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.474578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.474604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.474756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.474904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.474930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.475034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.475201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.475230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.475371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.475511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.475540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.475716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.475815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.475841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.475962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.476089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.476115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.476221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.476360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.476389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.476499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.476661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.476697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.476817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.476944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.476970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.477115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.477259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.477287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.477461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.477600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.477628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.477758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.477860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.477889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.478013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.478119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.478146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.478303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.478455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.478480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.478582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.478679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.478732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.478838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.478955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.478981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.479083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.479182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.479208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.479356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.479484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.479513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.479632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.479805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.479831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.479931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.480078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.480107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.480208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.480336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.480361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.480453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.480574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.480600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.480720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.480867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.480896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.481008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.481176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.481202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.481332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.481439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.481465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.481590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.481716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.481745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.834 [2024-11-26 05:26:31.481887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.482015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.834 [2024-11-26 05:26:31.482043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.834 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.482198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.482291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.482318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.482450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.482568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.482593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.482718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.482840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.482868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.482999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.483153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.483178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.483283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.483428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.483457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.483607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.483734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.483761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.483914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.484017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.484045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.484148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.484250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.484280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.484463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.484562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.484587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.484701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.484825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.484851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.484993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.485110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.485140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.485280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.485431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.485457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.485586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.485682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.485735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.485886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.486011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.486040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.486167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.486278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.486307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.486446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.486583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.486612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.486748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.486842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.486869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.486968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.487101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.487126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.487252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.487399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.487428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.487530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.487669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.487710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.487826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.487998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.488024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.488152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.488287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.488313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.488436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.488543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.488571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.488681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.488834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.488863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.488987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.489091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.489120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.489247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.489373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.489399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.489506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.489658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.489693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.489811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.489922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.489950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.835 qpair failed and we were unable to recover it. 00:30:29.835 [2024-11-26 05:26:31.490097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.490187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.835 [2024-11-26 05:26:31.490212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.490317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.490439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.490465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.490582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.490725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.490755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.490903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.491001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.491027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.491119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.491242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.491267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.491364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.491492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.491518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.491642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.491814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.491843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.491978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.492123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.492152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.492317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.492481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.492510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.492625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.492724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.492750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.492873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.493023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.493048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.493194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.493364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.493392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.493528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.493664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.493700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.493865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.493968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.493993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.494151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.494285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.494310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.494408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.494566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.494594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.494764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.494883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.494912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.495085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.495241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.495267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.495392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.495534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.495562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.495695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.495817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.495842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.495966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.496091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.496121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.496267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.496371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.496396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.496511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.496643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.496671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.496821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.496982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.497011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.497117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.497254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.497283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.497445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.497541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.497567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.497698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.497848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.497876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.497991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.498171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.498197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.498298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.498389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.498414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.498573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.498709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.498736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.498838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.498946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.498974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.836 [2024-11-26 05:26:31.499090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.499217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.836 [2024-11-26 05:26:31.499245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.836 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.499360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.499508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.499537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.499665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.499818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.499844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.499972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.500081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.500110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.500226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.500327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.500356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.500518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.500651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.500693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.500820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.500947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.500973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.501075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.501219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.501248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.501384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.501512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.501540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.501651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.501805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.501832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.501982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.502082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.502107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.502259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.502400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.502429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.502545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.502659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.502694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.502805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.502911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.502956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.503074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.503177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.503204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.503363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.503466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.503494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.503635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.503763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.503792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.503935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.504049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.504079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.504211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.504301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.504326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.504429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.504604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.504632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.504744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.504851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.504880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.505017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.505122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.505153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.505332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.505504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.505533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.505648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.505775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.505801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.505942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.506098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.506124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.506284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.506385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.506410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.506532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.506672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.506709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.506856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.506995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.507024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.837 qpair failed and we were unable to recover it. 00:30:29.837 [2024-11-26 05:26:31.507184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.837 [2024-11-26 05:26:31.507282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.507308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.507428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.507572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.507600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.507720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.507827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.507853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.507966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.508121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.508149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.508260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.508414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.508440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.508566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.508713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.508743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.508873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.508973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.508999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.509095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.509212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.509237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.509336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.509509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.509538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.509670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.509784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.509826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.509968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.510097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.510123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.510268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.510376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.510404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.510516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.510670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.510703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.510834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.510926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.510971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.511095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.511254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.511280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.511416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.511562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.511591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.511732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.511836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.511877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.512010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.512109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.512134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.512258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.512359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.512385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.512537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.512654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.512683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.512845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.512986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.513015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.513136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.513243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.513272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.513399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.513534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.513559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.513663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.513779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.513805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.513950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.514066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.514094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.514215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.514362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.514390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.514511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.514612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.514637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.514752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.514857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.514886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.514992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.515106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.515139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.515274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.515407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.515436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.515553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.515717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.515745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.516536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.516660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.516699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.516845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.516965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.838 [2024-11-26 05:26:31.516993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.838 qpair failed and we were unable to recover it. 00:30:29.838 [2024-11-26 05:26:31.517138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.517269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.517295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.517501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.517629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.517663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.517794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.517919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.517954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.518083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.518177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.518203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.518333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.518442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.518476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.518582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.518714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.518746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.518866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.519021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.519054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.519172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.519325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.519352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.519510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.519639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.519695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.519828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.519965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.519990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.520139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.520254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.520284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.520495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.520635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.520664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.520824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.520953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.520980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.521080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.521305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.521335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:29.839 [2024-11-26 05:26:31.521493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.521621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.839 [2024-11-26 05:26:31.521658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:29.839 qpair failed and we were unable to recover it. 00:30:30.130 [2024-11-26 05:26:31.521827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.522001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.522033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.522160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.522280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.522308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.522430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.522534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.522560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.522710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.522846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.522885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.523017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.523151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.523179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.523317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.523430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.523459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.523580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.523676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.523734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.523944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.524055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.524084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.524216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.524361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.524387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.524504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.524601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.524642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.524771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.524874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.524900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.525024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.525137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.525165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.525300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.525409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.525438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.525560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.525671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.525716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.525833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.525935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.525961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.526077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.526190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.526219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.526333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.526434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.526462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.526604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.526751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.526781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.526955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.527051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.527077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.527232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.527327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.527352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.527453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.527550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.527593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.527715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.527877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.527903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.528063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.528168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.528193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.528397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.528543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.528571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.528715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.528821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.528849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.529006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.529104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.529129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.529224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.529331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.529357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.529477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.529582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.529612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.529710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.529805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.529833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.131 [2024-11-26 05:26:31.529948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.530080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.131 [2024-11-26 05:26:31.530108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.131 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.530222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.530348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.530373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.530501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.530614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.530642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.530796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.530905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.530934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.531078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.531183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.531210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.531350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.531448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.531473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.531647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.531823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.531849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.531947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.532071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.532098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.532198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.532354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.532383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.532529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.532658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.532684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.532819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.532950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.532975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.533089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.533234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.533260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.533363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.533494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.533543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.533672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.533780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.533806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.533936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.534104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.534129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.534269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.534360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.534385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.534522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.534640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.534668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.534805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.534897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.534923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.535026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.535124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.535150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.535323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.535459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.535487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.535615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.535741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.535771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.535893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.535988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.536014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.536124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.536250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.536275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.536430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.536543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.536571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.536706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.536844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.536873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.537018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.537122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.537148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.537264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.537370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.537399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.537554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.537643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.537668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.537833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.537956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.537984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.538133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.538261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.538286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.538403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.538513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.538555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.538658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.538768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.538794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.538882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.539009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.539051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.539209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.539313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.539338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.132 qpair failed and we were unable to recover it. 00:30:30.132 [2024-11-26 05:26:31.539471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.132 [2024-11-26 05:26:31.539606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.539634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.539742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.539855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.539881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.540025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.540139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.540169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.540303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.540401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.540427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.540556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.540707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.540736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.540874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.541005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.541033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.541157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.541317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.541345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.541466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.541614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.541642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.541770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.541900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.541925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.542064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.542168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.542196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.542311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.542459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.542484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.542582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.542718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.542745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.542887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.543004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.543039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.543166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.543303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.543332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.543485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.543603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.543628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.543763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.543899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.543924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.544146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.544270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.544311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.544407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.544532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.544559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.544684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.544860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.544888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.545015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.545143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.545168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.545283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.545385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.545416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.545586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.545696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.545747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.545878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.546003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.546028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.546127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.546260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.546285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.546460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.546604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.546632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.546743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.546886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.546914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.547028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.547127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.547155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.547302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.547445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.547470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.547659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.547798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.547824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.547974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.548138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.548171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.548308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.548421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.548449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.548559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.548679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.548714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.548869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.549004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.549032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.133 qpair failed and we were unable to recover it. 00:30:30.133 [2024-11-26 05:26:31.549181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.549311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.133 [2024-11-26 05:26:31.549339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.549437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.549539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.549567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.549698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.549831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.549856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.549973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.550081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.550109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.550266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.550419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.550444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.550573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.550700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.550730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.550883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.551014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.551039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.551192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.551295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.551323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.551460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.551645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.551673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.551843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.551939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.551964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.552105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.552236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.552261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.552381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.552476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.552502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.552647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.552796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.552827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.552940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.553084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.553110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.553236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.553365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.553390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.553533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.553680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.553720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.553856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.554030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.554056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.554157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.554282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.554307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.554440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.554534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.554560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.554701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.554827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.554855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.554959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.555105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.555131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.555228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.555401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.555430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.555574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.555702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.555729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.555887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.556017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.556043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.556219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.556396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.556422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.556542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.556640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.556682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.556836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.556942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.556967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.557082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.557220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.557248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.557387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.557551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.557579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.557756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.557881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.557907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.558032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.558153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.558179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.558297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.558409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.558437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.134 qpair failed and we were unable to recover it. 00:30:30.134 [2024-11-26 05:26:31.558613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.558779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.134 [2024-11-26 05:26:31.558806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.558966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.559084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.559113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.559241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.559367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.559392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.559565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.559722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.559764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.559906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.560073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.560101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.560211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.560357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.560386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.560499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.560600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.560625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.560769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.560877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.560905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.561078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.561220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.561250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.561383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.561519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.561548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.561714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.561863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.561905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.562098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.562218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.562246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.562387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.562529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.562557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.562722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.562844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.562870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.562997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.563118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.563144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.563270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.563423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.563456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.563605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.563784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.563810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.563963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.564114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.564142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.564293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.564394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.564420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.564574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.564713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.564751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.564889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.565037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.565065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.565195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.565359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.565387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.565530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.565631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.565657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.565813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.565921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.565950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.566114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.566209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.566238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.566366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.566519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.566548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.566673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.566819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.566844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.566951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.567048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.567073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.567217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.567346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.567375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.567540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.567675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.567744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.135 qpair failed and we were unable to recover it. 00:30:30.135 [2024-11-26 05:26:31.567865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.135 [2024-11-26 05:26:31.567970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.567996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.568111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.568273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.568301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.568411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.568556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.568600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.568786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.568891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.568918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.569042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.569211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.569254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.569393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.569509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.569535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.569697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.569847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.569875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.570010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.570172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.570200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.570350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.570446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.570472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.570620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.570786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.570816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.570952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.571087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.571115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.571225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.571324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.571352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.571481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.571631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.571656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.571778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.571941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.571969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.572137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.572246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.572276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.572416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.572558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.572586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.572743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.572842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.572869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.573070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.573271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.573296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.573451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.573568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.573596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.573708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.573856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.573884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.574025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.574180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.574205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.574376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.574474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.574500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.574625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.574778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.574808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.574983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.575111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.575136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.575273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.575369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.575394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.575553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.575717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.575748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.575886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.576001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.576030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.576169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.576277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.576305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.576459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.576550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.576575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.576699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.576801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.576827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.577005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.577125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.577156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.577297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.577456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.577484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.577629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.577750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.577776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.577954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.578131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.136 [2024-11-26 05:26:31.578179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.136 qpair failed and we were unable to recover it. 00:30:30.136 [2024-11-26 05:26:31.578350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.578502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.578527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.578659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.578805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.578833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.578987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.579152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.579181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.579325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.579459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.579487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.579626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.579729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.579759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.579939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.580059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.580085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.580221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.580341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.580367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.580515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.580622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.580651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.580761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.580907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.580933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.581052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.581201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.581226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.581352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.581492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.581517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.581677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.581786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.581811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.581936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.582038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.582067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.582234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.582413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.582442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.582558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.582662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.582695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.582799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.582893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.582919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.583077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.583222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.583251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.583385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.583527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.583555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.583699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.583857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.583883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.584042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.584209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.584238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.584402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.584559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.584586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.584736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.584844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.584873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.585056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.585163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.585188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.585292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.585458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.585487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.585633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.585779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.585809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.585974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.586080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.586108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.586254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.586379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.586405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.586568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.586691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.586720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.586862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.587007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.587033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.587178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.587281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.587307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.587432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.587556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.587581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.587752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.587851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.587877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.587997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.588101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.588129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.137 [2024-11-26 05:26:31.588344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.588487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.137 [2024-11-26 05:26:31.588515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.137 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.588660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.588801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.588828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.588977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.589091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.589119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.589257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.589392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.589420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.589586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.589715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.589744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.589892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.589992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.590017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.590150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.590244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.590269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.590403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.590488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.590529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.590670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.590818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.590846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.591025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.591155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.591196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.591353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.591508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.591534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.591683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.591831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.591859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.592034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.592207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.592232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.592358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.592452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.592478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.592646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.592799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.592825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.592959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.593140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.593168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.593316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.593470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.593495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.593645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.593787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.593832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.593987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.594078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.594103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.594230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.594351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.594377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.594477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.594657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.594697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.594854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.594978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.595003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.595127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.595307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.595332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.595458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.595551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.595576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.595781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.595955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.595983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.596098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.596251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.596276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.596458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.596596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.596624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.596796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.596932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.596960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.597102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.597205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.597231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.597385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.597477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.597502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.597650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.597764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.597797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.597935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.598039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.138 [2024-11-26 05:26:31.598067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.138 qpair failed and we were unable to recover it. 00:30:30.138 [2024-11-26 05:26:31.598211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.598369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.598394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.598488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.598591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.598616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.598704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.598845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.598888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.599064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.599197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.599222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.599398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.599538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.599566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.599699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.599829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.599855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.600049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.600177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.600205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.600353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.600482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.600507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.600630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.600752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.600777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.600943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.601039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.601065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.601294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.601446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.601487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.601628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.601789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.601814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.601943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.602071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.602096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.602235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.602337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.602362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.602514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.602616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.602644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.602809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.602936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.602962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.603139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.603281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.603309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.603454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.603608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.603633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.603776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.603953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.603981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.604121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.604237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.604266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.604402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.604538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.604566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.604712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.604853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.604894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.605070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.605232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.605285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.605427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.605592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.605620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.605739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.605852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.605881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.606023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.606179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.606205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.606357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.606503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.606531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.606632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.606760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.606789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.606922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.607070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.607100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.607224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.607377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.607402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.607558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.607701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.607730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.607831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.607965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.607993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.139 qpair failed and we were unable to recover it. 00:30:30.139 [2024-11-26 05:26:31.608131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.139 [2024-11-26 05:26:31.608281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.608307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.608431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.608555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.608580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.608736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.608866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.608892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.609019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.609139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.609168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.609268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.609408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.609436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.609562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.609732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.609759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.609940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.610058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.610086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.610223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.610381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.610406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.610537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.610660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.610693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.610797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.610924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.610951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.611064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.611238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.611264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.611356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.611505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.611533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.611681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.611808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.611834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.611961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.612088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.612114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.612224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.612369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.612394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.612518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.612635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.612664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.612824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.612973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.612998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.613136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.613231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.613260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.613355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.613449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.613474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.613576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.613699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.613726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.613873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.613981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.614009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.614158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.614292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.614318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.614440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.614574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.614616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.614769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.614918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.614946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.615060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.615199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.615228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.615353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.615484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.615509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.615657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.615846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.615872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.616004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.616164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.616190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.616322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.616417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.616461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.616588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.616695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.616722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.616892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.617021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.617049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.617196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.617349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.617374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.617524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.617639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.617666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.617807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.617934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.140 [2024-11-26 05:26:31.617958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.140 qpair failed and we were unable to recover it. 00:30:30.140 [2024-11-26 05:26:31.618099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.618232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.618260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.618403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.618503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.618528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.618700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.618862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.618888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.618994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.619115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.619140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.619302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.619423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.619451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.619617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.619762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.619789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.619915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.620064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.620092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.620241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.620368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.620394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.620545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.620708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.620737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.620876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.620998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.621040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.621172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.621313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.621341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.621491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.621619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.621644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.621803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.621944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.621970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.622098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.622226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.622251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.622380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.622477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.622502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.622623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.622740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.622766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.622917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.623018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.623046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.623150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.623297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.623323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.623443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.623588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.623616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.623773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.623860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.623885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.623994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.624130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.624159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.624311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.624435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.624461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.624608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.624719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.624747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.624862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.624987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.625013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.625138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.625322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.625351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.625515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.625653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.625681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.625813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.625930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.625958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.626109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.626232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.626258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.626387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.626516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.626541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.626692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.626798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.626826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.626928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.627077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.627103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.627259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.627389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.627432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.627531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.627673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.627746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.141 [2024-11-26 05:26:31.627883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.627999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.141 [2024-11-26 05:26:31.628027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.141 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.628175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.628284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.628317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.628467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.628570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.628596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.628743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.628950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.628975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.629105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.629244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.629272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.629412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.629551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.629579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.629706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.629869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.629895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.630092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.630232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.630260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.630391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.630486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.630514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.630622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.630756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.630785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.630934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.631055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.631081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.631178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.631302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.631333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.631474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.631604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.631633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.631761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.631866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.631895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.632012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.632167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.632193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.632343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.632473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.632502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.632672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.632788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.632816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.632930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.633066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.633094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.633230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.633382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.633407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.633569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.633717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.633746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.633878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.634020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.634048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.634177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.634271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.634300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.634439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.634599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.634625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.634820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.634928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.634957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.635065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.635182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.635208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.635330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.635479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.635507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.635625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.635744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.635770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.635917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.636038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.636063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.636188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.636284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.636327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.142 qpair failed and we were unable to recover it. 00:30:30.142 [2024-11-26 05:26:31.636496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.636631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.142 [2024-11-26 05:26:31.636660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.636804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.636935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.636960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.637075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.637210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.637238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.637352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.637449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.637477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.637614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.637801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.637827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.637951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.638081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.638106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.638203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.638326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.638351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.638444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.638566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.638610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.638777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.638909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.638937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.639050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.639177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.639203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.639310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.639436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.639462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.639610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.639761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.639787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.639943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.640090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.640116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.640255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.640387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.640414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.640589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.640729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.640758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.640860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.641005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.641031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.641154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.641297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.641327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.641466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.641590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.641616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.641795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.641901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.641930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.642086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.642216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.642241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.642398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.642515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.642544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.642698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.642803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.642828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.643001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.643254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.643279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.643410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.643557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.643586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.643755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.643887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.643913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.644037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.644198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.644239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.644356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.644524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.644552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.644696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.644815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.644841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.644934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.645088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.645116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.645244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.645374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.645400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.645544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.645683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.645721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.645868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.645994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.646019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.646191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.646300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.646328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.143 [2024-11-26 05:26:31.646478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.646576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.143 [2024-11-26 05:26:31.646605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.143 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.646792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.646895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.646920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.647092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.647278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.647330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.647436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.647573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.647601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.647770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.647867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.647892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.648069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.648199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.648226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.648380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.648535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.648561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.648699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.648793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.648822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.648955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.649112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.649138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.649287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.649401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.649431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.649594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.649727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.649756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.649933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.650101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.650156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.650284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.650409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.650434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.650552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.650696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.650725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.650826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.650962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.650990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.651132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.651240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.651270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.651423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.651555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.651580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.651714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.651854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.651883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.652024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.652190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.652219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.652328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.652468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.652497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.652640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.652764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.652790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.652939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.653101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.653129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.653267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.653433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.653461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.653611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.653746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.653775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.653923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.654029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.654055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.654148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.654248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.654275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.654388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.654540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.654568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.654701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.654841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.654867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.654970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.655067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.655094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.655197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.655325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.655350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.655491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.655623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.655651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.655801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.655900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.655926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.656024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.656155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.656180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.144 qpair failed and we were unable to recover it. 00:30:30.144 [2024-11-26 05:26:31.656307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.656407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.144 [2024-11-26 05:26:31.656435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.656555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.656720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.656749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.656857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.656964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.656993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.657138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.657232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.657257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.657392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.657496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.657525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.657698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.657805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.657834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.657951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.658086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.658114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.658237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.658336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.658362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.658497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.658650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.658678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.658828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.658964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.658993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.659107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.659220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.659248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.659393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.659518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.659544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.659657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.659781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.659826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.659977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.660087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.660115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.660230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.660383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.660408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.660513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.660639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.660665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.660803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.660945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.660973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.661095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.661235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.661260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.661357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.661449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.661478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.661570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.661697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.661735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.661849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.661954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.661982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.662164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.662265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.662292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.662400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.662543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.662571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.662693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.662798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.662823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.662949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.663074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.663102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.663205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.663290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.663316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.663409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.663527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.663553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.663723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.663846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.663872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.664005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.664109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.664138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.664294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.664393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.664419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.664514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.664656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.664693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.664843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.664938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.664963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.665125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.665226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.665252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.665375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.665491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.665519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.145 qpair failed and we were unable to recover it. 00:30:30.145 [2024-11-26 05:26:31.665619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.145 [2024-11-26 05:26:31.665762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.665792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.665931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.666024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.666049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.666149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.666280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.666309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.666446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.666552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.666580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.666729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.666865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.666893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.667040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.667128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.667153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.667286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.667384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.667409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.667522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.667659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.667710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.667830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.667946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.667975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.668104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.668205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.668230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.668334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.668461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.668489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.668625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.668757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.668787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.668897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.669050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.669079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.669210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.669334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.669359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.669471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.669571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.669597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.669720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.669825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.669854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.669952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.670091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.670121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.670286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.670404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.670429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.670578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.670700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.670728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.670848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.670948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.670977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.671078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.671213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.671242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.671390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.671490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.671516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.671667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.671784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.671814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.671949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.672058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.672088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.672207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.672362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.672387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.672525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.672701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.672745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.672876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.672993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.673025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.673134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.673272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.673300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.673402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.673509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.673538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.673697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.673828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.673854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.146 qpair failed and we were unable to recover it. 00:30:30.146 [2024-11-26 05:26:31.673956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.674079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.146 [2024-11-26 05:26:31.674124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.674261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.674371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.674399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.674536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.674672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.674709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.674830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.674951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.674978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.675075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.675221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.675249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.675391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.675487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.675517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.675645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.675832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.675863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.676012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.676115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.676141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.676241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.676350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.676394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.676511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.676619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.676663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.676799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.676947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.676976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.677113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.677240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.677265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.677382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.677511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.677540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.677647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.677755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.677785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.677949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.678050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.678076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.678205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.678330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.678356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.678477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.678584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.678612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.678750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.678878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.678904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.679030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.679149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.679178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.679353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.679456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.679482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.679629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.679762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.679790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.679982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.680140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.680165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.680315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.680424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.680452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.680593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.680692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.680719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.680866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.681041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.681093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.681214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.681366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.681391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.681503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.681627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.681670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.681802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.681904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.681930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.682061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.682167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.682196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.682345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.682476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.682502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.682626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.682760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.682788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.682896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.683019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.683045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.683134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.683270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.683298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.683400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.683578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.147 [2024-11-26 05:26:31.683603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.147 qpair failed and we were unable to recover it. 00:30:30.147 [2024-11-26 05:26:31.683714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.683876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.683901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.684060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.684154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.684179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.684321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.684454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.684482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.684619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.684789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.684818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.684938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.685053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.685081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.685192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.685320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.685346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.685459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.685599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.685628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.685793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.685896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.685925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.686025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.686121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.686149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.686303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.686401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.686428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.686555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.686723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.686752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.686890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.687007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.687035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.687172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.687290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.687320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.687445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.687573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.687599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.687727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.687871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.687897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.688027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.688173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.688201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.688309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.688452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.688481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.688594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.688717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.688759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.688880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.688995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.689025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.689164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.689271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.689299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.689438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.689551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.689592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.689731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.689840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.689866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.690005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.690140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.690174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.690324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.690447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.690473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.690612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.690750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.690779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.690963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.691084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.691126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.691241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.691358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.691400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.691499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.691597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.691623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.691728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.691896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.691924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.692076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.692175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.692201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.692318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.692476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.692518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.692633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.692783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.692810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.692930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.693048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.693081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.148 qpair failed and we were unable to recover it. 00:30:30.148 [2024-11-26 05:26:31.693213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.148 [2024-11-26 05:26:31.693303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.693328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.693431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.693578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.693606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.693712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.693850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.693878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.694065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.694159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.694185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.694335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.694467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.694511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.694621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.694736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.694765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.694903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.695044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.695072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.695239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.695374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.695399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.695501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.695622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.695647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.695803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.695906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.695934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.696047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.696139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.696168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.696276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.696389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.696417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.696571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.696700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.696726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.696856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.696986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.697014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.697176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.697282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.697311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.697421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.697551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.697579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.697753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.697883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.697926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.698065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.698201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.698230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.698338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.698479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.698508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.698639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.698777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.698806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.698938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.699036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.699063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.699228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.699367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.699396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.699571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.699719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.699749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.699895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.700009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.700035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.700173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.700293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.700318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.700465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.700608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.700637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.700785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.700897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.700926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.701068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.701182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.701210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.701362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.701456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.701481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.701609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.701734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.701763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.701893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.702000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.702029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.702170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.702310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.702338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.702484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.702594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.702619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.702715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.702841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.702866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.149 qpair failed and we were unable to recover it. 00:30:30.149 [2024-11-26 05:26:31.703013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.149 [2024-11-26 05:26:31.703150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.703180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.703327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.703476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.703501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.703630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.703755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.703782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.703893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.704015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.704043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.704175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.704283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.704311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.704452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.704570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.704599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.704749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.704855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.704881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.705029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.705169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.705198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.705358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.705472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.705500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.705613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.705723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.705752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.705869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.705990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.706015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.706129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.706235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.706263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.706405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.706534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.706562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.706675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.706809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.706837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.706964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.707116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.707142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.707286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.707423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.707451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.707555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.707675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.707744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.707867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.708004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.708032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.708208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.708310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.708336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.708461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.708609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.708635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.708747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.708850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.708875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.708999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.709129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.709157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.709310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.709409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.709434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.709596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.709700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.709740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.709853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.709980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.710009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.710110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.710230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.710257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.710386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.710483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.710508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.710638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.710783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.710813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.710947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.711077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.711105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.711214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.711356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.150 [2024-11-26 05:26:31.711384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.150 qpair failed and we were unable to recover it. 00:30:30.150 [2024-11-26 05:26:31.711508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.711620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.711645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.711773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.711906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.711934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.712072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.712238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.712267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.712379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.712503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.712530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.712630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.712777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.712804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.712928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.713044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.713073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.713176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.713314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.713342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.713481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.713587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.713615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.713759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.713873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.713898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.713996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.714092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.714117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.714261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.714392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.714421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.714572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.714664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.714697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.714806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.714935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.714960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.715073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.715190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.715219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.715332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.715501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.715530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.715684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.715864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.715889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.715982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.716107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.716132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.716289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.716402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.716431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.716536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.716651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.716677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.716789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.716918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.716947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.717124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.717257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.717299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.717451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.717558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.717586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.717699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.717805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.717833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.717947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.718049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.718076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.718204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.718312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.718337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.718432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.718578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.718606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.718714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.718892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.718917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.719012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.719188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.719217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.719335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.719460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.719485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.719634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.719761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.719790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.719893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.719990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.720019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.720157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.720265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.720294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.720446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.720581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.720606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.151 [2024-11-26 05:26:31.720725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.720848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.151 [2024-11-26 05:26:31.720876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.151 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.721015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.721160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.721185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.721303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.721426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.721452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.721591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.721720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.721746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.721849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.721998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.722060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.722172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.722308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.722336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.722475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.722610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.722638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.722823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.722933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.722975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.723085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.723234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.723259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.723385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.723527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.723555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.723657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.723819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.723849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.723973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.724069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.724095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.724217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.724321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.724349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.724448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.724588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.724614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.724707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.724855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.724884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.725013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.725109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.725135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.725309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.725420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.725447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.725561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.725740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.725766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.725891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.726017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.726045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.726223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.726320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.726346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.726444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.726567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.726609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.726746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.726857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.726885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.726998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.727110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.727140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.727269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.727394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.727419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.727514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.727625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.727654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.727801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.727893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.727919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.728062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.728171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.728199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.728310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.728408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.728434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.728537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.728629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.728655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.728819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.728909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.728935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.729037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.729218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.729260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.729361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.729482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.729512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.729643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.729803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.729829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.729955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.730069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.730098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.152 qpair failed and we were unable to recover it. 00:30:30.152 [2024-11-26 05:26:31.730211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.152 [2024-11-26 05:26:31.730329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.730355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.730459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.730568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.730593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.730683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.730823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.730852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.730958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.731077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.731106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.731285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.731391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.731416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.731535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.731659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.731696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.731805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.731894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.731920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.732026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.732118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.732162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.732313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.732442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.732467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.732555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.732693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.732719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.732830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.732940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.732968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.733102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.733207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.733235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.733348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.733447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.733476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.733616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.733710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.733737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.733917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.734028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.734056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.734158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.734313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.734339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.734471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.734598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.734626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.734769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.734879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.734904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.735035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.735174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.735202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.735343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.735453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.735482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.735618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.735738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.735768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.735890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.735988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.736018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.736118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.736263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.736291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.736429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.736537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.736565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.736718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.736856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.736886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.737016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.737109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.737134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.737245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.737351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.737379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.737478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.737615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.737643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.737769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.737909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.737938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.738083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.738208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.738234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.738362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.738493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.738522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.738659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.738783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.738820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.738940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.739040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.739068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.739207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.739361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.153 [2024-11-26 05:26:31.739386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.153 qpair failed and we were unable to recover it. 00:30:30.153 [2024-11-26 05:26:31.739604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.739736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.739764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.739921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.740024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.740052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.740208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.740302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.740328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.740427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.740577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.740602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.740727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.740876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.740904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.741039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.741175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.741203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.741320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.741447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.741472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.741581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.741692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.741721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.741845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.741961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.741990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.742108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.742297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.742323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.742417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.742542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.742570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.742696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.742802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.742827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.742928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.743066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.743095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.743238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.743376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.743404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.743518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.743615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.743643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.743777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.743871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.743897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.744001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.744123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.744149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.744292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.744438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.744464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.744577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.744681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.744725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.744857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.744982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.745007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.745103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.745192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.745217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.745314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.745450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.745479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.745616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.745744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.745771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.745877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.746001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.746029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.746134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.746242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.746268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.746368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.746490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.746516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.746613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.746749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.746778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.746928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.747058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.747083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.747212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.747322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.747352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.747496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.747599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.154 [2024-11-26 05:26:31.747627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.154 qpair failed and we were unable to recover it. 00:30:30.154 [2024-11-26 05:26:31.747750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.747850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.747876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.748009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.748113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.748139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.748267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.748363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.748389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.748485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.748572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.748597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.748696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.748807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.748833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.748924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.749046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.749072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.749207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.749347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.749375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.749483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.749613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.749642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.749803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.749932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.749972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.750147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.750246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.750273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.750434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.750556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.750581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.750724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.750868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.750897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.751033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.751178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.751207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.751362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.751471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.751497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.751625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.751742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.751771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.751944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.752056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.752084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.752205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.752340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.752368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.752490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.752633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.752677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.752859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.752983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.753016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.753154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.753290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.753318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.753453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.753554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.753583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.753736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.753842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.753868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.753998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.754109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.754137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.754242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.754341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.754370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.754472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.754623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.754651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.754822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.754947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.754973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.755121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.755225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.755253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.755445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.755556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.755585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.755714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.755825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.755850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.756008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.756108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.756136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.756246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.756372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.756398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.756574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.756751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.756778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.756934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.757054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.757080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.155 [2024-11-26 05:26:31.757237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.757407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.155 [2024-11-26 05:26:31.757436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.155 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.757590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.757716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.757742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.757896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.758046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.758075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.758188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.758372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.758398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.758526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.758633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.758659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.758854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.758940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.758966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.759069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.759222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.759247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.759409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.759536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.759562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.759654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.759810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.759836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.759964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.760154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.760180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.760285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.760408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.760433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.760541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.760682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.760739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.760853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.760959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.760985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.761089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.761234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.761259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.761388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.761508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.761537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.761678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.761800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.761829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.761957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.762053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.762079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.762203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.762346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.762375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.762525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.762652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.762678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.762836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.762976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.763002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.763152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.763250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.763276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.763372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.763467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.763492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.763612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.763705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.763732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.763833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.763959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.764002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.764153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.764258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.764285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.764434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.764584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.764610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.764743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.764898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.764927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.765034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.765144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.765173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.765326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.765429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.765454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.765582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.765716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.765745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.765889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.766015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.766042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.766173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.766302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.766328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.766450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.766579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.766604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.766759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.766865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.766894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.156 qpair failed and we were unable to recover it. 00:30:30.156 [2024-11-26 05:26:31.767048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.156 [2024-11-26 05:26:31.767197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.767223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.767377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.767515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.767543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.767663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.767828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.767860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.768009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.768112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.768138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.768285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.768393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.768423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.768599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.768719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.768755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.768907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.769034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.769060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.769198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.769350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.769376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.769502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.769658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.769684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.769852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.769999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.770026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.770158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.770287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.770313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.770457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.770613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.770639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.770744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.770894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.770923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.771044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.771150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.771179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.771310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.771399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.771425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.771528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.771671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.771707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.771819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.771934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.771977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.772104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.772248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.772291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.772416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.772538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.772564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.772702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.772812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.772841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.772943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.773049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.773078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.773199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.773314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.773340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.773466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.773595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.773620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.773759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.773905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.773934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.774072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.774177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.774207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.774325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.774465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.774493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.774616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.774759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.774786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.774888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.774988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.775014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.775138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.775282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.775324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.775448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.775549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.775574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.775665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.775771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.775797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.775901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.776028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.776070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.776185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.776303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.776331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.776474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.776644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.776669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.157 qpair failed and we were unable to recover it. 00:30:30.157 [2024-11-26 05:26:31.776810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.157 [2024-11-26 05:26:31.776937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.776964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.777125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.777263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.777292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.777392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.777541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.777567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.777698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.777798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.777824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.777948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.778075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.778101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.778210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.778363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.778391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.778529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.778647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.778675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.778792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.778908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.778936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.779086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.779184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.779210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.779327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.779483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.779509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.779634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.779766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.779792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.779894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.780039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.780068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.780211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.780348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.780373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.780517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.780719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.780746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.780872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.781018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.781060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.781169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.781318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.781346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.781473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.781612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.781637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.781771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.781883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.781912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.782063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.782169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.782195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.782320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.782448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.782482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.782611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.782703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.782730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.782858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.783016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.783064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.783173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.783342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.783368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.783496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.783621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.783646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.783819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.783920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.783945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.784093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.784241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.784266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.784364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.784491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.784517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.784625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.784728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.784755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.784879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.784985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.785011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.158 [2024-11-26 05:26:31.785142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.785263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.158 [2024-11-26 05:26:31.785289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.158 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.785435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.785621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.785647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.785759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.785876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.785904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.786035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.786163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.786188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.786282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.786381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.786408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.786530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.786678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.786713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.786848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.786989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.787015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.787147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.787282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.787308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.787454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.787604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.787630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.787759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.787854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.787879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.787979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.788081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.788107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.788221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.788375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.788400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.788552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.788677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.788722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.788820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.788961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.788989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.789137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.789244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.789269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.789365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.789452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.789477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.789626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.789729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.789759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.789910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.790012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.790038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.790140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.790275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.790318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.790430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.790527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.790553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.790645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.790794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.790820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.790950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.791102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.791131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.791272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.791449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.791475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.791601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.791725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.791751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.791856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.791996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.792024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.792169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.792271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.792296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.792383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.792484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.792510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.792609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.792716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.792742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.792858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.792964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.792992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.793107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.793241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.793270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.793406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.793548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.793574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.793713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.793846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.793871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.793988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.794126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.794154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.794275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.794372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.794398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.159 qpair failed and we were unable to recover it. 00:30:30.159 [2024-11-26 05:26:31.794502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.794594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.159 [2024-11-26 05:26:31.794619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.794814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.794908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.794933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.795050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.795196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.795221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.795350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.795451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.795476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.795597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.795719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.795746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.795853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.795974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.796000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.796152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.796278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.796303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.796423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.796549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.796579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.796704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.796860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.796885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.796986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.797091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.797117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.797245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.797345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.797372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.797492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.797587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.797612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.797719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.797807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.797833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.797951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.798049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.798076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.798183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.798281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.798307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.798432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.798530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.798556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.798661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.798783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.798812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.798956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.799063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.799093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.799197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.799338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.799365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.799495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.799609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.799650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.799772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.799901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.799927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.800058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.800181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.800208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.800336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.800498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.800527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.800662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.800782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.800811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.800958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.801137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.801163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.801264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.801388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.801413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.801531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.801668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.801706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.801810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.801940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.801968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.802111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.802224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.802252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.802367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.802517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.802542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.802672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.802855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.802881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.803007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.803124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.803152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.803301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.803392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.803418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.160 qpair failed and we were unable to recover it. 00:30:30.160 [2024-11-26 05:26:31.803546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.160 [2024-11-26 05:26:31.803671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.803704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.803826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.803913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.803956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.804089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.804198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.804226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.804337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.804447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.804475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.804603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.804738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.804766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.804902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.805010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.805039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.805179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.805282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.805310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.805443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.805582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.805624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.805758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.805845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.805871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.805992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.806121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.806149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.806256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.806366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.806394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.806540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.806658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.806694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.806851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.806984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.807010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.807111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.807200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.807225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.807369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.807474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.807502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.807640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.807784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.807813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.807937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.808040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.808066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.808214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.808308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.808350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.808449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.808596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.808624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.808731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.808833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.808861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.808983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.809087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.809113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.809220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.809352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.809377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.809525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.809638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.809666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.809792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.809911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.809939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.810064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.810167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.810192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.810335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.810485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.810511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.810663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.810808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.810838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.810996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.811123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.811149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.811249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.811412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.811437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.811552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.811658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.811693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.811844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.811978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.812003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.812150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.812255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.812285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.812463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.812567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.812596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.812751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.812872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.161 [2024-11-26 05:26:31.812897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.161 qpair failed and we were unable to recover it. 00:30:30.161 [2024-11-26 05:26:31.813035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.813184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.813212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.813343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.813445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.813478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.813602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.813708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.813735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.813880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.814018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.814046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.814153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.814294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.814322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.814471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.814571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.814596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.814752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.814844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.814870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.814994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.815160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.815189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.815370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.815496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.815522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.815672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.815789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.815817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.815947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.816071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.816097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.816197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.816320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.816345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.816520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.816653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.816682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.816831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.816964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.816992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.817159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.817312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.817355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.817491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.817600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.817628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.817735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.817850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.817878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.817990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.818122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.818150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.818301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.818424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.818449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.818601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.818732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.818758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.818859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.819005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.819034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.819188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.819313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.819339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.819430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.819547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.819573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.819695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.819813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.819841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.819988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.820118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.820143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.820291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.820428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.820456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.820629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.820760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.820786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.820914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.821081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.821131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.821267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.821406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.821435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.821605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.821748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.821777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.162 qpair failed and we were unable to recover it. 00:30:30.162 [2024-11-26 05:26:31.821894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.162 [2024-11-26 05:26:31.821995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.822021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.822196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.822344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.822369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.822527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.822639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.822668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.822818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.822954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.822983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.823123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.823253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.823279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.823406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.823503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.823546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.823692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.823839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.823865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.823965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.824128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.824154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.824248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.824339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.824366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.824515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.824681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.824742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.824905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.825083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.825109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.825232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.825368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.825394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.825486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.825614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.825640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.825775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.825906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.825932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.826049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.826220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.826245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.826398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.826537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.826566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.826695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.826819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.826844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.826960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.827084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.827111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.827219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.827381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.827409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.827504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.827667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.827708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.827832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.827955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.827981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.828171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.828273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.828299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.828396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.828543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.828590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.828743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.828863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.828891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.829040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.829195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.829220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.829346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.829448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.829475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.829583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.829743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.829769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.829867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.829967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.829992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.830121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.830269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.830310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.830414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.830576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.830604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.830751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.830872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.830898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.831073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.831272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.831323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.831472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.831596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.831622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.831763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.831900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.831928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.163 qpair failed and we were unable to recover it. 00:30:30.163 [2024-11-26 05:26:31.832039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.163 [2024-11-26 05:26:31.832151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.832194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.832322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.832450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.832476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.832573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.832699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.832726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.832874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.832997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.833053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.833187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.833287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.833316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.833456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.833584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.833612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.833755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.833876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.833902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.834032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.834194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.834222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.834398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.834492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.834518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.834697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.834836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.834864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.835018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.835137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.835163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.835282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.835414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.835443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.835608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.835722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.835751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.835878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.836046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.836075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.836220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.836370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.836396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.836513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.836646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.836675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.836859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.836994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.837024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.837135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.837307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.837335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.837478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.837599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.837625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.837815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.837910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.837935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.838058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.838203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.838231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.838412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.838537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.838562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.838733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.838829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.838855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.838982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.839106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.839131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.839258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.839353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.839396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.839511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.839671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.839707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.839861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.840005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.840030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.840163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.840267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.840296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.840409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.840552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.840577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.840741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.840858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.840887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.841073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.841171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.841197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.841346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.841452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.841480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.841592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.841734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.841763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.841867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.841985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.164 [2024-11-26 05:26:31.842014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.164 qpair failed and we were unable to recover it. 00:30:30.164 [2024-11-26 05:26:31.842168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.842294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.842320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.842468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.842571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.842599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.842735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.842849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.842875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.843005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.843135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.843160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.843293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.843419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.843444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.843570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.843740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.843774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.843870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.844013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.844042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.844211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.844384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.844412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.844536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.844658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.844683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.844826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.844929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.844973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.845115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.845247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.845294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.845418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.845593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.845621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.845735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.845868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.845893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.846066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.846248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.846303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.846466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.846577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.846606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.846743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.846845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.846875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.847008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.847101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.847126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.847251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.847385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.847413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.847522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.847627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.847655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.847814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.847944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.847971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.848093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.848223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.848248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.848397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.848518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.848546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.848713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.848807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.848832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.848986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.849092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.849120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.849268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.849372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.849397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.849539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.849718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.849747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.849893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.850064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.850089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.850244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.850356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.850385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.850551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.850676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.850710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.850872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.851050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.851075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.851211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.851336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.851362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.851530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.851671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.851707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.851851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.851977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.852003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.165 [2024-11-26 05:26:31.852163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.852277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.165 [2024-11-26 05:26:31.852305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.165 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.852411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.852557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.852582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.852715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.852878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.852907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.853040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.853196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.853222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.853348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.853454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.853482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.853609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.853772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.853801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.853901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.854042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.854070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.854190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.854319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.854345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.854490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.854596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.854624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.854770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.854896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.854922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.855043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.855210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.855239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.855374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.855496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.855522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.855767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.855895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.855921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.856016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.856169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.856199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.856334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.856516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.856541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.856721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.856840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.856865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.857048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.857148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.857176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.857289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.857406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.857434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.857581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.857680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.857715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.857838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.857961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.857986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.858159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.858289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.858317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.858488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.858628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.858654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.858764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.858887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.858912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.859044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.859152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.859178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.859325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.859475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.859501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.859640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.859765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.859794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.859928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.860065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.860093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.860239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.860355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.860380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.860527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.860656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.860684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.860823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.860961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.860990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.166 [2024-11-26 05:26:31.861134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.861259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.166 [2024-11-26 05:26:31.861287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.166 qpair failed and we were unable to recover it. 00:30:30.167 [2024-11-26 05:26:31.861458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.861605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.861630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.167 qpair failed and we were unable to recover it. 00:30:30.167 [2024-11-26 05:26:31.861746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.861881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.861909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.167 qpair failed and we were unable to recover it. 00:30:30.167 [2024-11-26 05:26:31.862026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.862193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.862225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.167 qpair failed and we were unable to recover it. 00:30:30.167 [2024-11-26 05:26:31.862334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.862467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.862494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.167 qpair failed and we were unable to recover it. 00:30:30.167 [2024-11-26 05:26:31.862645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.862751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.862778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.167 qpair failed and we were unable to recover it. 00:30:30.167 [2024-11-26 05:26:31.862944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.863051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.863076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.167 qpair failed and we were unable to recover it. 00:30:30.167 [2024-11-26 05:26:31.863197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.863338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.167 [2024-11-26 05:26:31.863366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.167 qpair failed and we were unable to recover it. 00:30:30.454 [2024-11-26 05:26:31.863495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.454 [2024-11-26 05:26:31.863632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.454 [2024-11-26 05:26:31.863661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.454 qpair failed and we were unable to recover it. 00:30:30.454 [2024-11-26 05:26:31.863823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.454 [2024-11-26 05:26:31.863949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.454 [2024-11-26 05:26:31.863974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.454 qpair failed and we were unable to recover it. 00:30:30.454 [2024-11-26 05:26:31.864091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.454 [2024-11-26 05:26:31.864209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.454 [2024-11-26 05:26:31.864237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.454 qpair failed and we were unable to recover it. 00:30:30.454 [2024-11-26 05:26:31.864371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.454 [2024-11-26 05:26:31.864518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.454 [2024-11-26 05:26:31.864543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.454 qpair failed and we were unable to recover it. 00:30:30.454 [2024-11-26 05:26:31.864698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.454 [2024-11-26 05:26:31.864821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.454 [2024-11-26 05:26:31.864849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.454 qpair failed and we were unable to recover it. 00:30:30.454 [2024-11-26 05:26:31.864993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.454 [2024-11-26 05:26:31.865098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.454 [2024-11-26 05:26:31.865123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.454 qpair failed and we were unable to recover it. 00:30:30.454 [2024-11-26 05:26:31.865219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.865367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.865393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.865495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.865607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.865636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.865747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.865916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.865944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.866083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.866177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.866203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.866386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.866484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.866512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.866650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.866799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.866828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.866943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.867055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.867083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.867208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.867324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.867350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.867489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.867619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.867647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.867767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.867909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.867937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.868107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.868222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.868251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.868383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.868501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.868527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.868644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.868805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.868831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.868955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.869109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.869137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.869270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.869379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.869407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.869569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.869696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.869722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.869866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.869982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.870010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.870144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.870277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.870307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.870448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.870579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.870604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.870738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.870892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.870934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.871081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.871249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.871275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.871405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.871525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.871554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.871720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.871871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.871901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.872051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.872178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.872203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.872360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.872513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.872538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.872699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.872854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.872879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.873006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.873177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.873205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.873320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.873473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.873498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.455 qpair failed and we were unable to recover it. 00:30:30.455 [2024-11-26 05:26:31.873614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.455 [2024-11-26 05:26:31.873802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.873854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.873997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.874160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.874189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.874322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.874482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.874508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.874609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.874736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.874762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.874888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.875043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.875072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.875236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.875377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.875405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.875516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.875653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.875682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.875840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.875976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.876002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.876126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.876275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.876303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.876410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.876539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.876568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.876684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.876859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.876885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.876989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.877108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.877134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.877284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.877427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.877460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.877630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.877795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.877825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.877963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.878102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.878131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.878308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.878460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.878504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.878637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.878796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.878823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.878977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.879122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.879150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.879286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.879448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.879476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.879646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.879784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.879810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.879941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.880111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.880168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.880337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.880447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.880475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.880625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.880749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.880776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.880930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.881018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.881044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.881258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.881447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.881476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.881620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.881747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.881777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.881888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.882049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.882076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.882231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.882323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.882349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.456 [2024-11-26 05:26:31.882466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.882572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.456 [2024-11-26 05:26:31.882601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.456 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.882728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.882866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.882895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.883036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.883186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.883212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.883351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.883504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.883546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.883679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.883867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.883893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.883990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.884115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.884141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.884236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.884377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.884406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.884538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.884650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.884679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.884808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.884903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.884929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.885057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.885187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.885216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.885394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.885532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.885560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.885734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.885865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.885892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.886051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.886200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.886225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.886355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.886501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.886529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.886663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.886830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.886856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.886987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.887081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.887108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.887261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.887395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.887425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.887564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.887698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.887728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.887903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.888043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.888072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.888245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.888369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.888395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.888545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.888710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.888739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.888878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.889018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.889047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.889177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.889290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.889319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.889445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.889574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.889602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.889773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.889903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.889929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.890047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.890223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.890253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.890363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.890532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.890559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.890673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.890802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.890828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.890952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.891133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.891162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.457 qpair failed and we were unable to recover it. 00:30:30.457 [2024-11-26 05:26:31.891306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.891475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.457 [2024-11-26 05:26:31.891504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.891645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.891794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.891823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.891972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.892074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.892101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.892223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.892427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.892455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.892619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.892743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.892770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.892904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.892998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.893025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.893148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.893304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.893351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.893491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.893628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.893657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.893843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.893964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.893990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.894110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.894254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.894283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.894432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.894584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.894626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.894802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.894934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.894977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.895131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.895268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.895297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.895431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.895559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.895588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.895743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.895873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.895899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.896033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.896181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.896210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.896345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.896450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.896484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.896628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.896737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.896768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.896955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.897124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.897152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.897283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.897414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.897443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.897612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.897717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.897748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.897892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.898024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.898053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.898209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.898336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.898363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.898456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.898602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.898632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.898809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.898961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.898988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.899119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.899236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.899265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.899404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.899520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.899546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.899710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.899860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.899888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.900023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.900192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.900221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.458 qpair failed and we were unable to recover it. 00:30:30.458 [2024-11-26 05:26:31.900394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.900551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.458 [2024-11-26 05:26:31.900577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.900742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.900866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.900908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.901115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.901247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.901284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.901392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.901559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.901587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.901726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.901872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.901899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.902065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.902189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.902232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.902387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.902520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.902549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.902682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.902829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.902858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.903002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.903145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.903172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.903290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.903391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.903417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.903538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.903727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.903754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.903850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.904011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.904037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.904186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.904331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.904360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.904509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.904643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.904669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.904829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.904972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.905001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.905098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.905242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.905272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.905410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.905553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.905582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.905709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.905836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.905863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.906042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.906186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.906216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.906348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.906452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.906480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.906660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.906771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.906801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.906929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.907032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.907059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.907201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.907366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.907395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.907514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.907646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.907675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.459 qpair failed and we were unable to recover it. 00:30:30.459 [2024-11-26 05:26:31.907823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.459 [2024-11-26 05:26:31.907938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.907968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.908107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.908200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.908226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.908326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.908463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.908492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.908610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.908716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.908747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.908886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.909036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.909070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.909222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.909375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.909401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.909522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.909625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.909654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.909803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.909933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.909959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.910071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.910215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.910244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.910356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.910453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.910479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.910631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.910786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.910812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.910942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.911096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.911125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.911234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.911343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.911370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.911475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.911623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.911650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.911786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.911925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.911959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.912131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.912270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.912299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.912440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.912574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.912603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.912759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.912891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.912917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.913067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.913216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.913244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.913385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.913494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.913523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.913666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.913815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.913844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.913963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.914070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.914096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.914238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.914352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.914381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.914547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.914700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.914726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.914859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.915030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.915059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.915214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.915316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.915343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.915500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.915617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.915646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.915794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.915908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.915936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.916073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.916216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.460 [2024-11-26 05:26:31.916245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.460 qpair failed and we were unable to recover it. 00:30:30.460 [2024-11-26 05:26:31.916390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.916520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.916546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.916658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.916818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.916848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.916993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.917148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.917174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.917277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.917379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.917405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.917537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.917658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.917684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.917852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.917965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.917995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.918143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.918275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.918305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.918455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.918594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.918623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.918800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.918900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.918927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.919077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.919203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.919231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.919371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.919474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.919503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.919612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.919773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.919802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.919921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.920019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.920045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.920218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.920344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.920373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.920527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.920664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.920700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.920847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.920956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.920984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.921114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.921284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.921310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.921479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.921636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.921662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.921826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.921943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.921986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.922118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.922263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.922292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.922418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.922550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.922576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.922732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.922880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.922909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.923059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.923189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.923215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.923390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.923496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.923525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.923677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.923835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.923861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.924115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.924266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.924293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.924409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.924555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.924584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.924732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.924829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.924855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.461 [2024-11-26 05:26:31.924977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.925107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.461 [2024-11-26 05:26:31.925133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.461 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.925293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.925432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.925460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.925603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.925709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.925739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.925878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.925985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.926014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.926147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.926272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.926298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.926478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.926622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.926648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.926809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.926990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.927019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.927203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.927332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.927358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.927450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.927548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.927579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.927754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.927855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.927884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.928000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.928136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.928165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.928303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.928454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.928480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.928635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.928733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.928758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.928884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.928985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.929011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.929105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.929217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.929246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.929389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.929564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.929590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.929749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.929881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.929926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.930045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.930159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.930188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.930309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.930416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.930453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.930600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.930738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.930769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.930920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.931057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.931084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.931212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.931325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.931354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.931488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.931604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.931635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.931779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.931917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.931959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.932064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.932164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.932190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.932368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.932492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.932521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.932660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.932789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.932818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.932941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.933043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.933072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.933233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.933336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.933362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.462 [2024-11-26 05:26:31.933480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.933586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.462 [2024-11-26 05:26:31.933615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.462 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.933726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.933840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.933870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.933986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.934091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.934133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.934289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.934467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.934496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.934615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.934733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.934764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.934944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.935082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.935110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.935235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.935343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.935377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.935535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.935672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.935704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.935812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.935965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.935997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.936139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.936241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.936270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.936396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.936508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.936537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.936661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.936773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.936799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.936903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.937036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.937062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.937213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.937330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.937356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.937456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.937580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.937609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.937728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.937837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.937863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.937955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.938077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.938102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.938202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.938369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.938398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.938536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.938644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.938673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.938800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.938898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.938924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.939054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.939155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.939199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.939313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.939475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.939503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.939609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.939788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.939814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.939912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.940044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.940069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.940207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.940344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.940372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.940516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.940624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.940653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.940832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.940992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.463 [2024-11-26 05:26:31.941042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.463 qpair failed and we were unable to recover it. 00:30:30.463 [2024-11-26 05:26:31.941234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.941380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.941424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.941538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.941658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.941701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.941857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.941979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.942005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.942129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.942257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.942287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.942425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.942548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.942573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.942747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.942856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.942882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.942974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.943121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.943149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.943257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.943443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.943468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.943601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.943727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.943753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.943860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.944012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.944037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.944164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.944311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.944339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.944474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.944620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.944648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.944836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.944940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.944967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.945126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.945282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.945326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.945473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.945619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.945647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.945769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.945902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.945930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.946116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.946215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.946240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.946423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.946569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.946595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.946706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.946859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.946888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.947042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.947211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.947239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.947385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.947509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.947535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.947675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.947825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.947867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.947997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.948139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.948168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.948314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.948421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.948450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.948578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.948670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.948728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.948883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.949001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.949029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.949174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.949324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.949350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.464 qpair failed and we were unable to recover it. 00:30:30.464 [2024-11-26 05:26:31.949482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.949596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.464 [2024-11-26 05:26:31.949626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.949792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.949899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.949924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.950033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.950125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.950151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.950305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.950411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.950440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.950626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.950750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.950777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.950904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.951044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.951069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.951232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.951373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.951398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.951533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.951715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.951744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.951855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.951959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.951986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.952134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.952260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.952285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.952432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.952569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.952596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.952771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.952865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.952890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.953034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.953142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.953171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.953347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.953497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.953539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.953677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.953811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.953838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.953971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.954081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.954110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.954245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.954383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.954410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.954556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.954695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.954721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.954841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.954951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.954981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.955116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.955286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.955315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.955457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.955598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.955623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.955762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.955884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.955909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.956058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.956164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.956252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.956384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.956522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.956550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.956725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.956867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.956895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.957045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.957198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.957224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.957360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.957499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.957526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.957658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.957806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.957839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.957945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.958116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.465 [2024-11-26 05:26:31.958144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.465 qpair failed and we were unable to recover it. 00:30:30.465 [2024-11-26 05:26:31.958263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.958369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.958394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.958516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.958696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.958726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.958860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.958996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.959024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.959134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.959278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.959303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.959430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.959517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.959542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.959716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.959849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.959877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.959986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.960123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.960152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.960265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.960430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.960458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.960627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.960757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.960788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.960952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.961077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.961104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.961205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.961381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.961408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.961555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.961696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.961724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.961844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.961963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.961988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.962127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.962263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.962292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.962431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.962564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.962592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.962769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.962891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.962919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.963097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.963196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.963221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.963363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.963474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.963502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.963638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.963780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.963808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.963935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.964105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.964133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.964247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.964341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.964367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.964465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.964590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.964617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.964756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.964896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.964921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.965080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.965217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.965247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.965400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.965527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.965552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.965713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.965870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.466 [2024-11-26 05:26:31.965897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.466 qpair failed and we were unable to recover it. 00:30:30.466 [2024-11-26 05:26:31.966017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.966157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.966183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.966332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.966502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.966530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.966643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.966776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.966802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.966993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.967117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.967141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.967285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.967433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.967461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.967630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.967799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.967827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.968007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.968094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.968119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.968241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.968413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.968441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.968564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.968718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.968745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.968862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.969004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.969031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.969177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.969301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.969326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.969472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.969572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.969601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.969737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.969875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.969903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.970038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.970208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.970237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.970414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.970515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.970539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.970630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.970781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.970810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.970963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.971061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.971087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.971256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.971391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.971418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.971542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.971665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.971696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.971837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.971946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.971973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.972117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.972228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.972256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.972396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.972524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.972552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.972707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.972860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.972899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.973036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.973147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.973175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.973290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.973436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.973461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.973627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.973823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.973850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.973975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.974130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.974156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.974282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.974476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.974501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.467 [2024-11-26 05:26:31.974630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.974753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.467 [2024-11-26 05:26:31.974779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.467 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.974903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.975057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.975083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.975180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.975314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.975341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.975435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.975575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.975603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.975756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.975862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.975889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.976033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.976185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.976215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.976340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.976466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.976490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.976592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.976739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.976768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.976914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.977057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.977081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.977236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.977375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.977403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.977521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.977643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.977669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.977796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.977933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.977961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.978065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.978227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.978255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.978395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.978523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.978551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.978721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.978819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.978844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.978959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.979096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.979123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.979265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.979400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.979429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.979536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.979668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.979703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.979840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.979964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.979989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.980121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.980285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.980314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.980421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.980556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.980585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.980730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.980870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.980897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.981045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.981172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.981196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.981318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.981421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.981449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.981599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.981725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.981751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.981852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.981965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.468 [2024-11-26 05:26:31.981994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.468 qpair failed and we were unable to recover it. 00:30:30.468 [2024-11-26 05:26:31.982175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.982269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.982294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.982416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.982545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.982573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.982694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.982842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.982869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.982967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.983129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.983156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.983271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.983421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.983445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.983591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.983698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.983727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.983861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.983968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.983997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.984167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.984279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.984307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.984456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.984607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.984631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.984745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.984885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.984912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.985062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.985176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.985205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.985308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.985442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.985470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.985617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.985746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.985772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.985930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.986023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.986048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.986163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.986301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.986329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.986506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.986608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.986633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.986757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.986892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.986918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.987139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.987299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.987327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.987437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.987600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.987627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.987764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.987899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.987928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.988043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.988197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.988222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.988365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.988514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.988539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.988664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.988870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.988899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.989042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.989216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.989242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.989366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.989492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.989518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.989642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.989782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.989809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.989926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.990090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.990118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.990224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.990376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.990402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.990531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.990683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.469 [2024-11-26 05:26:31.990733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.469 qpair failed and we were unable to recover it. 00:30:30.469 [2024-11-26 05:26:31.990851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.991038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.991087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.991228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.991334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.991366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.991495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.991636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.991661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.991803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.991921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.991945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.992065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.992176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.992203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.992362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.992502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.992529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.992641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.992789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.992817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.992931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.993025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.993051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.993222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.993333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.993360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.993501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.993608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.993636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.993757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.993920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.993947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.994066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.994183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.994208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.994389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.994525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.994553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.994716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.994814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.994840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.994935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.995053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.995081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.995232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.995339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.995363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.995456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.995597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.995625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.995798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.995927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.995951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.996074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.996191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.996216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.996343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.996473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.996497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.996634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.996770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.996799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.996906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.997051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.997076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.997200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.997327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.997352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.997453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.997574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.997600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.997723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.997842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.997870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.998023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.998150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.998175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.998298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.998407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.998434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.998578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.998732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.998757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.470 [2024-11-26 05:26:31.998893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.999039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.470 [2024-11-26 05:26:31.999086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.470 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:31.999220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:31.999382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:31.999410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:31.999549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:31.999657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:31.999694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:31.999827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:31.999953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:31.999977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.000089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.000222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.000249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.000413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.000545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.000574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.000704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.000869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.000897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.001025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.001151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.001177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.001309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.001446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.001473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.001583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.001718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.001747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.001915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.002054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.002081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.002214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.002337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.002362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.002465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.002639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.002666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.002819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.002990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.003015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.003108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.003231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.003256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.003358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.003476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.003501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.003627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.003758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.003791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.003977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.004159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.004206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.004343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.004486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.004514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.004661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.004785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.004812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.004961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.005129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.005154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.005302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.005446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.005473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.005611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.005751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.005781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.005920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.006018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.006043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.006177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.006348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.006377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.006535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.006679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.006713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.006854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.006962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.006990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.007115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.007270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.007296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.007415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.007545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.007573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.471 [2024-11-26 05:26:32.007724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.007876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.471 [2024-11-26 05:26:32.007901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.471 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.008040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.008177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.008205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.008367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.008496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.008522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.008621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.008763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.008792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.008932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.009067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.009094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.009210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.009343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.009378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.009528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.009652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.009677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.009806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.009952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.009976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.010091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.010238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.010264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.010393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.010513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.010554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.010682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.010811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.010837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.011024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.011148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.011174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.011333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.011425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.011450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.011552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.011702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.011728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.011884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.012010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.012051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.012188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.012301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.012328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.012434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.012570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.012597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.012739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.012872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.012900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.013025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.013148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.013172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.013313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.013428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.013470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.013591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.013734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.013763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.013909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.014032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.014056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.014212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.014395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.014422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.014535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.014667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.014701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.014808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.014977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.015003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.015127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.015270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.015298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.015463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.015617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.015642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.015769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.015909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.015936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.016099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.016251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.016275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.472 qpair failed and we were unable to recover it. 00:30:30.472 [2024-11-26 05:26:32.016375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.016540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.472 [2024-11-26 05:26:32.016579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.016734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.016858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.016884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.017015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.017198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.017223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.017317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.017416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.017442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.017593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.017756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.017784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.017930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.018061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.018087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.018180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.018274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.018299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.018445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.018603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.018631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.018771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.018887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.018916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.019042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.019145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.019172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.019319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.019480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.019507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.019672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.019821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.019845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.019996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.020113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.020142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.020315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.020435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.020460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.020585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.020730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.020760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.020928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.021069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.021096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.021211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.021355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.021383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.021508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.021644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.021669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.021812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.021941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.021968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.022131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.022239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.022267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.022397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.022573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.022599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.022731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.022860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.022885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.023009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.023138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.023166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.023319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.023448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.023473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.023645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.023781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.023810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.473 qpair failed and we were unable to recover it. 00:30:30.473 [2024-11-26 05:26:32.023967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.024082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.473 [2024-11-26 05:26:32.024108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.024288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.024389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.024414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.024557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.024710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.024744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.024935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.025058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.025083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.025185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.025309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.025334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.025480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.025584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.025611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.025766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.025891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.025916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.026073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.026206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.026233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.026376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.026500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.026525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.026682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.026827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.026856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.026965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.027107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.027135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.027238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.027365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.027393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.027521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.027617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.027642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.027765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.027880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.027908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.028038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.028165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.028192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.028293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.028448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.028476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.028627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.028753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.028778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.028898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.029002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.029030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.029168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.029277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.029306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.029470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.029582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.029612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.029743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.029836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.029861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.029989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.030089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.030114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.030241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.030423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.030451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.030568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.030707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.030735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.030909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.031046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.031087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.031216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.031378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.031406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.031545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.031720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.031745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.031847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.031978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.032020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.032141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.032291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.032316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.474 qpair failed and we were unable to recover it. 00:30:30.474 [2024-11-26 05:26:32.032461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.032595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.474 [2024-11-26 05:26:32.032630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.032765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.032906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.032933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.033053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.033191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.033219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.033383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.033502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.033543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.033698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.033853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.033879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.034026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.034155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.034183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.034339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.034495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.034520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.034641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.034776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.034801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.034983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.035122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.035163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.035264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.035397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.035424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.035526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.035661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.035698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.035848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.035967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.035993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.036107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.036247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.036275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.036383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.036530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.036556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.036709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.036867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.036894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.037036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.037127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.037153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.037279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.037459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.037483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.037614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.037732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.037763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.037944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.038067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.038093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.038248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.038374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.038415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.038549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.038692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.038720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.038828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.038998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.039026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.039204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.039332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.039357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.039480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.039608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.039633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.039791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.039896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.039929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.040071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.040208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.040237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.040348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.040463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.040491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.040648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.040785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.040811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.040966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.041090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.041132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.475 qpair failed and we were unable to recover it. 00:30:30.475 [2024-11-26 05:26:32.041261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.475 [2024-11-26 05:26:32.041357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.041382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.041486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.041610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.041651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.041797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.041923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.041949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.042093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.042226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.042255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.042390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.042526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.042553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.042659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.042774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.042803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.042946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.043079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.043104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.043231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.043366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.043393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.043500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.043604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.043632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.043768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.043884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.043910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.044043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.044172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.044197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.044343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.044478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.044507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.044642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.044806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.044835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.044999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.045137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.045165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.045340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.045512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.045541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.045708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.045837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.045862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.046023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.046130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.046158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.046306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.046431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.046457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.046579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.046674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.046706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.046802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.046903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.046929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.047074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.047180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.047208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.047345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.047517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.047545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.047670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.047798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.047824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.047969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.048074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.048102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.048265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.048370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.048398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.048537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.048682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.048717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.048844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.048968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.048993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.049136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.049272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.049300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.049442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.049604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.049632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.476 qpair failed and we were unable to recover it. 00:30:30.476 [2024-11-26 05:26:32.049752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.476 [2024-11-26 05:26:32.049891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.049919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.050071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.050224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.050250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.050400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.050533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.050560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.050734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.050848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.050876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.051020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.051130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.051158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.051303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.051424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.051449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.051604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.051728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.051757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.051858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.051996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.052024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.052195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.052303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.052331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.052505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.052632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.052657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.052796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.052968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.052996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.053140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.053278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.053306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.053443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.053581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.053610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.053743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.053878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.053903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.054048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.054192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.054218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.054347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.054454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.054482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.054619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.054732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.054760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.054888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.055041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.055072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.055294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.055504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.055529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.055661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.055788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.055816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.055980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.056118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.056148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.056292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.056428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.056453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.056595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.056766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.056792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.056916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.057022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.057050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.057215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.057383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.057407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.477 [2024-11-26 05:26:32.057559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.057678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.477 [2024-11-26 05:26:32.057710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.477 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.057843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.057994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.058019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.058172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.058341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.058368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.058492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.058634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.058662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.058799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.058949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.058974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.059088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.059192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.059219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.059339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.059474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.059503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.059605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.059718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.059747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.059921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.060047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.060073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.060197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.060301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.060329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.060445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.060579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.060606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.060775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.060893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.060920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.061065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.061169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.061194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.061304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.061447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.061476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.061640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.061789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.061818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.061953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.062049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.062077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.062222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.062324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.062348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.062448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.062549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.062574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.062705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.062857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.062885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.063056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.063173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.063201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.063344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.063477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.063502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.063655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.063762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.063789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.063893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.063996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.064038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.064176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.064319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.064347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.064523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.064662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.064712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.064855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.065008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.065034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.065142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.065269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.065294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.065446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.065574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.065602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.065775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.065878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.065902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-11-26 05:26:32.066017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.066174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-11-26 05:26:32.066238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.066384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.066516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.066541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.066695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.066834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.066862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.067010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.067133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.067159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.067335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.067487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.067511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.067638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.067779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.067807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.067980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.068132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.068157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.068258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.068383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.068408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.068565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.068716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.068745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.068881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.069019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.069047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.069154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.069296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.069321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.069451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.069578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.069604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.069712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.069858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.069886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.070007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.070171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.070200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.070321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.070428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.070460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.070582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.070730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.070755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.070910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.071027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.071054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.071189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.071322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.071349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.071523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.071616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.071641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.071781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.071884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.071911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.072074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.072209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.072237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.072341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.072484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.072512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.072651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.072823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.072851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.073032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.073151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.073192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.073323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.073436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.073469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.073633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.073773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.073802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.073938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.074086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.074111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.074240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.074359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.074384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.074548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.074680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.074714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-11-26 05:26:32.074855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-11-26 05:26:32.074997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.075025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.075143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.075245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.075272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.075425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.075549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.075575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.075726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.075874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.075899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.075996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.076089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.076114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.076243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.076387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.076415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.076547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.076666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.076712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.076827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.076933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.076961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.077130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.077271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.077298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.077435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.077573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.077601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.077784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.077888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.077914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.078015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.078131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.078172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.078354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.078482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.078506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.078633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.078736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.078762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.078920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.079060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.079103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.079345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.079491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.079515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.079646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.079806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.079849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.079962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.080056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.080100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.080228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.080354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.080379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.080507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.080650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.080678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.080851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.080959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.080988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.081121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.081286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.081315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.081439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.081571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.081596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.081741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.081896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.081923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.082090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.082230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.082258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.082364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.082457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.082486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.082608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.082740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.082766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.082905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.083002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.083030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.083164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.083300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.083329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-11-26 05:26:32.083463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-11-26 05:26:32.083578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.083606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.083750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.083905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.083930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.084049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.084187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.084214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.084352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.084527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.084552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.084679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.084842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.084870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.085043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.085164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.085188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.085370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.085514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.085539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.085667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.085827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.085856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.086017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.086158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.086183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.086311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.086436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.086462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.086585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.086723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.086752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.086897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.087031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.087060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.087210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.087335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.087359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.087489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.087591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.087616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.087740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.087831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.087855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.087957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.088072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.088100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.088231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.088368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.088395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.088537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.088636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.088666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.088848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.088953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.088981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.089095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.089258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.089286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.089422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.089559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.089587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.089713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.089872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.089897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.090161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.090301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.090329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.090433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.090576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.090602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.090731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.090889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.090914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.091040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.091171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.091196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.091327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.091470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.091499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.091603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.091737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.091766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.091913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.092052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.092081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-11-26 05:26:32.092231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-11-26 05:26:32.092361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.092386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.092508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.092612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.092653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.092800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.092953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.092977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.093093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.093228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.093256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.093370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.093496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.093522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.093665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.093769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.093798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.093901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.094060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.094088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.094232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.094396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.094423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.094566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.094698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.094723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.094881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.095016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.095045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.095217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.095375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.095400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.095552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.095718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.095743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.095877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.096005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.096030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.096155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.096300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.096326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.096418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.096548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.096573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.096667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.096780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.096805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.096899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.097001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.097026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.097176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.097279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.097308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.097408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.097533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.097561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.097723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.097833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.097858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.097986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.098111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.098135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.098261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.098365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.098393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.098527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.098695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.098723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.098844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.099012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.099040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.099188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.099284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.099312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-11-26 05:26:32.099441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.099580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-11-26 05:26:32.099608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.099735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.099870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.099899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.100034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.100165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.100193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.100342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.100467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.100491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.100636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.100805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.100834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.100980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.101109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.101137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.101278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.101439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.101464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.101591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.101746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.101788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.101927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.102062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.102090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.102232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.102394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.102422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.102558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.102700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.102730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.102874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.102966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.102991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.103114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.103249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.103279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.103424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.103543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.103569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.103702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.103822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.103855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.104011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.104142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.104166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.104318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.104438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.104463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.104633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.104763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.104792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.104894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.105024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.105052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.105207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.105301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.105330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.105433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.105585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.105611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.105761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.105879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.105907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.106042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.106209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.106236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.106360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.106469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.106494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.106646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.106793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.106822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.106992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.107140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.107166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.107260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.107358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.107384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.107548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.107679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.107712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.107885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.108118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.108171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-11-26 05:26:32.108287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-11-26 05:26:32.108427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.108454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.108565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.108723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.108752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.108877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.109027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.109051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.109225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.109359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.109387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.109540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.109696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.109723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.109863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.109994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.110021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.110177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.110295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.110320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.110446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.110589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.110616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.110780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.110905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.110930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.111060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.111202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.111230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.111353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.111474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.111499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.111675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.111789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.111817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.111958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.112092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.112119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.112260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.112417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.112441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.112568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.112670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.112710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.112840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.112954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.112981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.113137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.113266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.113293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.113439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.113608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.113635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.113761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.113856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.113881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.113989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.114082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.114108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.114283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.114425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.114452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.114565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.114700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.114729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.114845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.114967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.114993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.115168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.115284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.115312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.115488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.115621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.115646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.115778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.115885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.115913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.116093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.116218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.116259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.116457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.116583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.116609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.116735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.116857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.116882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-11-26 05:26:32.117000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-11-26 05:26:32.117129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.117157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.117305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.117458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.117483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.117643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.117775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.117800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.117901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.118090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.118117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.118231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.118377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.118402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.118555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.118680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.118730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.118873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.119011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.119038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.119175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.119285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.119317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.119472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.119599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.119624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.119720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.119822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.119847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.119954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.120149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.120214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.120381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.120515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.120543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.120705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.120838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.120865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.121015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.121143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.121168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.121287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.121449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.121477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.121587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.121750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.121779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.121894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.122032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.122062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.122217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.122345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.122375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.122502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.122664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.122697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.122872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.123009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.123037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.123215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.123312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.123338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.123461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.123611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.123636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.123794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.123930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.123957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.124061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.124167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.124194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.124305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.124457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.124482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.124605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.124751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.124777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.124932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.125070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.125098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.125241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.125417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.125442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.125574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.125718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-11-26 05:26:32.125746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-11-26 05:26:32.125890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.126045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.126069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.126196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.126339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.126364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.126496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.126595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.126621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.126752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.126881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.126909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.127053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.127147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.127173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.127358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.127476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.127501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.127628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.127817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.127848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.128014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.128144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.128170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.128295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.128416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.128441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.128562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.128711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.128737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.128864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.128976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.129004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.129145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.129319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.129344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.129468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.129596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.129622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.129745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.129844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.129885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.129990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.130152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.130180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.130322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.130469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.130495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.130585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.130703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.130729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.130975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.131122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.131189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.131294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.131434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.131462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.131601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.131767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.131795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.131915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.132070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.132096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.132247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.132420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.132449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.132580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.132715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.132744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.132878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.132979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.133007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.133131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.133253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.133278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.133391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.133539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.133567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-11-26 05:26:32.133701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.133853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-11-26 05:26:32.133878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.134003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.134146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.134174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.134298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.134453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.134478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.134651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.134811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.134841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.134976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.135077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.135120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.135243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.135388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.135417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.135553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.135646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.135672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.135847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.135984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.136013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.136112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.136261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.136286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.136412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.136543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.136571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.136746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.136875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.136901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.137031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.137149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.137175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.137270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.137400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.137444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.137614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.137747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.137779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.137906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.138057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.138082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.138228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.138367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.138392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.138514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.138611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.138653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.138825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.138938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.138966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.139093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.139215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.139239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.139386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.139554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.139579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.139710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.139853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.139881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.140039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.140163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.140190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.140320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.140447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.140472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.140568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.140710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.140738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.140911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.141045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.141073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.141221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.141326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.141354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.141505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.141633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.141658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.141785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.141905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.141931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-11-26 05:26:32.142077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.142216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-11-26 05:26:32.142246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.142381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.142493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.142521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.142670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.142828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.142870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.143008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.143112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.143139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.143301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.143407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.143434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.143562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.143704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.143731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.143867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.143995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.144020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.144138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.144283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.144311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.144463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.144625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.144653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.144817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.144956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.144983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.145106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.145256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.145281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.145405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.145542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.145570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.145726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.145857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.145881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.146024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.146160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.146188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.146332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.146429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.146453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.146597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.146708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.146737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.146881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.146982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.147010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.147174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.147307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.147336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.147485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.147590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.147614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.147768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.147912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.147939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.148070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.148172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.148201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.148377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.148502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.148526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.148621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.148771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.148797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.148951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.149092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.149116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.149251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.149393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.149421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.149537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.149676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.149713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.149866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.149995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.150020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.150131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.150267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.150295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-11-26 05:26:32.150435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.150571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-11-26 05:26:32.150600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.150752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.150881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.150905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.151035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.151129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.151153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.151295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.151459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.151486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.151642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.151746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.151772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.151902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.152014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.152043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.152225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.152342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.152367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.152491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.152627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.152655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.152824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.152961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.152993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.153133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.153240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.153267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.153408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.153503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.153527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.153655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.153804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.153832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.153974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.154108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.154136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.154241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.154354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.154381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.154509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.154627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.154653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.154790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.154917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.154942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.155116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.155258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.155287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.155398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.155536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.155565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.155741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.155832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.155857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.155985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.156150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.156178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.156321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.156425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.156452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.156587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.156729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.156758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.156909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.157002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.157028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.157199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.157353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.157380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.157489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.157670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.157702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.157831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.157943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.157970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.158103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.158228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.158253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.158400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.158541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.158569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.158741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.158894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.158919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.489 qpair failed and we were unable to recover it. 00:30:30.489 [2024-11-26 05:26:32.159050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.489 [2024-11-26 05:26:32.159196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.159224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.159375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.159527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.159552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.159675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.159864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.159889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.160021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.160119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.160159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.160281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.160420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.160449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.160600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.160731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.160758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.160876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.160986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.161013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.161148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.161288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.161316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.161498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.161605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.161633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.161780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.161902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.161927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.162095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.162223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.162251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.162400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.162564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.162592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.162733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.162842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.162869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.163021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.163170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.163212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.163395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.163500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.163526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.163649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.163788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.163816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.163932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.164067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.164094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.164220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.164343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.164367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.164511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.164642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.164669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.164832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.164996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.165024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.165191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.165344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.165369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.165500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.165625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.165650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.165791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.165912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.165939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.166077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.166219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.166247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.166351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.166452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.166480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.166625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.166742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.166767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.166994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.167129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.167157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.167294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.167436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.167463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.167602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.167757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.167782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.490 qpair failed and we were unable to recover it. 00:30:30.490 [2024-11-26 05:26:32.167886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.490 [2024-11-26 05:26:32.167985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.168009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.168132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.168234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.168282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.168417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.168536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.168561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.168656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.168826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.168854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.168973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.169124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.169149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.169326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.169460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.169488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.169623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.169746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.169775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.169964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.170088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.170114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.170238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.170333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.170359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.170450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.170600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.170626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.170814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.170949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.170978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.171117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.171263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.171291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.171445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.171599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.171624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.171834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.171996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.172024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.172167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.172304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.172332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.172473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.172663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.172695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.172830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.172916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.172942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.173118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.173366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.173394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.173539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.173708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.173737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.173905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.174058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.174083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.174179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.174301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.174327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.174456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.174634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.174659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.174797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.174896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.174921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.175027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.175155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.175197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.175373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.175462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.175488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.491 qpair failed and we were unable to recover it. 00:30:30.491 [2024-11-26 05:26:32.175667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.491 [2024-11-26 05:26:32.175812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.175840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.175983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.176104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.176129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.176259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.176371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.176399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.176557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.176651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.176677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.176824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.176935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.176963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.177074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.177248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.177273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.177425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.177574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.177603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.177764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.177892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.177917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.178011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.178167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.178194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.178376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.178503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.178528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.178699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.178804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.178831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.178991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.179088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.179113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.179297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.179428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.179453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.179603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.179750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.179775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.179898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.180036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.180064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.180178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.180328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.180353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.180506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.180612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.180640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.180798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.180904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.180929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.181059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.181204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.181232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.181372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.181498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.181523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.181680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.181785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.181810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.181972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.182111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.182138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.182281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.182406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.182434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.182583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.182680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.182713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.182856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.182996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.183024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.183197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.183322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.183347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.183491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.183596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.183623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.183808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.183912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.183942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.184094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.184258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.184286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.492 qpair failed and we were unable to recover it. 00:30:30.492 [2024-11-26 05:26:32.184450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.492 [2024-11-26 05:26:32.184573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.184601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.184742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.184877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.184905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.185047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.185147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.185172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.185286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.185385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.185410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.185560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.185670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.185717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.185833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.185933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.185961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.186115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.186213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.186237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.186377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.186488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.186516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.186624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.186760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.186792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.186934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.187095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.187123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.187275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.187372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.187398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.187525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.187668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.187704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.187848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.188005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.188030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.188172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.188265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.188307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.188451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.188603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.188629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.188815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.188974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.188999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.189149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.189276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.493 [2024-11-26 05:26:32.189304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.493 qpair failed and we were unable to recover it. 00:30:30.493 [2024-11-26 05:26:32.189472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.189607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.189636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.189770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.189926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.189952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.190130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.190286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.190315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.190458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.190601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.190626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.190790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.190910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.190940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.191065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.191186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.191211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.191354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.191493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.191521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.191662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.191805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.191834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.191971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.192074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.192101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.192246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.192348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.192372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.192483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.192623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.192652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.192846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.192969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.192995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.193159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.193322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.193351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.193499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.193625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.193649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.193826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.193951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.193976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.194122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.194250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.194277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.780 qpair failed and we were unable to recover it. 00:30:30.780 [2024-11-26 05:26:32.194390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.780 [2024-11-26 05:26:32.194525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.194553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.194729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.194836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.194861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.194990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.195135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.195163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.195305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.195409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.195437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.195575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.195712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.195740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.195860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.195984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.196009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.196161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.196309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.196336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.196500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.196605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.196632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.196744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.196923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.196948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.197104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.197229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.197270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.197411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.197543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.197570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.197691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.197855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.197882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.197994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.198098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.198126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.198273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.198393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.198418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.198567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.198703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.198729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.198848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.198990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.199017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.199153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.199297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.199325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.199471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.199571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.199595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.199767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.199941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.199969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.200107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.200241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.200270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.200427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.200527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.200553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.200704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.200870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.200896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.201034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.201199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.201226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.201360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.201536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.201561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.201714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.201832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.201861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.202015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.202112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.202137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.202248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.202392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.202426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.202604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.202712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.202739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.202910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.203057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.203085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.781 qpair failed and we were unable to recover it. 00:30:30.781 [2024-11-26 05:26:32.203236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.781 [2024-11-26 05:26:32.203384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.203409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.203524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.203678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.203710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.203803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.203930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.203955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.204052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.204181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.204209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.204383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.204534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.204575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.204713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.204855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.204883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.204991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.205129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.205158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.205273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.205387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.205417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.205574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.205679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.205711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.205865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.205985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.206010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.206110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.206223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.206251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.206418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.206566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.206593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.206770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.206891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.206916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.207078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.207181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.207207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.207309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.207424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.207453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.207583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.207690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.207718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.207869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.207964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.207990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.208126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.208237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.208265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.208435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.208609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.208634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.208764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.208905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.208932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.209118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.209247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.209289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.209427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.209557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.209585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.209702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.209841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.209868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.209981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.210093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.210121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.210246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.210370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.210396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.210490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.210587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.210631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.210769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.210866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.210891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.211044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.211159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.211187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.782 [2024-11-26 05:26:32.211340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.211466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.782 [2024-11-26 05:26:32.211491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.782 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.211610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.211789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.211815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.211941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.212084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.212113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.212253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.212420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.212446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.212568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.212664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.212696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.212825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.212967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.212995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.213133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.213242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.213270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.213403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.213533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.213562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.213690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.213822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.213848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.213964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.214121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.214146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.214271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.214430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.214459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.214600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.214731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.214760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.214885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.215017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.215042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.215132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.215298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.215326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.215429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.215602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.215628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.215773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.215891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.215922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.216075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.216227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.216253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.216368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.216474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.216502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.216670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.216825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.216853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.216967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.217108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.217136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.217263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.217393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.217423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.217575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.217706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.217735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.217839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.217947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.217975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.218116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.218218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.218247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.218394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.218544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.218570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.218770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.218894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.218919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.219029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.219120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.219147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.219320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.219486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.219514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.219659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.219766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.219792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.783 qpair failed and we were unable to recover it. 00:30:30.783 [2024-11-26 05:26:32.219897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.783 [2024-11-26 05:26:32.220025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.220051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.220216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.220329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.220358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.220504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.220673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.220718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.220899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.221003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.221028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.221176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.221324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.221349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.221514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.221662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.221698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.221839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.221994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.222018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.222176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.222294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.222337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.222447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.222610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.222638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.222781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.222928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.222952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.223075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.223222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.223249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.223371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.223521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.223545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.223717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.223833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.223862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.224010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.224115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.224143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.224304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.224441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.224471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.224594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.224727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.224752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.224901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.225122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.225173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.225303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.225439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.225467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.225597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.225732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.225761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.225911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.226013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.226038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.226181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.226315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.226343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.226477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.226612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.226640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.226842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.226989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.227021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.227185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.227323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.227350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.227483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.227586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.227613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.227730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.227830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.227857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.784 qpair failed and we were unable to recover it. 00:30:30.784 [2024-11-26 05:26:32.228015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.228159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.784 [2024-11-26 05:26:32.228190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.228363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.228514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.228540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.228693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.228837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.228867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.229016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.229146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.229173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.229291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.229426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.229457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.229629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.229771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.229797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.229949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1410980 is same with the state(5) to be set 00:30:30.785 [2024-11-26 05:26:32.230190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.230370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.230399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.230533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.230679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.230719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.230840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.230966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.230992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.231088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.231243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.231272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.231432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.231570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.231598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.231742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.231878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.231903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.232042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.232223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.232250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.232378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.232540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.232566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.232698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.232797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.232824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.232924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.233105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.233133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.233403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.233578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.233607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.233758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.233913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.233939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.234069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.234205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.234233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.234400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.234512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.234542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.234658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.234826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.234852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.234991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.235163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.235192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.235323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.235485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.235514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.235631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.235738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.235765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.235876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.236003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.236029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.236146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.236313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.236341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.236517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.236642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.785 [2024-11-26 05:26:32.236691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.785 qpair failed and we were unable to recover it. 00:30:30.785 [2024-11-26 05:26:32.236814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.236941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.236968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.237140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.237305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.237335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.237436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.237590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.237616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.237769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.237872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.237899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.238137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.238414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.238467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.238616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.238731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.238758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.238851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.238948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.238989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.239133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.239331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.239357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.239511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.239609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.239635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.239807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.239948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.239976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.240110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.240196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.240221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.240350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.240453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.240478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.240575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.240704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.240730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.240839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.240964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.240990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.241115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.241240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.241265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.241446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.241584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.241614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.241788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.241889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.241915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.242013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.242165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.242191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.242334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.242473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.242501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.242662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.242860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.242890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.243027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.243131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.243157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.243285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.243501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.243562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.243732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.243857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.243883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.243979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.244075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.244100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.244212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.244387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.244416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.244589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.244770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.244797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.244949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.245078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.245120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.245287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.245422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.245451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.786 [2024-11-26 05:26:32.245679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.245831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.786 [2024-11-26 05:26:32.245857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.786 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.245988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.246122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.246149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.246337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.246453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.246496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.246652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.246761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.246787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.246886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.246984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.247011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.247163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.247306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.247335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.247476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.247613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.247642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.247800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.247927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.247954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.248136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.248282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.248308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.248470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.248622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.248650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.248823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.248960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.248986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.249134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.249310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.249335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.249478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.249629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.249658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.249826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.249929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.249955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.250079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.250234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.250260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.250436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.250572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.250601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.250759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.250865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.250891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.250988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.251136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.251166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.251336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.251439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.251468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.251646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.251771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.251798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.251930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.252119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.252147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.252264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.252434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.252463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.252618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.252776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.252803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.252931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.253050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.253078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.253246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.253408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.253437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.253579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.253710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.253737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.253891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.254030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.254059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.254225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.254335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.254363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.254506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.254609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.254635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.787 qpair failed and we were unable to recover it. 00:30:30.787 [2024-11-26 05:26:32.254763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.254897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.787 [2024-11-26 05:26:32.254926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.255038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.255204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.255232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.255418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.255589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.255618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.255788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.255883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.255909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.256036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.256189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.256215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.256411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.256530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.256572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.256718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.256885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.256914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.257066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.257190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.257216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.257345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.257447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.257473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.257656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.257756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.257782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.257936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.258045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.258073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.258247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.258373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.258400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.258550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.258733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.258765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.258889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.259040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.259070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.259225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.259386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.259428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.259583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.259698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.259730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.259872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.260002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.260044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.260168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.260321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.260348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.260548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.260677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.260720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.260867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.260995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.261023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.261193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.261345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.261371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.261500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.261672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.261708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.261849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.261992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.262024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.262146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.262250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.262275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.262449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.262588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.262617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.262771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.262947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.262975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.263128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.263254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.263281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.263434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.263603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.263632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.263771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.263885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.263930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.788 qpair failed and we were unable to recover it. 00:30:30.788 [2024-11-26 05:26:32.264090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.788 [2024-11-26 05:26:32.264216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.264241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.264396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.264533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.264562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.264699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.264862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.264891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.265046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.265199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.265247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.265379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.265516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.265545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.265701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.265883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.265908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.266039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.266196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.266237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.266338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.266471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.266500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.266632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.266781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.266810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.266959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.267096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.267121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.267263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.267379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.267406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.267548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.267679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.267714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.267868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.268001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.268025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.268165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.268306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.268340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.268518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.268675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.268732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.268886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.268987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.269011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.269163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.269269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.269297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.269438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.269585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.269610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.269739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.269865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.269890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.270061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.270159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.270188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.270324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.270469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.270495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.270653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.270757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.270783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.789 qpair failed and we were unable to recover it. 00:30:30.789 [2024-11-26 05:26:32.270915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.271036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.789 [2024-11-26 05:26:32.271063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.271205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.271360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.271385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.271488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.271594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.271621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.271769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.271948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.271973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.272126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.272273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.272302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.272449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.272566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.272590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.272733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.272886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.272911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.273037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.273188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.273214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.273311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.273459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.273484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.273629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.273789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.273818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.273962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.274112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.274140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.274312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.274431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.274455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.274630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.274757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.274782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.274929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.275040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.275068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.275210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.275338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.275364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.275488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.275640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.275666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.275820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.275938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.275968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.276148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.276277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.276317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.276476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.276602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.276627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.276772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.276910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.276939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.277092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.277215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.277242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.277397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.277584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.277609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.277741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.277877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.277904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.278061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.278215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.278241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.278413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.278574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.278602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.278743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.278914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.278940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.279094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.279221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.279263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.279409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.279549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.279577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.279742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.279872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.279900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.790 qpair failed and we were unable to recover it. 00:30:30.790 [2024-11-26 05:26:32.280083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.790 [2024-11-26 05:26:32.280174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.280198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.280322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.280488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.280517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.280659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.280828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.280857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.280977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.281148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.281173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.281325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.281488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.281516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.281647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.281797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.281827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.281952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.282052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.282077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.282249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.282414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.282443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.282588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.282729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.282757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.282872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.282990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.283015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.283205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.283373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.283401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.283537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.283682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.283716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.283832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.283989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.284014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.284196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.284332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.284360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.284525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.284674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.284726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.284888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.284991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.285018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.285179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.285318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.285346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.285487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.285596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.285626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.285787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.285914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.285940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.286120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.286258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.286288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.286431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.286587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.286613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.286772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.286898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.286940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.287073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.287178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.287207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.287393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.287488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.287514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.287669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.287783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.287809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.287961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.288097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.288125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.288268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.288377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.288406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.288586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.288719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.288763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.791 [2024-11-26 05:26:32.288873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.289031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.791 [2024-11-26 05:26:32.289059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.791 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.289230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.289414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.289443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.289587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.289714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.289740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.289859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.290004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.290033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.290177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.290315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.290345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.290502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.290630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.290656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.290792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.290912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.290938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.291045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.291146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.291172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.291291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.291428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.291454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.291616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.291715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.291742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.291892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.292073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.292098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.292223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.292380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.292423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.292568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.292724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.292751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.292886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.292977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.293020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.293198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.293301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.293327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.293483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.293596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.293625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.293737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.293888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.293913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.294066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.294217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.294259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.294416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.294542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.294567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.294703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.294851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.294877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.294992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.295133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.295158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.295305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.295441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.295469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.295634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.295745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.295774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.295930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.296060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.296085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.296205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.296360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.296389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.296539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.296682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.296725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.296855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.296950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.296976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.297101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.297232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.297258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.297418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.297541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.297566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.792 qpair failed and we were unable to recover it. 00:30:30.792 [2024-11-26 05:26:32.297696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.297818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.792 [2024-11-26 05:26:32.297843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.297995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.298175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.298203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.298359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.298452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.298477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.298580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.298710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.298736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.298833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.298983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.299009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.299118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.299235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.299273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.299419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.299548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.299586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.299733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.299846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.299874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.300017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.300157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.300184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.300341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.300470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.300495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.300622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.300743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.300768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.300942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.301077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.301106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.301255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.301390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.301416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.301566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.301671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.301704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.301841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.301952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.301980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.302168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.302297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.302322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.302472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.302625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.302655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.302834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.302970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.302998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.303125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.303268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.303294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.303439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.303552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.303580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.303757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.303878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.303903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.304037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.304139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.304165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.304306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.304437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.304464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.304590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.304718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.304746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.304902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.305024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.305066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.305181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.305296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.305324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.305491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.305630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.305657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.305798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.305928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.305953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.306134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.306270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.793 [2024-11-26 05:26:32.306298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.793 qpair failed and we were unable to recover it. 00:30:30.793 [2024-11-26 05:26:32.306434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.306608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.306637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.306796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.306948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.306973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.307163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.307283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.307310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.307458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.307587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.307615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.307746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.307852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.307877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.308034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.308166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.308195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.308338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.308474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.308502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.308653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.308785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.308816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.309014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.309135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.309162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.309271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.309450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.309479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.309627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.309758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.309784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.309941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.310118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.310146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.310319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.310459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.310487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.310611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.310738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.310763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.310909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.311012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.311041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.311177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.311315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.311343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.311488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.311646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.311695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.311834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.311972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.312006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.312112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.312252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.312281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.312401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.312521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.312546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.312719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.312820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.312847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.312982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.313150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.313176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.313308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.313414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.313440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.313582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.313747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.313775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.313930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.314055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.794 [2024-11-26 05:26:32.314082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.794 qpair failed and we were unable to recover it. 00:30:30.794 [2024-11-26 05:26:32.314181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.314278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.314304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.314431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.314603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.314632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.314773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.314919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.314949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.315105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.315234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.315274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.315440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.315583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.315609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.315729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.315837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.315863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.315964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.316115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.316141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.316330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.316474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.316499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.316599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.316728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.316753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.316887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.316986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.317011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.317159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.317273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.317302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.317473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.317626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.317651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.317788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.317909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.317939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.318083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.318226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.318254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.318420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.318536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.318564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.318717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.318814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.318839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.318987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.319175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.319200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.319304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.319406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.319447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.319604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.319733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.319759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.319940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.320076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.320104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.320267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.320406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.320435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.320607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.320732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.320757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.320912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.321080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.321105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.321266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.321427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.321456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.321633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.321754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.321779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.321935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.322084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.322112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.322250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.322358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.322387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.322541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.322636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.322661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.795 [2024-11-26 05:26:32.322791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.322915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.795 [2024-11-26 05:26:32.322942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.795 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.323107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.323239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.323267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.323419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.323548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.323574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.323734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.323900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.323928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.324084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.324214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.324239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.324394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.324543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.324585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.324731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.324846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.324871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.324996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.325168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.325196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.325337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.325497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.325522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.325671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.325815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.325844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.325989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.326154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.326182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.326333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.326486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.326528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.326696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.326815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.326841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.326998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.327142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.327170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.327286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.327419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.327445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.327591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.327697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.327727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.327825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.327966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.327996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.328149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.328279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.328304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.328429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.328521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.328546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.328640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.328759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.328788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.328944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.329100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.329125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.329278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.329443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.329471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.329637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.329804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.329872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.330024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.330172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.330198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.330370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.330495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.330522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.330701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.330810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.330839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.331015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.331139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.331165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.331320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.331458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.331486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.331631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.331768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.331799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.796 qpair failed and we were unable to recover it. 00:30:30.796 [2024-11-26 05:26:32.331972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.332140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.796 [2024-11-26 05:26:32.332169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.332337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.332480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.332505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.332647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.332856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.332886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.333040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.333166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.333192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.333299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.333391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.333417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.333575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.333675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.333712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.333839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.333960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.333985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.334163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.334300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.334328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.334473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.334588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.334617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.334765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.334900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.334926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.335069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.335250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.335275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.335406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.335556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.335584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.335712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.335810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.335835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.335930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.336111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.336139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.336317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.336413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.336438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.336539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.336703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.336729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.336858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.337022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.337051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.337224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.337350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.337375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.337469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.337596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.337623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.337768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.337931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.337959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.338074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.338211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.338235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.338360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.338482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.338506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.338632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.338800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.338830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.339007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.339140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.339169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.339327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.339425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.339451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.339544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.339664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.339703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.339849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.339952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.339982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.340134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.340265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.340290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.797 [2024-11-26 05:26:32.340463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.340612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.797 [2024-11-26 05:26:32.340640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.797 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.340812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.340952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.340993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.341155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.341304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.341329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.341465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.341611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.341636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.341790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.341911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.341939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.342084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.342208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.342235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.342359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.342502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.342530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.342665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.342836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.342864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.342997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.343157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.343182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.343331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.343470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.343499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.343599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.343733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.343761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.343917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.344016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.344043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.344231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.344324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.344350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.344532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.344672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.344705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.344858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.345010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.345035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.345214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.345351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.345379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.345496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.345635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.345662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.345789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.345915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.345940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.346066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.346192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.346217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.346394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.346557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.346585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.346760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.346908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.346951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.347121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.347247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.347272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.347412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.347583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.347609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.347777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.347886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.347927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.348064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.348237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.348264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.348379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.348518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.798 [2024-11-26 05:26:32.348545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.798 qpair failed and we were unable to recover it. 00:30:30.798 [2024-11-26 05:26:32.348698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.348828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.348854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.349032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.349135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.349163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.349329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.349507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.349535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.349690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.349840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.349881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.350015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.350159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.350187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.350295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.350434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.350463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.350608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.350717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.350743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.350872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.350971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.351014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.351161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.351326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.351354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.351499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.351625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.351651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.351815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.351963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.351989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.352168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.352305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.352334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.352504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.352630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.352655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.352830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.352986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.353028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.353161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.353302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.353344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.353472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.353628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.353654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.353810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.353936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.353962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.354091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.354190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.354218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.354358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.354487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.354512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.354699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.354836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.354864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.355002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.355133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.355161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.355313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.355439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.355464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.355607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.355754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.355787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.355921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.356085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.356113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.356255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.356384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.356411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.356566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.356714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.356743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.356907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.357046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.357074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.357211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.357337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.357362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.799 qpair failed and we were unable to recover it. 00:30:30.799 [2024-11-26 05:26:32.357461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.799 [2024-11-26 05:26:32.357578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.357602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.357724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.357836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.357864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.358012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.358132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.358157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.358261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.358384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.358409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.358553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.358701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.358732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.358885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.359058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.359087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.359255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.359415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.359443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.359581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.359722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.359753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.359902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.360028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.360054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.360187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.360292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.360320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.360486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.360589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.360619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.360798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.360916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.360941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.361120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.361303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.361329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.361482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.361627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.361655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.361819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.361945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.361974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.362121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.362286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.362314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.362431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.362598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.362624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.362751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.362845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.362872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.363050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.363153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.363181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.363360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.363490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.363515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.363611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.363773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.363799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.363982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.364123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.364152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.364265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.364431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.364460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.364575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.364672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.364709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.364842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.364985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.365018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.365162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.365329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.365358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.365512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.365639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.365665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.365793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.365935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.365963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.366103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.366276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.366303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.800 qpair failed and we were unable to recover it. 00:30:30.800 [2024-11-26 05:26:32.366456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.800 [2024-11-26 05:26:32.366576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.366601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.366718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.366848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.366876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.367044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.367182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.367210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.367325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.367452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.367478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.367654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.367804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.367832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.367943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.368075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.368103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.368298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.368453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.368479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.368584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.368734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.368761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.368863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.368992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.369020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.369151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.369247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.369273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.369396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.369488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.369514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.369681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.369831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.369860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.370005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.370133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.370158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.370277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.370440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.370468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.370610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.370774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.370803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.370917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.371020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.371045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.371200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.371320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.371349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.371529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.371657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.371683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.371821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.371928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.371955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.372098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.372259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.372287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.372426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.372576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.372602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.372758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.372856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.372881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.373062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.373237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.373266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.373435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.373564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.373593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.373771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.373865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.373890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.374010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.374160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.374187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.374346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.374481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.374507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.374640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.374766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.374792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.374947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.375100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.801 [2024-11-26 05:26:32.375128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.801 qpair failed and we were unable to recover it. 00:30:30.801 [2024-11-26 05:26:32.375270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.375372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.375397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.375523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.375647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.375672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.375797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.375938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.375967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.376108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.376243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.376272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.376448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.376599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.376642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.376762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.376902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.376930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.377068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.377181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.377208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.377344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.377501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.377528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.377679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.377826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.377854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.378008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.378161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.378186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.378313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.378413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.378439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.378612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.378757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.378786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.378951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.379091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.379119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.379244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.379343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.379369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.379541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.379716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.379741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.379844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.380017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.380045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.380170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.380289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.380314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.380473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.380624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.380650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.380814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.380948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.380976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.381146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.381298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.381341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.381494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.381617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.381643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.381807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.381964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.381992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.382142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.382262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.382287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.382410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.382541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.382568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.382682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.382827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.382855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.382979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.383136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.383161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.383341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.383516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.383544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.383694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.383828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.383857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.802 qpair failed and we were unable to recover it. 00:30:30.802 [2024-11-26 05:26:32.384005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.384131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.802 [2024-11-26 05:26:32.384156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.384330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.384472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.384498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.384645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.384818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.384848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.385028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.385205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.385232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.385343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.385491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.385517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.385672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.385801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.385830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.385953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.386079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.386106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.386253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.386393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.386421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.386588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.386698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.386727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.386907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.387028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.387055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.387209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.387349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.387376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.387562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.387696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.387722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.387829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.387957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.387983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.388170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.388291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.388316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.388451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.388617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.388645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.388843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.388997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.389040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.389143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.389284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.389312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.389486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.389609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.389634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.389764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.389914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.389955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.390068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.390204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.390233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.390372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.390539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.390568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.390718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.390866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.390892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.391088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.391182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.391208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.391338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.391461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.391491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.391639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.391776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.391802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.803 [2024-11-26 05:26:32.391947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.392114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.803 [2024-11-26 05:26:32.392141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.803 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.392282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.392397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.392425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.392600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.392753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.392796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.392928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.393093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.393121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.393264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.393416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.393445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.393563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.393715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.393741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.393867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.394004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.394030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.394177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.394322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.394348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.394509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.394678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.394711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.394823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.394989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.395017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.395159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.395294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.395322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.395498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.395604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.395630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.395726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.395852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.395895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.396045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.396176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.396201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.396354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.396461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.396487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.396639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.396786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.396815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.396984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.397127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.397153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.397278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.397414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.397439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.397554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.397702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.397729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.397853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.397949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.397974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.398129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.398262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.398304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.398442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.398583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.398611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.398729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.398840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.398870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.399028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.399152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.399179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.399313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.399456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.399484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.399661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.399756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.399781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.399889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.400018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.400044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.400201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.400332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.400361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.400503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.400600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.400627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.804 qpair failed and we were unable to recover it. 00:30:30.804 [2024-11-26 05:26:32.400787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.804 [2024-11-26 05:26:32.400939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.400966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.401141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.401275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.401302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.401412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.401572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.401599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.401731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.401859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.401884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.402060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.402227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.402255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.402420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.402534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.402563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.402721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.402818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.402843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.402971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.403117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.403145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.403278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.403416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.403444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.403606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.403734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.403759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.403894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.404063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.404089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.404228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.404371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.404399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.404547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.404699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.404726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.404922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.405047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.405072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.405200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.405338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.405366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.405520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.405671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.405707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.405899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.406065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.406093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.406283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.406433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.406459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.406566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.406698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.406724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.406882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.407068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.407097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.407276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.407426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.407451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.407579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.407726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.407752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.407936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.408112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.408138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.408294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.408453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.408482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.408660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.408844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.408872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.408982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.409117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.409151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.409308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.409427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.409453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.409607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.409758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.409802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.409969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.410135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.805 [2024-11-26 05:26:32.410163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.805 qpair failed and we were unable to recover it. 00:30:30.805 [2024-11-26 05:26:32.410285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.410453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.410481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.410637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.410738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.410764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.410895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.411042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.411071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.411205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.411373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.411398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.411524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.411624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.411650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.411786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.411938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.411964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.412093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.412184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.412213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.412353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.412481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.412507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.412641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.412836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.412866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.413031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.413174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.413199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.413326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.413452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.413477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.413603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.413719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.413749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.413906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.414046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.414071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.414231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.414364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.414406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.414540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.414646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.414675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.414817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.414988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.415016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.415159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.415290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.415321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.415446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.415588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.415616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.415752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.415891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.415919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.416061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.416184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.416210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.416387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.416521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.416549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.416665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.416774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.416802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.416979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.417114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.417139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.417244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.417343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.417368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.417539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.417682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.417718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.417871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.418020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.418063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.418199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.418337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.418365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.418519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.418671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.418704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.806 [2024-11-26 05:26:32.418830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.418981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.806 [2024-11-26 05:26:32.419006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.806 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.419156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.419259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.419287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.419456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.419567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.419595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.419736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.419864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.419890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.420070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.420211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.420239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.420382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.420520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.420549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.420721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.420851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.420892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.421067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.421225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.421249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.421377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.421476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.421504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.421633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.421761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.421787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.421920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.422017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.422045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.422213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.422376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.422405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.422556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.422691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.422716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.422907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.423033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.423058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.423187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.423339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.423365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.423472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.423601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.423627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.423774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.423913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.423942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.424106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.424256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.424281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.424408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.424529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.424554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.424733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.424883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.424909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.425088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.425245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.425271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.425478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.425645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.425673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.425855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.425993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.426022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.426160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.426346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.426372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.426504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.426629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.426654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.426792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.426918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.426944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.807 qpair failed and we were unable to recover it. 00:30:30.807 [2024-11-26 05:26:32.427075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.807 [2024-11-26 05:26:32.427216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.427245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.427396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.427532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.427557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.427707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.427842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.427872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.427997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.428138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.428165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.428315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.428449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.428474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.428661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.428804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.428830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.428962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.429127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.429156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.429333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.429430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.429455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.429590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.429739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.429768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.429908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.430041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.430070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.430219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.430368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.430394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.430523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.430692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.430717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.430871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.431021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.431050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.431183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.431284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.431310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.431440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.431564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.431590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.431738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.431882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.431911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.432079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.432255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.432317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.432461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.432586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.432614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.432766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.432895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.432921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.433078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.433204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.433246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.433358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.433528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.433556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.433698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.433872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.433901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.434078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.434229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.434272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.434446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.434587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.434616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.434768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.434873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.434899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.435026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.435153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.435179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.435330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.435459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.435486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.435637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.435782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.435811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.808 [2024-11-26 05:26:32.435966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.436120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.808 [2024-11-26 05:26:32.436145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.808 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.436337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.436461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.436486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.436627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.436812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.436841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.436966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.437119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.437145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.437318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.437449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.437478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.437640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.437734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.437760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.437889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.438017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.438044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.438232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.438396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.438425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.438593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.438763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.438792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.438912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.439068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.439094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.439242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.439410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.439436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.439599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.439791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.439818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.439920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.440045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.440071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.440225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.440375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.440404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.440545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.440717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.440747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.440904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.441009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.441035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.441195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.441327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.441356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.441502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.441641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.441670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.441799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.441938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.441964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.442145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.442262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.442287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.442443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.442571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.442599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.442749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.442873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.442899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.443048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.443196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.443222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.443344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.443492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.443521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.443642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.443747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.443774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.443921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.444065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.444094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.444231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.444400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.444428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.444580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.444733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.444759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.444940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.445075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.445104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.809 qpair failed and we were unable to recover it. 00:30:30.809 [2024-11-26 05:26:32.445245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.809 [2024-11-26 05:26:32.445354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.445383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.445563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.445691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.445716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.445837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.445968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.445996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.446142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.446268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.446294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.446425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.446550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.446575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.446695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.446837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.446865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.447008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.447183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.447209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.447364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.447491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.447531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.447673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.447844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.447872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.448046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.448243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.448304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.448478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.448604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.448630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.448794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.448965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.448990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.449142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.449318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.449347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.449475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.449600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.449626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.449744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.449903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.449932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.450048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.450213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.450242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.450368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.450519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.450544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.450696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.450831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.450860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.450979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.451121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.451149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.451303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.451402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.451428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.451557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.451675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.451712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.451834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.451963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.451992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.452173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.452298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.452340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.452521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.452676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.452729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.452859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.453035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.453063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.453212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.453336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.453361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.453489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.453629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.453657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.453786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.453952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.453981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.454168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.454299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.810 [2024-11-26 05:26:32.454341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.810 qpair failed and we were unable to recover it. 00:30:30.810 [2024-11-26 05:26:32.454508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.454653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.454678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.454842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.454996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.455023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.455202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.455352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.455395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.455539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.455656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.455698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.455852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.455957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.455982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.456113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.456212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.456237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.456360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.456481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.456507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.456634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.456757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.456790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.456969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.457100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.457143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.457312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.457485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.457510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.457639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.457771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.457800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.457948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.458072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.458097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.458276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.458439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.458467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.458580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.458695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.458725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.458872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.458990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.459016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.459180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.459328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.459354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.459503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.459659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.459690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.459820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.459940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.459970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.460115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.460219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.460247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.460394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.460490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.460516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.460668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.460853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.460881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.461054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.461205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.461231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.461388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.461525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.461554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.461667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.461802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.461828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.461976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.462080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.462107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.462246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.462413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.462442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.462588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.462742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.462768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.462888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.463028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.463061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.811 qpair failed and we were unable to recover it. 00:30:30.811 [2024-11-26 05:26:32.463226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.463362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.811 [2024-11-26 05:26:32.463391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.463512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.463641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.463666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.463847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.464012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.464041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.464182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.464299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.464327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.464506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.464637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.464662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.464825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.464941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.464966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.465096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.465219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.465246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.465404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.465527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.465553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.465713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.465828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.465856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.465990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.466131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.466164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.466318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.466437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.466462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.466588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.466751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.466780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.466943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.467062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.467091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.467238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.467341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.467367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.467459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.467627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.467656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.467794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.467960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.467987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.468140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.468291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.468315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.468423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.468583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.468611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.468798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.468900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.468925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.469029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.469164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.469190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.469368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.469503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.469530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.469645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.469787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.469817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.470002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.470129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.470154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.470318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.470429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.470457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.470598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.470715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.470745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.812 [2024-11-26 05:26:32.470933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.471062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.812 [2024-11-26 05:26:32.471087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.812 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.471219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.471352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.471380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.471532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.471659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.471689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.471787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.471925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.471950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.472123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.472261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.472290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.472445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.472573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.472598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.472737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.472833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.472858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.473013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.473162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.473191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.473350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.473477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.473503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.473621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.473772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.473799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.473987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.474124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.474152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.474295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.474458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.474486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.474657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.474790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.474834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.475000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.475131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.475158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.475302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.475439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.475469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.475663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.475799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.475825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.475924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.476045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.476071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.476249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.476414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.476442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.476590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.476740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.476782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.476922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.477089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.477117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.477258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.477440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.477465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.477618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.477745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.477788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.477955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.478120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.478147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.478291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.478396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.478423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.478568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.478735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.478761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.478928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.479032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.479060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.479208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.479370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.479399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.479526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.479658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.479684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.479813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.479978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.480007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.813 qpair failed and we were unable to recover it. 00:30:30.813 [2024-11-26 05:26:32.480181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.480310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.813 [2024-11-26 05:26:32.480337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.480439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.480568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.480593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.480693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.480804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.480841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.481012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.481129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.481154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.481283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.481407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.481433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.481532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.481716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.481745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.481854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.481996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.482024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.482201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.482331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.482357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.482514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.482657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.482693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.482862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.483000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.483030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.483206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.483357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.483399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.483566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.483714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.483745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.483882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.484108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.484137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.484292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.484441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.484466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.484601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.484765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.484794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.484934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.485102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.485131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.485288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.485438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.485464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.485656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.485832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.485859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.485981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.486119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.486149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.486323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.486452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.486480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.486624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.486787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.486816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.486954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.487131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.487157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.487259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.487382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.487407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.487550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.487716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.487744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.487885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.488030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.488060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.488212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.488360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.488403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.488543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.488706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.488734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.488849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.488988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.489016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.489137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.489264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.489289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.814 qpair failed and we were unable to recover it. 00:30:30.814 [2024-11-26 05:26:32.489406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.814 [2024-11-26 05:26:32.489572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.489599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.489766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.489904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.489933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.490103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.490259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.490301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.490483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.490608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.490633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.490754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.490852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.490896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.491053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.491204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.491230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.491373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.491485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.491514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.491660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.491767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.491796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.491970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.492096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.492122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.492239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.492383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.492413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.492555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.492663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.492698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.492843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.492974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.492999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.493157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.493333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.493361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.493462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.493592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.493619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.493749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.493876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.493902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.494080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.494188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.494216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.494323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.494459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.494486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.494660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.494821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.494847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.494999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.495148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.495177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.495314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.495478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.495507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.495692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.495830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.495873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.496037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.496211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.496237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.496368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.496508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.496536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.496714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.496811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.496835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.497012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.497116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.497146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.497334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.497470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.497498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.497647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.497784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.497811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.497967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.498098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.498123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.815 [2024-11-26 05:26:32.498273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.498424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.815 [2024-11-26 05:26:32.498449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.815 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.498579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.498728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.498753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.498938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.499055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.499082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.499261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.499369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.499397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.499552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.499677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.499707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.499893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.500019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.500047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.500219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.500347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.500373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.500503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.500660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.500710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.500830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.500965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.500992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.501136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.501278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.501306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.501496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.501669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.501706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.501882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.502020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.502049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.502189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.502353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.502381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.502531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.502653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.502677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.502814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.502912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.502938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.503058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.503167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.503195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.503370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.503508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.503533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.503709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.503860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.503886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.504018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.504156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.504184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.504337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.504464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.504494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.504672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.504817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.504845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.504995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.505093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.505120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.505244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.505396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.505422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.505577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.505712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.505740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.505852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.506023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.506051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.506203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.506303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.506327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.506495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.506659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.506694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.816 qpair failed and we were unable to recover it. 00:30:30.816 [2024-11-26 05:26:32.506880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.506996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.816 [2024-11-26 05:26:32.507023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.507138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.507289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.507314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.507470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.507637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.507670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.507846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.508015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.508040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.508195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.508320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.508361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.508537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.508780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.508809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.508947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.509052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.509080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.509226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.509323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.509348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.509470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.509631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.509660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.509828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.509975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.510001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.510161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.510290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.510333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.510474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.510610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.510639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.510815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.510953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.510986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.511169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.511275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.511302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.511432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.511552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.511580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.511737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.511895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.511921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.512119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.512267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.512294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.512465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.512605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.512633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.512812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.512970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.512996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.513121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.513277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.513318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.513466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.513632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.513660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.513805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.513972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.514001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.514157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.514317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.514347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.514459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.514601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.514629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.514795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.514947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.514974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.515100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.515229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.515254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.515410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.515549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.515577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:30.817 [2024-11-26 05:26:32.515697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.515857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.817 [2024-11-26 05:26:32.515883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:30.817 qpair failed and we were unable to recover it. 00:30:31.095 [2024-11-26 05:26:32.516008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.095 [2024-11-26 05:26:32.516166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.095 [2024-11-26 05:26:32.516192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.095 qpair failed and we were unable to recover it. 00:30:31.095 [2024-11-26 05:26:32.516319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.095 [2024-11-26 05:26:32.516423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.095 [2024-11-26 05:26:32.516450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.095 qpair failed and we were unable to recover it. 00:30:31.095 [2024-11-26 05:26:32.516590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.095 [2024-11-26 05:26:32.516730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.095 [2024-11-26 05:26:32.516759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.095 qpair failed and we were unable to recover it. 00:30:31.095 [2024-11-26 05:26:32.516875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.095 [2024-11-26 05:26:32.517030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.517057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.517202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.517338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.517366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.517506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.517641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.517671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.517837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.517949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.517975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.518103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.518206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.518251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.518369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.518526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.518555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.518704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.518833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.518858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.519015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.519184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.519212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.519353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.519502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.519528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.519637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.519792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.519821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.520011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.520168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.520194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.520378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.520547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.520576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.520704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.520809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.520834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.520992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.521140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.521169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.521307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.521446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.521475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.521601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.521722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.521749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.521926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.522091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.522120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.522262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.522412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.522438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.522534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.522683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.522717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.522863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.522974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.523004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.523142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.523275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.523304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.523429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.523559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.523586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.523733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.523870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.523899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.524030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.524186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.524212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.524341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.524469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.524495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.524675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.524818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.524847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.524955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.525094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.525123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.096 qpair failed and we were unable to recover it. 00:30:31.096 [2024-11-26 05:26:32.525295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.525424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.096 [2024-11-26 05:26:32.525450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.525579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.525708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.525734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.525854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.526010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.526035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.526144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.526306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.526331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.526489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.526629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.526658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.526809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.526910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.526939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.527114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.527239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.527266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.527443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.527596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.527623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.527763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.527889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.527919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.528068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.528171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.528196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.528337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.528450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.528478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.528591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.528699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.528729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.528895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.528996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.529022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.529149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.529283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.529312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.529475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.529612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.529640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.529811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.529940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.529965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.530064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.530213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.530239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.530416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.530551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.530580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.530759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.530913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.530938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.531089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.531254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.531282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.531424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.531592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.531619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.531796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.531915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.531941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.532124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.532257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.532282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.532434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.532606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.532631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.532735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.532889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.532914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.533103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.533272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.533301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.533409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.533516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.533546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.533677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.533814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.533839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.534012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.534140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.534168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.097 qpair failed and we were unable to recover it. 00:30:31.097 [2024-11-26 05:26:32.534334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.097 [2024-11-26 05:26:32.534497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.534525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.534668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.534821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.534848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.535004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.535172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.535199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.535336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.535449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.535478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.535618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.535773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.535800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.535987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.536120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.536148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.536319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.536486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.536515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.536701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.536806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.536831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.536963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.537115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.537143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.537283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.537386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.537414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.537589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.537721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.537764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.537935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.538085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.538111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.538266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.538404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.538433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.538606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.538736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.538762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.538943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.539115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.539143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.539308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.539453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.539481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.539667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.539799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.539825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.539955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.540125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.540153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.540295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.540477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.540502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.540657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.540793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.540820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.540917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.541088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.541116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.541279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.541468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.541493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.541621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.541752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.541778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.541938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.542073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.542103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.542246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.542349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.542378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.542505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.542637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.542663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.542802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.542930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.542956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.543050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.543230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.543255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.098 [2024-11-26 05:26:32.543356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.543485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.098 [2024-11-26 05:26:32.543510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.098 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.543656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.543837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.543866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.544035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.544142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.544170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.544319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.544421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.544447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.544600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.544698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.544724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.544831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.544977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.545007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.545192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.545316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.545356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.545461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.545639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.545665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.545801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.545947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.545976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.546145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.546297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.546323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.546494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.546631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.546658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.546782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.546952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.546981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.547120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.547274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.547300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.547447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.547548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.547576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.547713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.547852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.547880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.548028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.548182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.548208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.548340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.548479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.548506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.548683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.548818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.548844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.549063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.549200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.549225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.549350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.549473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.549502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.549616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.549755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.549785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.549907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.550007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.550032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.550211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.550346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.550374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.550537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.550666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.550701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.550877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.551002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.551029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.551220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.551322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.551348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.551466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.551593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.551618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.551773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.551931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.551957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.552114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.552257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.552285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.099 qpair failed and we were unable to recover it. 00:30:31.099 [2024-11-26 05:26:32.552432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.552595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.099 [2024-11-26 05:26:32.552623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.552771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.552869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.552896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.553049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.553188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.553217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.553356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.553491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.553519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.553698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.553801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.553826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.554001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.554169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.554195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.554351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.554518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.554544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.554672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.554838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.554863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.554982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.555120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.555149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.555329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.555483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.555513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.555647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.555778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.555804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.555993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.556144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.556169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.556297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.556395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.556423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.556549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.556700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.556727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.556878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.557012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.557041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.557180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.557329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.557354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.557487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.557612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.557638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.557809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.557938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.557963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.558084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.558213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.558242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.558360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.558510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.558541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.558730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.558881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.558907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.559063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.559192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.559220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.559370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.559464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.559490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.559661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.559834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.100 [2024-11-26 05:26:32.559863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.100 qpair failed and we were unable to recover it. 00:30:31.100 [2024-11-26 05:26:32.560011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.560143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.560170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.560283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.560383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.560409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.560513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.560636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.560663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.560771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.560897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.560923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.561026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.561173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.561199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.561326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.561459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.561493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.561670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.561819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.561846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.562020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.562143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.562169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.562362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.562488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.562515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.562663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.562812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.562837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.562976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.563107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.563132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.563266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.563352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.563377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.563484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.563578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.563603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.563702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.563830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.563855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.564025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.564170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.564199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.564343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.564468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.564501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.564673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.564781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.564808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.564922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.565080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.565108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.565264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.565379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.565409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.565561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.565689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.565715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.565891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.565997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.566024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.566172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.566328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.566354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.566485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.566634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.566675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.566855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.567016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.567044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.567185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.567344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.567370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.567509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.567632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.567658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.567800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.567966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.567994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.568167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.568305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.568334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.101 qpair failed and we were unable to recover it. 00:30:31.101 [2024-11-26 05:26:32.568482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.568607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.101 [2024-11-26 05:26:32.568632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.568786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.568928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.568956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.569117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.569247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.569272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.569395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.569493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.569517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.569659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.569818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.569847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.569982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.570157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.570183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.570334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.570457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.570482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.570678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.570835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.570861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.571016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.571185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.571211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.571355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.571505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.571547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.571664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.571834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.571862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.572029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.572165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.572193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.572341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.572465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.572492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.572619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.572762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.572791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.572967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.573070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.573111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.573267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.573420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.573446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.573571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.573718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.573748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.573929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.574084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.574110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.574238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.574360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.574385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.574532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.574639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.574669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.574827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.574963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.574993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.575131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.575249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.575274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.575422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.575591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.575618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.575788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.575890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.575919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.576094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.576185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.576211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.576324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.576505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.576531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.576630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.576762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.576789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.576915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.577071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.577112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.577257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.577395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.577422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.102 qpair failed and we were unable to recover it. 00:30:31.102 [2024-11-26 05:26:32.577554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.102 [2024-11-26 05:26:32.577720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.577749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.577893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.577994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.578021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.578214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.578366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.578391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.578548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.578692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.578721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.578867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.578987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.579013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.579166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.579311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.579339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.579475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.579613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.579653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.579829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.579959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.579986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.580165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.580318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.580343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.580504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.580620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.580649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.580792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.580946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.580972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.581112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.581247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.581276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.581383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.581490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.581519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.581662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.581791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.581818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.581990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.582145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.582171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.582316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.582449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.582490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.582643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.582815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.582842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.582971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.583111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.583137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.583262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.583397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.583426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.583602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.583729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.583757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.583939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.584075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.584104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.584246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.584427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.584453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.584607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.584737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.584780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.584920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.585046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.585077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.585173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.585305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.585334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.585487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.585589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.585617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.585789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.585930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.585958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.586114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.586290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.586318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.586446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.586573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.103 [2024-11-26 05:26:32.586600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.103 qpair failed and we were unable to recover it. 00:30:31.103 [2024-11-26 05:26:32.586710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.586857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.586887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.587045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.587161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.587190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.587314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.587439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.587467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.587609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.587706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.587746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.587861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.587997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.588027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.588177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.588287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.588314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.588464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.588596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.588625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.588731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.588900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.588928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.589052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.589149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.589176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.589319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.589485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.589515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.589649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.589845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.589872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.590012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.590136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.590161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.590353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.590481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.590508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.590633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.590799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.590826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.590954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.591104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.591131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.591268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.591384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.591410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.591511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.591641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.591669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.591779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.591907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.591934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.592039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.592172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.592199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.592340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.592470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.592496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.592649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.592767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.592799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.592921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.593016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.593042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.593215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.593392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.593421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.593653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.593786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.593813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.593943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.594075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.594100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.594245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.594351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.594379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.594537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.594703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.594746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.594869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.595030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.595056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.104 qpair failed and we were unable to recover it. 00:30:31.104 [2024-11-26 05:26:32.595208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.595382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.104 [2024-11-26 05:26:32.595411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.595543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.595707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.595734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.595872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.596017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.596057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.596174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.596293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.596321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.596495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.596637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.596665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.596793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.596903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.596929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.597056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.597205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.597234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.597369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.597530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.597560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.597747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.597843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.597869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.598021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.598158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.598187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.598356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.598496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.598525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.598666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.598792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.598819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.598953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.599083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.599109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.599242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.599401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.599428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.599550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.599728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.599756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.599914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.600103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.600133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.600364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.600492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.600521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.600680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.600810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.600837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.600970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.601085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.601113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.601221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.601353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.601384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.601552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.601730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.601758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.601889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.602040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.602070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.602250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.602398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.602442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.602565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.602711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.602754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.602874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.603027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.603056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.603201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.603366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.603395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.105 qpair failed and we were unable to recover it. 00:30:31.105 [2024-11-26 05:26:32.603544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.105 [2024-11-26 05:26:32.603682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.603718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.603878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.604048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.604078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.604242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.604407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.604437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.604535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.604676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.604709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.604848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.604954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.604998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.605206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.605347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.605376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.605516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.605657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.605692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.605820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.605952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.605996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.606139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.606284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.606314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.606453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.606588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.606618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.606781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.606886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.606912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.607174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.607409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.607460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.607612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.607743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.607770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.607898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.608096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.608122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.608269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.608428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.608457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.608588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.608765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.608792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.608889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.609016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.609044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.609160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.609343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.609372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.609550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.609732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.609760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.609893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.610014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.610043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.610163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.610286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.610311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.610485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.610613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.610642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.610770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.610901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.610926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.611084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.611253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.611283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.611452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.611592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.611618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.611777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.611934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.611963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.612131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.612287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.612314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.612481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.612605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.612635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.612733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.612857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.612882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.106 qpair failed and we were unable to recover it. 00:30:31.106 [2024-11-26 05:26:32.612984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.106 [2024-11-26 05:26:32.613111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.613137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.613279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.613415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.613443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.613554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.613722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.613752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.613877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.614002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.614029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.614170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.614341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.614371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.614548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.614646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.614672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.614831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.614956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.614996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.615177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.615305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.615332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.615481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.615619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.615648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.615807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.615958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.616009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.616176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.616312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.616341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.616516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.616670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.616704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.616873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.616993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.617019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.617152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.617325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.617354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.617548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.617664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.617730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.617848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.617970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.617995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.618126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.618257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.618285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.618398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.618552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.618578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.618731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.618861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.618887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.618999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.619173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.619201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.619379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.619545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.619574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.619726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.619847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.619874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.619996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.620132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.620161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.620330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.620466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.620496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.620682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.620800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.620826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.621005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.621121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.621150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.621289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.621431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.621459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.621617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.621738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.621765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.621865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.622039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.622069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.107 qpair failed and we were unable to recover it. 00:30:31.107 [2024-11-26 05:26:32.622213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.107 [2024-11-26 05:26:32.622365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.622393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.622540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.622674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.622705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.622885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.622988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.623017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.623149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.623299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.623329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.623476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.623605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.623632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.623805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.623912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.623938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.624070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.624225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.624254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.624381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.624500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.624526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.624672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.624796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.624824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.624970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.625109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.625142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.625289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.625425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.625451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.625661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.625855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.625884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.626009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.626162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.626198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.626326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.626446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.626472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.626603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.626729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.626755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.626860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.626963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.626991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.627178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.627272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.627297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.627452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.627617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.627645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.627802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.627923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.627949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.628077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.628229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.628271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.628447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.628582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.628616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.628758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.628869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.628897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.629024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.629125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.629150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.629302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.629448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.629491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.629646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.629801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.629831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.630015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.630114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.630141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.630297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.630435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.630464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.630605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.630761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.630787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.630920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.631050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.108 [2024-11-26 05:26:32.631076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.108 qpair failed and we were unable to recover it. 00:30:31.108 [2024-11-26 05:26:32.631202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.631329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.631356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.631511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.631692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.631720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.631856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.631984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.632009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.632114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.632289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.632318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.632434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.632554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.632582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.632735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.632870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.632896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.633047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.633219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.633244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.633406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.633554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.633582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.633771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.633899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.633944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.634084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.634225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.634255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.634392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.634535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.634561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.634664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.634823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.634850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.635027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.635183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.635209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.635352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.635486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.635515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.635693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.635824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.635851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.635979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.636160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.636186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.636316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.636471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.636500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.636628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.636736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.636763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.636897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.637017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.637061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.637200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.637300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.637328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.637503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.637595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.637620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.637795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.637900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.637928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.638087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.638258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.638287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.638409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.638559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.638585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.638740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.638881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.638911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.109 qpair failed and we were unable to recover it. 00:30:31.109 [2024-11-26 05:26:32.639025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.109 [2024-11-26 05:26:32.639137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.639167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.639294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.639418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.639445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.639562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.639736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.639767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.639874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.639984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.640012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.640166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.640317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.640343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.640500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.640632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.640661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.640861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.641012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.641045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.641194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.641321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.641348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.641474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.641626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.641655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.641834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.642001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.642030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.642201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.642354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.642381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.642539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.642673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.642714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.642874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.643009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.643035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.643163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.643262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.643288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.643445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.643574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.643602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.643778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.643898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.643927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.644049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.644178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.644205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.644335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.644527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.644556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.644704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.644840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.644868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.645006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.645107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.645132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.645260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.645418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.645464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.645578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.645745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.645774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.645945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.646104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.646131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.646234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.646364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.646391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.646524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.646726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.646756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.646893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.647031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.647056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.647185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.647319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.647349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.647521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.647671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.647707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.647865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.647995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.110 [2024-11-26 05:26:32.648020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.110 qpair failed and we were unable to recover it. 00:30:31.110 [2024-11-26 05:26:32.648190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.648364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.648394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.648532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.648777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.648807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.648962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.649113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.649138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.649277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.649400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.649427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.649579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.649670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.649703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.649840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.649961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.649988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.650120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.650295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.650324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.650468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.650633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.650661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.650819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.650916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.650948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.651103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.651266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.651312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.651467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.651595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.651621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.651726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.651852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.651878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.652012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.652140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.652165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.652298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.652439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.652469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.652613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.652747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.652775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.652901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.653003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.653029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.653186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.653292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.653323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.653470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.653601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.653627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.653728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.653877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.653909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.654012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.654194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.654223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.654366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.654497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.654525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.654655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.654807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.654837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.655013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.655182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.655211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.655381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.655519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.655545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.655717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.655866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.655893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.656023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.656192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.656221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.656358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.656447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.656473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.656597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.656710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.656741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.111 qpair failed and we were unable to recover it. 00:30:31.111 [2024-11-26 05:26:32.656878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.657049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.111 [2024-11-26 05:26:32.657083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.657202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.657306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.657335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.657493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.657648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.657674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.657793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.657950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.657976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.658133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.658259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.658285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.658433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.658546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.658576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.658695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.658808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.658837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.659013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.659169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.659196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.659349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.659449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.659476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.659632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.659765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.659791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.659890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.660009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.660034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.660214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.660356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.660387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.660505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.660644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.660674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.660836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.660993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.661020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.661169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.661304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.661332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.661501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.661693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.661721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.661880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.661982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.662007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.662163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.662294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.662320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.662414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.662544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.662571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.662698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.662854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.662881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.663056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.663200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.663229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.663372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.663509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.663538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.663692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.663850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.663875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.664049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.664153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.664181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.664299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.664464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.664492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.664636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.664770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.664799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.664903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.665000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.665027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.665159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.665339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.665369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.665518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.665639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.665666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.112 qpair failed and we were unable to recover it. 00:30:31.112 [2024-11-26 05:26:32.665830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.112 [2024-11-26 05:26:32.665955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.665982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.666111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.666293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.666322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.666470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.666596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.666623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.666812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.666968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.666994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.667122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.667248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.667273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.667382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.667485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.667510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.667606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.667794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.667821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.667982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.668112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.668138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.668266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.668423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.668449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.668558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.668694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.668722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.668883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.669008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.669053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.669172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.669279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.669306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.669419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.669546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.669574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.669711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.669867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.669897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.670042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.670194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.670219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.670356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.670537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.670566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.670726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.670854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.670881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.671011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.671141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.671167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.671326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.671455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.671483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.671641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.671813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.671843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.672015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.672154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.672181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.672305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.672452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.672482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.672626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.672767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.672797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.672925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.673078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.673104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.673254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.673425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.673455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.673613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.673745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.673772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.673877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.673977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.674005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.674107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.674289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.674319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.113 qpair failed and we were unable to recover it. 00:30:31.113 [2024-11-26 05:26:32.674464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.113 [2024-11-26 05:26:32.674597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.674622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.674782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.674939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.674964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.675086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.675228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.675259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.675401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.675544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.675574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.675755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.675890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.675916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.676061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.676201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.676229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.676355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.676507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.676534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.676666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.676774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.676801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.676903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.677067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.677093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.677192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.677358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.677387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.677560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.677692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.677719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.677853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.677956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.677983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.678104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.678256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.678282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.678410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.678568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.678594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.678757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.678901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.678931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.679082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.679232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.679258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.679357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.679514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.679541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.679709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.679851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.679880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.680018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.680184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.680214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.680338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.680458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.680484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.680612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.680768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.680798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.680919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.681064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.681092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.681243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.681372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.681399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.681579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.681718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.681746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.681887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.682042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.114 [2024-11-26 05:26:32.682071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.114 qpair failed and we were unable to recover it. 00:30:31.114 [2024-11-26 05:26:32.682226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.682352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.682378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.682557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.682706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.682735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.682875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.683098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.683151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.683301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.683455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.683480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.683611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.683714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.683744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.683890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.684032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.684061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.684185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.684313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.684340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.684483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.684635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.684666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.684792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.684901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.684930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.685090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.685218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.685246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.685353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.685501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.685531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.685639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.685786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.685813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.685967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.686094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.686120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.686245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.686354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.686381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.686482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.686643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.686670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.686835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.686966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.686992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.687119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.687274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.687301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.687428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.687534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.687563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.687717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.687876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.687902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.688067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.688174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.688200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.688334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.688454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.688480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.688637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.688736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.688763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.688869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.689025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.689052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.689153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.689278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.689305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.689460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.689588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.689616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.689729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.689830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.689858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.689958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.690058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.690084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.690191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.690343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.690370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.115 qpair failed and we were unable to recover it. 00:30:31.115 [2024-11-26 05:26:32.690513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.115 [2024-11-26 05:26:32.690614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.690640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.690746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.690906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.690933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.691069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.691199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.691226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.691351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.691514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.691541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.691702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.691832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.691859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.691985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.692111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.692138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.692294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.692388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.692415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.692538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.692666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.692699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.692835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.692941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.692967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.693100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.693229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.693256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.693381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.693535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.693561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.693714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.693855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.693881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.693980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.694111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.694138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.694239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.694394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.694421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.694582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.694708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.694747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.694873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.695021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.695050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.695186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.695312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.695338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.695493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.695623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.695649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.695775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.695917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.695947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.696058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.696223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.696253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.696407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.696505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.696531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.696693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.696819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.696850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.696964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.697063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.697092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.697243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.697367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.697394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.697550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.697720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.697752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.697889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.698026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.698055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.698199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.698323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.698349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.698451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.698577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.698604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.698709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.698862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.116 [2024-11-26 05:26:32.698888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.116 qpair failed and we were unable to recover it. 00:30:31.116 [2024-11-26 05:26:32.698988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.699125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.699152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.699303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.699423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.699451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.699631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.699772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.699806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.699981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.700080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.700109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.700239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.700368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.700412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.700518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.700664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.700699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.700816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.700966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.700993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.701126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.701277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.701305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.701420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.701551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.701580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.701730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.701861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.701886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.702030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.702174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.702203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.702358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.702513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.702540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.702639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.702778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.702810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.702942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.703104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.703130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.703277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.703440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.703469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.703620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.703766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.703792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.703921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.704050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.704076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.704253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.704384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.704414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.704535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.704666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.704700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.704834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.704981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.705011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.705156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.705324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.705352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.705525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.705657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.705683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.705851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.705965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.705999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.706105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.706245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.706274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.706389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.706495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.706522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.706655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.706808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.706839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.706986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.707119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.707147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.707284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.707409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.707435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.117 qpair failed and we were unable to recover it. 00:30:31.117 [2024-11-26 05:26:32.707612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.707781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.117 [2024-11-26 05:26:32.707811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.707961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.708130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.708159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.708310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.708439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.708466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.708594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.708726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.708754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.708938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.709111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.709174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.709355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.709482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.709508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.709661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.709789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.709816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.709975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.710102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.710129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.710267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.710395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.710429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.710577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.710717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.710757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.710892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.711060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.711090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.711225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.711352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.711378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.711533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.711631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.711657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.711847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.711998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.712025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.712180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.712304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.712331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.712433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.712580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.712610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.712749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.712853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.712883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.713042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.713138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.713164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.713293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.713397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.713422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.713549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.713648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.713675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.713837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.713945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.713972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.714131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.714301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.714330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.714480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.714641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.714667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.714804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.714935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.714962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.715102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.715231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.715260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.118 qpair failed and we were unable to recover it. 00:30:31.118 [2024-11-26 05:26:32.715405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.118 [2024-11-26 05:26:32.715573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.715601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.715729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.715863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.715890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.716015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.716167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.716197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.716350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.716515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.716543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.716691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.716814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.716840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.716965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.717135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.717164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.717306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.717418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.717447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.717621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.717748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.717775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.717921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.718058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.718086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.718223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.718328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.718356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.718509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.718660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.718693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.718848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.718952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.718979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.719078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.719212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.719240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.719369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.719496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.719523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.719677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.719809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.719837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.720013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.720182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.720237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.720380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.720481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.720507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.720633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.720761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.720806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.720927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.721056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.721084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.721192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.721309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.721336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.721471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.721636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.721662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.721831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.721957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.721983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.722105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.722232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.722257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.722405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.722514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.722544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.722653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.722802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.722833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.723001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.723128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.723154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.723302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.723441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.723470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.723581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.723752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.723783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.723907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.724038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.119 [2024-11-26 05:26:32.724065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.119 qpair failed and we were unable to recover it. 00:30:31.119 [2024-11-26 05:26:32.724240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.724377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.724406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.724516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.724652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.724682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.724860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.724989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.725017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.725160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.725299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.725340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.725496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.725592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.725619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.725749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.725900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.725927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.726074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.726216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.726246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.726413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.726600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.726625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.726780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.726902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.726928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.727059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.727191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.727217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.727324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.727479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.727506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.727708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.727880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.727909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.728019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.728167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.728211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.728358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.728497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.728543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.728675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.728780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.728806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.728915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.729084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.729111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.729264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.729429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.729477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.729609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.729706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.729733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.729919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.730086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.730129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.730277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.730425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.730452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.730606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.730776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.730822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.730968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.731099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.731131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.731248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.731422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.731453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.731575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.731754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.731782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.731915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.732041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.732066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.732189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.732351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.732377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.732518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.732675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.732708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.732918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.733053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.733083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.120 [2024-11-26 05:26:32.733200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.733321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.120 [2024-11-26 05:26:32.733349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.120 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.733515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.733627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.733655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.733788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.733934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.733972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.734138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.734283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.734314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.734445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.734575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.734606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.734744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.734871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.734897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.735028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.735167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.735196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.735309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.735418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.735447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.735620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.735748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.735775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.735905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.736069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.736099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.736213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.736400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.736430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.736614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.736775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.736802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.736927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.737105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.737134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.737338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.737483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.737513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.737653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.737790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.737816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.737926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.738116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.738142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.738294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.738455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.738484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.738601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.738764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.738791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.738891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.738987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.739033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.739171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.739339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.739369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.739536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.739663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.739695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.739857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.739983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.740010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.740137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.740253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.740283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.740427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.740548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.740578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.740757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.740883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.740909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.741029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.741157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.741188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.741394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.741525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.741555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.741675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.741820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.741846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.742017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.742134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.742164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.121 qpair failed and we were unable to recover it. 00:30:31.121 [2024-11-26 05:26:32.742325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.121 [2024-11-26 05:26:32.742489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.742519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.742662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.742821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.742847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.742951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.743065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.743092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.743240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.743381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.743411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.743513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.743692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.743747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.743850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.744020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.744049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.744238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.744384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.744414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.744574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.744716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.744760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.744887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.745037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.745066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.745191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.745369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.745398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.745561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.745741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.745768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.745898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.746033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.746064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.746217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.746363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.746393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.746523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.746656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.746692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.746843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.746949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.747008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.747153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.747286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.747313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.747436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.747528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.747572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.747759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.747886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.747912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.748086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.748196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.748227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.748395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.748528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.748558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.748714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.748823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.748849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.749004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.749118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.749150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.749258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.749387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.749416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.749591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.749739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.749765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.749862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.749958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.749989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.750081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.750235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.750262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.750362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.750493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.750520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.750649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.750790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.750817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.122 [2024-11-26 05:26:32.750906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.751081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.122 [2024-11-26 05:26:32.751110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.122 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.751278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.751384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.751414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.751559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.751697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.751724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.751831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.751931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.751959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.752104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.752247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.752279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.752422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.752553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.752581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.752737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.752915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.752946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.753074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.753253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.753283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.753413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.753563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.753590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.753729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.753871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.753902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.754012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.754188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.754218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.754361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.754488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.754515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.754666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.754790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.754819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.754958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.755100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.755130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.755278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.755432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.755459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.755610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.755759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.755789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.755928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.756071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.756106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.756288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.756380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.756408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.756516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.756656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.756705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.756831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.756956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.756984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.757086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.757238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.757265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.757417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.757557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.757588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.757717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.757862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.757891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.758045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.758198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.758225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.758322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.758445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.758472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.123 [2024-11-26 05:26:32.758591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.758744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.123 [2024-11-26 05:26:32.758774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.123 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.758948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.759079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.759106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.759232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.759375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.759404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.759570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.759691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.759722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.759867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.759989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.760016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.760137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.760272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.760302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.760412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.760550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.760580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.760702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.760851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.760877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.761054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.761210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.761237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.761390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.761569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.761599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.761742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.761896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.761922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.762075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.762251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.762281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.762430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.762569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.762599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.762728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.762836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.762862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.763021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.763172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.763202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.763348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.763488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.763518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.763666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.763882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.763910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.764108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.764273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.764302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.764431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.764538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.764568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.764703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.764868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.764894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.765052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.765230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.765257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.765388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.765572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.765598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.765759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.765859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.765884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.766038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.766215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.766245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.766350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.766456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.766487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.766632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.766790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.766817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.766986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.767124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.767154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.767294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.767433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.767463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.767604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.767718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.767749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.124 qpair failed and we were unable to recover it. 00:30:31.124 [2024-11-26 05:26:32.767881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.768000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.124 [2024-11-26 05:26:32.768027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.768140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.768328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.768355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.768508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.768676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.768713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.768896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.769071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.769098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.769228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.769382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.769412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.769565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.769694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.769721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.769880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.770005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.770035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.770136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.770258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.770287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.770442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.770605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.770648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.770804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.770943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.770979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.771112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.771243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.771272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.771386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.771519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.771546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.771702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.771807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.771833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.771966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.772081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.772111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.772269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.772422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.772449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.772595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.772737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.772767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.772909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.773076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.773105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.773290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.773423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.773449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.773572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.773741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.773771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.773924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.774071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.774098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.774321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.774453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.774479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.774606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.774725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.774755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.774928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.775069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.775098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.775252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.775406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.775433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.775582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.775763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.775790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.775946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.776100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.776129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.776257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.776415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.776442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.776581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.776748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.776778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.776911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.777069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.125 [2024-11-26 05:26:32.777096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.125 qpair failed and we were unable to recover it. 00:30:31.125 [2024-11-26 05:26:32.777216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.777309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.777336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.777467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.777633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.777663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.777815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.777977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.778007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.778150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.778254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.778282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.778463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.778607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.778637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.778776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.778911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.778939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.779064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.779195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.779221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.779341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.779512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.779538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.779713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.779851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.779883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.779998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.780106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.780133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.780267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.780440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.780470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.780633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.780751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.780779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.780903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.781055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.781097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.781312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.781466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.781493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.781637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.781800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.781828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.781985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.782153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.782182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.782362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.782521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.782550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.782715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.782865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.782891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.783026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.783151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.783178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.783285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.783407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.783433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.783533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.783623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.783650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.783797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.783899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.783926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.784079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.784218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.784246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.784390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.784530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.784561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.784721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.784827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.784864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.785015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.785204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.785232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.785348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.785495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.785525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.785670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.785794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.785822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.785978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.786125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.126 [2024-11-26 05:26:32.786153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.126 qpair failed and we were unable to recover it. 00:30:31.126 [2024-11-26 05:26:32.786290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.786398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.786427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.786614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.786788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.786817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.786968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.787113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.787140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.787294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.787462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.787489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.787614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.787736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.787762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.787901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.788056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.788090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.788271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.788400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.788428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.788523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.788650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.788682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.791857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.791996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.792028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.792195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.792318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.792343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.792504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.792628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.792671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.792815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.792944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.792973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.793118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.793257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.793287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.793410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.793507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.793532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.793663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.793808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.793836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.793938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.794057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.794086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.794267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.794418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.794462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.794626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.794779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.794808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.794946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.795061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.795092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.795254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.795420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.795450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.795562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.795715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.795755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.795894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.796038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.796067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.796237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.796434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.796478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.796599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.796768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.796797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.796938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.797046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.127 [2024-11-26 05:26:32.797089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.127 qpair failed and we were unable to recover it. 00:30:31.127 [2024-11-26 05:26:32.797243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.797371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.797398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.797531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.797626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.797656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.797809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.797927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.797956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.798128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.798230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.798255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.798418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.798566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.798595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.798773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.798887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.798916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.799038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.799183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.799211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.799352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.799492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.799522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.799698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.799827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.799855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.800009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.800187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.800231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.800368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.800537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.800567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.800716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.800881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.800922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.801122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.801277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.801320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.801485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.801614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.801643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.801834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.801962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.801992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.802090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.802244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.802270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.802406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.802571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.802600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.802738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.802867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.802896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.803076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.803203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.803230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.803387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.803554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.803584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.803765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.803895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.803922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.804032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.804188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.804216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.804364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.804476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.804506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.804675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.804823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.804851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.804968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.805100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.805126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.805254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.805419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.805448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.805586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.805737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.805767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.805900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.806053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.806081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.128 [2024-11-26 05:26:32.806189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.806325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.128 [2024-11-26 05:26:32.806354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.128 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.806521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.806670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.806705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.806838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.806968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.806994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.807156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.807286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.807318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.807445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.807597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.807627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.807748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.807859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.807885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.808039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.808179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.808208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.808385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.808539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.808566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.808748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.808874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.808901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.809060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.809228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.809258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.809438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.809565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.809592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.809747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.809870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.809897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.810027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.810180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.810207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.810358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.810538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.810568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.810699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.810858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.810885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.811012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.811153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.811182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.811324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.811458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.811487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.811639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.811780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.811809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.811934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.812075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.812105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.812247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.812381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.812410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.812523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.812660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.812695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.812822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.812991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.813021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.813155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.813292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.813322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.813449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.813569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.813596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.813709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.813827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.813857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.814033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.814174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.814201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.814329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.814460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.814487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.814651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.814786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.814814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.814953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.815127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.815154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.129 qpair failed and we were unable to recover it. 00:30:31.129 [2024-11-26 05:26:32.815277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.815376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.129 [2024-11-26 05:26:32.815403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.815512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.815691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.815719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.815871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.815993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.816023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.816146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.816267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.816294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.816442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.816546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.816576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.816749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.816884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.816914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.817061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.817188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.817216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.817321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.817444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.817471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.817604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.817699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.817745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.817888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.817994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.818021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.818149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.818321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.818350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.818479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.818611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.818641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.818803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.818939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.818966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.819069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.819217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.819247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.819417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.819562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.819592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.819717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.819849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.819877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.820049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.820213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.820278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.820458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.820624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.820654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.820800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.820923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.820951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.821133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.821298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.821327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.821470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.821607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.821638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.821816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.821963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.821990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.822145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.822287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.822316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.822481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.822645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.822675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.822796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.822950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.822977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.823119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.823255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.823288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.823425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.823549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.823580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.823714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.823853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.823880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.824030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.824180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.824208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.130 qpair failed and we were unable to recover it. 00:30:31.130 [2024-11-26 05:26:32.824333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.130 [2024-11-26 05:26:32.824472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.824503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.824650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.824815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.824857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.825010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.825136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.825161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.825331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.825497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.825526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.825702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.825866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.825896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.826032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.826172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.826200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.826354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.826508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.826534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.826664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.826798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.826824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.826947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.827087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.827118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.827240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.827358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.827387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.827509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.827637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.827666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.827863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.827990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.828016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.828147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.828287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.828315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.828466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.828591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.828616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.828809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.828907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.828935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.829058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.829199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.829229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.829404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.829561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.829604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.829775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.829916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.829944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.830084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.830260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.830287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.830443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.830615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.830643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.830810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.830974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.831004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.831158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.831254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.831281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.831384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.831511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.831538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.831714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.831843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.831869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.832012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.832175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.832204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.832347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.832476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.832502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.832599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.832733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.832767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.832914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.833028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.833056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.833176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.833330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.833356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.131 qpair failed and we were unable to recover it. 00:30:31.131 [2024-11-26 05:26:32.833539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.131 [2024-11-26 05:26:32.833770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.833801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.833944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.834076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.834105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.834219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.834345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.834370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.834519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.834656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.834691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.834846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.834972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.834998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.835127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.835280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.835323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.835496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.835625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.835651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.835839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.835938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.835967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.836116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.836250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.836277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.836434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.836596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.836625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.836757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.836922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.836950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.837091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.837201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.837227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.837332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.837434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.837459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.837567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.837691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.837717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.837830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.837921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.837948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.838104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.838215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.838244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.838391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.838547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.838572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.838703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.838827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.838853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.839007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.839160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.839190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.839317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.839494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.839524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.839679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.839823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.839849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.840000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.840115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.840145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.132 qpair failed and we were unable to recover it. 00:30:31.132 [2024-11-26 05:26:32.840258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.840400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.132 [2024-11-26 05:26:32.840428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.840567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.840721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.840749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.840904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.841063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.841093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.841264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.841433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.841461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.841585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.841707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.841744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.841856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.842005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.842031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.842153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.842304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.842333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.842489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.842641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.842667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.842837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.842977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.843006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.843171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.843294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.843323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.843476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.843601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.843628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.843741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.843855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.843885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.844039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.844181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.844210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.844361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.844490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.844516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.844668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.844818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.844846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.845014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.845189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.845218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.845364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.845518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.845544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.845701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.845840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.845868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.846054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.846183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.846209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.846339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.846436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.846462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.846602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.846769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.846799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.846943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.847070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.847096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.847250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.847377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.847418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.411 [2024-11-26 05:26:32.847596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.847718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.411 [2024-11-26 05:26:32.847748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.411 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.847916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.848090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.848117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.848269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.848371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.848396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.848550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.848705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.848749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.848887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.849041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.849070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.849223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.849353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.849378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.849515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.849683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.849717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.849853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.850013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.850040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.850187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.850280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.850308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.850439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.850585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.850615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.850752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.850884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.850913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.851069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.851199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.851225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.851343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.851509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.851537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.851682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.851853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.851882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.852011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.852166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.852193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.852344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.852485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.852513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.852653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.852826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.852854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.852994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.853090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.853116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.853266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.853396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.853425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.853557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.853712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.853739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.853845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.853972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.853998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.854119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.854263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.854291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.854403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.854514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.854542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.854670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.854831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.854857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.855040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.855176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.855209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.855376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.855516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.855546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.855664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.855822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.855849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.856010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.856196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.856221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.856326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.856501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.856531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.412 qpair failed and we were unable to recover it. 00:30:31.412 [2024-11-26 05:26:32.856710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.856837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.412 [2024-11-26 05:26:32.856863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.856991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.857144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.857172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.857282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.857433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.857459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.857590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.857727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.857754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.857912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.858084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.858113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.858237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.858389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.858418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.858625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.858734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.858760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.858862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.859011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.859039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.859170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.859288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.859316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.859466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.859614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.859641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.859805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.859959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.859985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.860143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.860319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.860346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.860473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.860599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.860625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.860773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.860929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.860954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.861148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.861300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.861327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.861465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.861613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.861639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.861842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.861950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.861976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.862082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.862177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.862203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.862331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.862424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.862450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.862622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.862766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.862795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.862905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.863038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.863066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.863218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.863316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.863341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.863493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.863634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.863664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.863829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.863964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.863992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.864145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.864276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.864301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.864447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.864589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.864618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.864769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.864912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.864942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.865093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.865248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.865289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.865436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.865625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.865652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.413 qpair failed and we were unable to recover it. 00:30:31.413 [2024-11-26 05:26:32.865787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.413 [2024-11-26 05:26:32.865920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.865946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.866078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.866225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.866267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.866403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.866541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.866569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.866695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.866811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.866841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.866995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.867124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.867150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.867284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.867428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.867457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.867603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.867742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.867773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.867905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.868057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.868084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.868233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.868366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.868395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.868531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.868700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.868731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.868876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.869035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.869062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.869159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.869276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.869307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.869473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.869609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.869639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.869781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.869881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.869908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.870058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.870268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.870321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.870459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.870573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.870603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.870766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.870887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.870913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.871100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.871220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.871247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.871401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.871522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.871552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.871663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.871815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.871841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.871992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.872104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.872135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.872307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.872459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.872486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.872647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.872790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.872817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.872973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.873105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.873135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.873275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.873453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.873480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.873576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.873707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.873742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.873903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.874035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.874062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.874181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.874319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.874353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.874503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.874595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.414 [2024-11-26 05:26:32.874622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.414 qpair failed and we were unable to recover it. 00:30:31.414 [2024-11-26 05:26:32.874739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.874913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.874939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.875087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.875235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.875264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.875409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.875559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.875587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.875771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.875981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.876049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.876216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.876367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.876394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.876546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.876669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.876706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.876870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.877034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.877062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.877198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.877343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.877372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.877523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.877625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.877652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.877775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.877881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.877907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.878046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.878187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.878218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.878338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.878487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.878514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.878667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.878819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.878848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.879030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.879161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.879187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.879316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.879468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.879512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.879673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.879843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.879872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.880024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.880140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.880170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.880352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.880482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.880525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.880701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.880840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.880870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.881028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.881177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.881204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.881333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.881430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.881456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.881608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.881750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.881779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.881932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.882097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.882127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.415 [2024-11-26 05:26:32.882275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.882378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.415 [2024-11-26 05:26:32.882404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.415 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.882526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.882711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.882743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.882840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.882981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.883009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.883135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.883256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.883282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.883420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.883564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.883590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.883725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.883821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.883866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.884027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.884180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.884207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.884396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.884526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.884553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.884701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.884812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.884840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.885015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.885184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.885214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.885328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.885493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.885523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.885655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.885828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.885858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.886041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.886173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.886217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.886331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.886465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.886494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.886664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.886826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.886858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.887007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.887162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.887188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.887344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.887487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.887516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.887648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.887772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.887802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.887950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.888107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.888133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.888304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.888433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.888463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.888568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.888699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.888730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.888910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.889006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.889044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.889200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.889341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.889383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.889484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.889608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.889637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.889772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.889903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.889930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.890068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.890210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.890240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.890374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.890484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.890519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.890664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.890806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.890833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.890979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.891093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.891122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.416 qpair failed and we were unable to recover it. 00:30:31.416 [2024-11-26 05:26:32.891293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.891469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.416 [2024-11-26 05:26:32.891495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.891628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.891751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.891779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.891937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.892136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.892202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.892349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.892525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.892553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.892679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.892780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.892807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.892960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.893102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.893132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.893246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.893378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.893407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.893557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.893713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.893740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.893870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.894050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.894077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.894229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.894373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.894403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.894544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.894640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.894666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.894831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.894970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.895001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.895146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.895259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.895288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.895420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.895564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.895591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.895767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.895909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.895938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.896034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.896150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.896179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.896347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.896476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.896502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.896632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.896740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.896784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.896917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.897062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.897092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.897236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.897329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.897357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.897532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.897695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.897722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.897877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.898032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.898061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.898238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.898392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.898436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.898579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.898716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.898744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.898876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.899022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.899050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.899210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.899338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.899364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3429095 Killed "${NVMF_APP[@]}" "$@" 00:30:31.417 [2024-11-26 05:26:32.899520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.899649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.899679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 [2024-11-26 05:26:32.899833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 05:26:32 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:31.417 [2024-11-26 05:26:32.899997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.900031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.417 qpair failed and we were unable to recover it. 00:30:31.417 05:26:32 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:31.417 [2024-11-26 05:26:32.900210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 [2024-11-26 05:26:32.900338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.417 05:26:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:31.417 [2024-11-26 05:26:32.900365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 05:26:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:31.418 [2024-11-26 05:26:32.900522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 05:26:32 -- common/autotest_common.sh@10 -- # set +x 00:30:31.418 [2024-11-26 05:26:32.900698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.900727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.900838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.900987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.901016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.901165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.901295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.901321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.901468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.901613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.901640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.901790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.901888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.901914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.902019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.902114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.902158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.902333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.902482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.902529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.902644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.902800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.902827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.902957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.903093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.903122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.903269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.903398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.903424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.903575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.903714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.903748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.903889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.904041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.904070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.904196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.904319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.904346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.904446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.904543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.904572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.904699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.904842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.904872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.905059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.905181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.905207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 05:26:32 -- nvmf/common.sh@469 -- # nvmfpid=3429798 00:30:31.418 [2024-11-26 05:26:32.905363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 05:26:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:31.418 05:26:32 -- nvmf/common.sh@470 -- # waitforlisten 3429798 00:30:31.418 [2024-11-26 05:26:32.905511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.905537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.905691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 05:26:32 -- common/autotest_common.sh@829 -- # '[' -z 3429798 ']' 00:30:31.418 [2024-11-26 05:26:32.905850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.905885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 wit 05:26:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:31.418 h addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.906040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 05:26:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:31.418 [2024-11-26 05:26:32.906191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 05:26:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:31.418 [2024-11-26 05:26:32.906219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 witWaiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:31.418 h addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 05:26:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:31.418 [2024-11-26 05:26:32.906383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 05:26:32 -- common/autotest_common.sh@10 -- # set +x 00:30:31.418 [2024-11-26 05:26:32.906526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.906554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.906719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.906866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.906894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.907053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.907183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.907210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.907311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.907438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.907483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.907591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.907754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.907787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.907918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.908046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.908073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.418 [2024-11-26 05:26:32.908226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.908360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.418 [2024-11-26 05:26:32.908389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.418 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.908534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.908677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.908714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.908857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.908988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.909015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.909170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.909336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.909364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.909543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.909679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.909716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.909857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.909965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.909992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.910169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.910276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.910306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.910466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.910574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.910600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.910721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.910826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.910851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.911026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.911139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.911169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.911329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.911452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.911478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.911608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.911740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.911772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.911927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.912091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.912122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.912275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.912399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.912426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.912578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.912680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.912714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.912845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.913008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.913036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.913203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.913315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.913359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.913488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.913612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.913639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.913743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.913868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.913895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.914042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.914176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.914205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.914346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.914468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.914493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.914684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.914806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.914834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.915016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.915117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.915143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.915271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.915399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.915426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.915548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.915696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.915727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.915844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.915993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.916021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.916183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.916310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.916336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.916482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.916620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.916650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.916812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.916980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.917009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.419 [2024-11-26 05:26:32.917156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.917305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.419 [2024-11-26 05:26:32.917331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.419 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.917483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.917648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.917677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.917810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.917956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.917986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.918137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.918291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.918317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.918471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.918594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.918620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.918758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.918878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.918908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.919085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.919205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.919231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.919343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.919481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.919509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.919645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.919758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.919803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.919936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.920058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.920084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.920263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.920438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.920464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.920594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.920764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.920794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.920918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.921039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.921065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.921200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.921323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.921351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.921488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.921613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.921639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.921811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.921908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.921933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.922084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.922224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.922253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.922418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.922557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.922586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.922756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.922906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.922932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.923117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.923938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.923972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.924144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.924283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.924313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.924491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.924596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.924625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.924811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.924939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.924965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.925119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.925229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.925258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.925960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.926144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.926174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.926294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.926460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.926490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.420 qpair failed and we were unable to recover it. 00:30:31.420 [2024-11-26 05:26:32.926630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.420 [2024-11-26 05:26:32.926789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.926816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.926926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.927052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.927080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.927255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.927420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.927449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.927598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.927733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.927762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.927870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.928041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.928067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.928246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.928374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.928403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.928545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.928692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.928724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.928882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.928991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.929022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.929174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.929308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.929337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.929511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.929661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.929705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.929834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.929935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.929962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.930114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.930278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.930306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.930449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.930599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.930625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.930760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.930916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.930961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.931095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.931263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.931289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.931395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.931569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.931597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.931772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.931918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.931944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.932111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.932277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.932307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.932423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.932585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.932611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.932769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.932903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.932947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.933079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.933223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.933254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.933400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.933525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.933551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.933655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.933770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.933797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.933950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.934060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.934091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.934236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.934374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.934402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.934561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.934712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.934739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.934840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.934993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.935019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.935187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.935359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.935386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.935552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.935676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.421 [2024-11-26 05:26:32.935715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.421 qpair failed and we were unable to recover it. 00:30:31.421 [2024-11-26 05:26:32.935881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.936030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.936059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.936175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.936308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.936337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.936511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.936629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.936656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.936831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.936980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.937007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.937127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.937272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.937301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.937444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.937560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.937586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.937708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.937847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.937876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.938087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.938209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.938236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.938356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.938489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.938515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.938713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.938817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.938843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.938987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.939129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.939157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.939304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.939408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.939434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.939582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.939724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.939755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.939898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.940041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.940070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.940221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.940375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.940418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.940556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.940727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.940755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.940853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.941008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.941033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.941166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.941292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.941319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.941438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.941611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.941641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.941805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.941968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.942005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.942167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.942319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.942346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.942499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.942675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.942754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.942896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.943081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.943122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.943281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.943414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.943440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.943568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.943752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.943778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.943884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.944049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.944075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.944206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.944331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.944356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.944511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.944673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.944714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.944830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.944934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.422 [2024-11-26 05:26:32.944963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.422 qpair failed and we were unable to recover it. 00:30:31.422 [2024-11-26 05:26:32.945140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.945266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.945295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.945451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.945593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.945621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.945747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.945865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.945894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.946035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.946162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.946189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.946370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.946500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.946530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.946672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.946827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.946855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.947005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.947129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.947156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.947327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.947493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.947527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.947704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.947849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.947889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.948097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.948241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.948268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.948468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.948620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.948645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.948815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.948971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.949009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.949125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.949288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.949314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.949445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.949591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.949623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.949744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.949862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.949890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.950059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.950166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.950192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.950320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.950469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.950498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.950640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.950765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.950794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.950944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.951070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.951097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.951256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.951400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.951426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.951538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.951646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.951699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 [2024-11-26 05:26:32.951663] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.951770] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:31.423 [2024-11-26 05:26:32.951839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.951938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.951962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.952073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.952182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.952207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.952308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.952404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.952430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.952560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.952701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.952746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.952845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.952953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.953008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.953159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.953337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.953381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.953564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.953711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.423 [2024-11-26 05:26:32.953757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.423 qpair failed and we were unable to recover it. 00:30:31.423 [2024-11-26 05:26:32.953877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.954019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.954049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.954191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.954331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.954360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.954520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.954652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.954699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.954832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.954974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.955006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.955129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.955257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.955285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.955462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.955597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.955623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.955738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.955880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.955909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.956050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.956158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.956187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.956317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.956418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.956445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.956579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.956722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.956754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.956867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.956980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.957010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.957136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.957260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.957287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.957412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.957567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.957593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.957707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.957858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.957886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.958050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.958201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.958226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.958405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.958515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.958545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.958675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.958804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.958834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.958958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.959087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.959113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.959248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.959360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.959389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.959531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.959645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.959694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.959832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.959940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.959965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.960120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.960258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.960287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.960456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.960572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.960606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.960761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.960856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.960883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.960995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.961125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.961154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.424 qpair failed and we were unable to recover it. 00:30:31.424 [2024-11-26 05:26:32.961273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.961400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.424 [2024-11-26 05:26:32.961429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.961553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.961674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.961708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.961834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.961933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.961961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.962147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.962264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.962292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.962445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.962536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.962562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.962661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.962797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.962827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.962940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.963051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.963080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.963201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.963327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.963353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.963485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.963617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.963646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.963799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.963906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.963932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.964071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.964221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.964246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.964412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.964546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.964590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.964731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.964850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.964880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.965038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.965165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.965192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.965319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.965469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.965497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.965609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.965775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.965805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.965957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.966086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.966111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.966278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.966405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.966433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.966559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.966700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.966731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.966873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.966969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.967000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.967122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.967261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.967289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.967444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.967625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.967650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.967770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.967895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.967921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.968075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.968184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.968213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.968354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.968496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.968526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.968649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.968772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.968799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.968947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.969065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.969094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.425 qpair failed and we were unable to recover it. 00:30:31.425 [2024-11-26 05:26:32.969232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.425 [2024-11-26 05:26:32.969399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.969428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.969571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.969735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.969762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.969914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.970083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.970113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.970277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.970417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.970446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.970600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.970736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.970763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.970899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.971026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.971055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.971202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.971376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.971405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.971526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.971649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.971696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.971885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.971993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.972019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.972167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.972308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.972336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.972485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.972604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.972629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.972813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.972920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.972946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.973098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.973243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.973269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.973369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.973479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.973507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.973642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.973786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.973815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.973948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.974127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.974153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.974280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.974410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.974438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.974595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.974753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.974781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.974888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.975024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.975051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.975176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.975301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.975327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.975506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.975631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.975657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.975790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.975934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.975968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.976145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.976265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.976291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.976466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.976582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.976611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.976732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.976833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.976860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.976960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.977111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.977138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.977315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.977456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.977486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.977626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.977767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.977797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.977920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.978042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.978068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.426 qpair failed and we were unable to recover it. 00:30:31.426 [2024-11-26 05:26:32.978188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.426 [2024-11-26 05:26:32.978288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.978330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.978510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.978638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.978664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.978809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.978933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.978960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.979115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.979285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.979314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.979455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.979575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.979601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.979773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.979936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.979963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.980113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.980288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.980314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.980442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.980545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.980572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.980669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.980787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.980814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.980976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.981107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.981133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.981293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.981438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.981468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.981609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.981830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.981861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.981964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.982115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.982142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.982271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.982415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.982446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.982618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.982805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.982836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.983012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.983114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.983142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.983234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.983361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.983387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.983548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.983679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.983733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.983850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.984002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.984028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.984152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.984295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.984324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.984480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.984578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.984605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.984772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.984881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.984909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.985091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.985241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.985267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.985456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.985580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.985605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.985781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.985927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.985953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.986136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.986277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.986306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.986430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.986555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.986581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.986740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.986881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.986909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.987057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.987192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.987221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.427 qpair failed and we were unable to recover it. 00:30:31.427 [2024-11-26 05:26:32.987377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.427 [2024-11-26 05:26:32.987529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.987555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.987701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.987826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.987852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.987983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.988104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.988130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.988233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.988361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.988386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.988579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.988722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.988749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.988928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.989073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.989102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.989253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.989356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.989382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.989540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.989699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.989751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.989874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 EAL: No free 2048 kB hugepages reported on node 1 00:30:31.428 [2024-11-26 05:26:32.990043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.990073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.990224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.990347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.990375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.990519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.990634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.990663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.990816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.990964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.990998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.991155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.991287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.991328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.991480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.991643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.991672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.991827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.991940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.991968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.992111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.992211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.992236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.992356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.992522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.992550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.992715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.992896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.992925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.993076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.993250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.993276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.993409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.993628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.993664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.993811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.993943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.993979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.994131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.994231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.994257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.994414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.994560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.994586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.994698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.994852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.994878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.995035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.995170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.995200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.995309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.995447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.995473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.995572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.995715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.995741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.995869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.995972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.995997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.996119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.996219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.428 [2024-11-26 05:26:32.996245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.428 qpair failed and we were unable to recover it. 00:30:31.428 [2024-11-26 05:26:32.996409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.996534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.996560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:32.996683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.996821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.996846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:32.996999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.997124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.997149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:32.997279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.997381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.997407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:32.997542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.997645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.997670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:32.997777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.997908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.997934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:32.998081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.998204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.998230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:32.998359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.998484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.998509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:32.998602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.998711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.998738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:32.998845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.998946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.998973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:32.999107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.999257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.999283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:32.999416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.999564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.999589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:32.999715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.999811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:32.999836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:32.999971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.000100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.000126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.000244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.000347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.000372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.000499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.000638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.000665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.000850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.000943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.000969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.001112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.001238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.001264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.001370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.001524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.001550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.001654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.001818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.001844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.001979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.002101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.002126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.002223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.002371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.002396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.002523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.002620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.002645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.002749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.002875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.002902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.003063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.003186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.003212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.003313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.003435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.003461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.003595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.003717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.003744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.003851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.003942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.003968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.004130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.004255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.429 [2024-11-26 05:26:33.004280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.429 qpair failed and we were unable to recover it. 00:30:31.429 [2024-11-26 05:26:33.004410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.004537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.004562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.004691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.004801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.004827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.004956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.005073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.005099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.005204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.005330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.005355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.005485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.005635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.005660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.005811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.005916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.005943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.006041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.006144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.006170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.006301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.006424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.006451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.006602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.006716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.006744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.006878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.007019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.007046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.007150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.007284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.007309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.007461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.007598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.007623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.007779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.007935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.007960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.008079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.008241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.008268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.008389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.008541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.008567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.008677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.008819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.008846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.008998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.009155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.009181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.009303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.009426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.009455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.009600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.009722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.009749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.009877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.010020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.010046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.010171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.010296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.010322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.010418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.010518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.010545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.010667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.010793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.010820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.010946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.011067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.011093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.011221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.011320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.011347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.430 qpair failed and we were unable to recover it. 00:30:31.430 [2024-11-26 05:26:33.011443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.430 [2024-11-26 05:26:33.011593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.011619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.011720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.011841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.011867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.011974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.012101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.012131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.012229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.012354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.012380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.012519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.012612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.012638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.012777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.012930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.012956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.013060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.013180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.013207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.013364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.013486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.013511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.013640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.013796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.013822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.013962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.014091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.014116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.014218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.014343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.014368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.014466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.014618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.014644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.014784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.014937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.014964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.015107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.015203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.015229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.015356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.015511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.015536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.015700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.015834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.015860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.015993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.016118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.016144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.016294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.016411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.016437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.016563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.016712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.016740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.016873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.017027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.017053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.017199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.017323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.017349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.017480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.017611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.017637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.017750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.017839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.017865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.017987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.018083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.018110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.018213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.018315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.018341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.018494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.018591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.018617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.018719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.018847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.018875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.018980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.019111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.019137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.019267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.019420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.431 [2024-11-26 05:26:33.019446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.431 qpair failed and we were unable to recover it. 00:30:31.431 [2024-11-26 05:26:33.019540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.019668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.019700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.019827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.019953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.019985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.020109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.020212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.020239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.020366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.020466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.020493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.020621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.020771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.020799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.020927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.021037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.021063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.021215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.021315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.021341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.021463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.021593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.021619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.021757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.021852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.021878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.022009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.022145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.022171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.022289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.022409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.022434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.022584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.022677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.022711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.022806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.022894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.022920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.023063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.023194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.023220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.023345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.023471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.023497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.023597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.023727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.023754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.023854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.024010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.024048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.024177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.024297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.024323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.024434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.024526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.024551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.024613] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:31.432 [2024-11-26 05:26:33.024649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.024784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.024811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.024937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.025109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.025135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.025289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.025442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.025468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.025624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.025752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.025778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.025911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.026038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.026064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.026167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.026269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.026294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.026405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.026529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.026554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.026693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.026795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.026822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.026953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.027058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.027084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.432 [2024-11-26 05:26:33.027239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.027368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.432 [2024-11-26 05:26:33.027394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.432 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.027524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.027614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.027640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.027801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.027920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.027946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.028123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.028227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.028252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.028384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.028513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.028539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.028672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.028804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.028830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.028983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.029141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.029172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.029306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.029432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.029457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.029579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.029713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.029739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.029896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.030011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.030036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.030133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.030265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.030291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.030423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.030552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.030578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.030691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.030807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.030832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.030959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.031063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.031089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.031213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.031333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.031358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.031480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.031610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.031641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.031788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.031895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.031921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.032086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.032238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.032265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.032395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.032524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.032550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.032647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.032776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.032803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.032908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.033009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.033035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.033137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.033291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.033317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.033456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.033614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.033640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.033754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.033881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.033906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.034066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.034215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.034240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.034343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.034470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.034496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.034657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.034772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.034798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.034911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.035065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.035091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.035242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.035377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.035403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.433 [2024-11-26 05:26:33.035533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.035633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.433 [2024-11-26 05:26:33.035659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.433 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.035782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.035877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.035903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.036008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.036161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.036187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.036287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.036385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.036412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.036520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.036666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.036734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.036858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.037008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.037033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.037162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.037267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.037292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.037418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.037526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.037552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.037725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.037825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.037850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.037969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.038093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.038118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.038272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.038424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.038449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.038607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.038732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.038760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.038920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.039046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.039071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.039207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.039307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.039333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.039457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.039610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.039636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.039764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.039852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.039877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.040012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.040108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.040133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.040226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.040378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.040404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.040507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.040665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.040696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.040833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.040978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.041004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.041133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.041237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.041265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.041421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.041523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.041549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.041670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.041829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.041856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.041988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.042113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.042139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.042271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.042398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.042424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.042550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.042675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.434 [2024-11-26 05:26:33.042718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.434 qpair failed and we were unable to recover it. 00:30:31.434 [2024-11-26 05:26:33.042850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.043004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.043030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.043163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.043296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.043323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.043457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.043584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.043614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.043777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.043908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.043934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.044032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.044133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.044161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.044292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.044384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.044409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.044532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.044655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.044681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.044802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.044936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.044962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.045067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.045196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.045223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.045380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.045476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.045502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.045659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.045789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.045816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.045922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.046044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.046070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.046209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.046305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.046330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.046466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.046624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.046650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.046787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.046918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.046943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.047063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.047188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.047215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.047349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.047506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.047532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.047663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.047776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.047803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.047935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.048037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.048063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.048194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.048325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.048350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.048492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.048591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.048617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.048753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.048854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.048881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.049048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.049210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.049236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.049370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.049500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.049526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.049661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.049819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.049846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.049947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.050048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.050074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.050167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.050293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.050320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.050448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.050550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.050578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.050718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.050851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.435 [2024-11-26 05:26:33.050877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.435 qpair failed and we were unable to recover it. 00:30:31.435 [2024-11-26 05:26:33.050998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.051094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.051121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.051255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.051356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.051382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.051507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.051639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.051666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.051794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.051889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.051915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.052021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.052153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.052180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.052272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.052393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.052420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.052578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.052704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.052731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.052856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.052981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.053009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.053138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.053272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.053297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.053433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.053586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.053612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.053710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.053863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.053889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.053991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.054111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.054137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.054256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.054352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.054377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.054505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.054659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.054692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.054824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.054979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.055005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.055162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.055261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.055287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.055442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.055566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.055592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.055752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.055849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.055875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.056004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.056096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.056121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.056217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.056319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.056345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.056450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.056599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.056625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.056783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.056906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.056932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.057063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.057167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.057193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.057322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.057446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.057472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.057604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.057721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.057753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.057912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.058043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.058069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.058166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.058284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.058310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.058442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.058544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.058570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.058730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.058833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.436 [2024-11-26 05:26:33.058859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.436 qpair failed and we were unable to recover it. 00:30:31.436 [2024-11-26 05:26:33.058963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.059118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.059144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.059295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.059393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.059419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.059524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.059676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.059708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.059837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.059994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.060020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.060152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.060275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.060302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.060402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.060554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.060585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.060723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.060850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.060877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.060978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.061137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.061164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.061331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.061435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.061461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.061592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.061727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.061754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.061890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.062022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.062049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.062156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.062318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.062345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.062456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.062580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.062606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.062745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.062848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.062874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.063013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.063142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.063170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.063323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.063448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.063475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.063580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.063703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.063730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.063835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.063942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.063968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.064123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.064220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.064247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.064404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.064499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.064526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.064651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.064754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.064782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.064917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.065050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.065076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.065203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.065298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.065324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.065459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.065588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.065614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.065746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.065841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.065867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.065993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.066091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.066117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.066226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.066353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.066379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.066499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.066622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.066648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.066763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.066859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.437 [2024-11-26 05:26:33.066885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.437 qpair failed and we were unable to recover it. 00:30:31.437 [2024-11-26 05:26:33.067006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.067101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.067127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.067254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.067352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.067378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.067509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.067642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.067668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.067786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.067889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.067916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.068020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.068148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.068174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.068302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.068436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.068462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.068556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.068683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.068736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.068867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.069025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.069053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.069186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.069310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.069336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.069468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.069598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.069623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.069777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.069909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.069934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.070093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.070221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.070247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.070350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.070508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.070534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.070656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.070790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.070816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.070925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.071081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.071106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.071264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.071390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.071415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.071543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.071643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.071668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.071829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.071930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.071955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.072082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.072184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.072211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.072339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.072497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.072523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.072649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.072784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.072810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.072915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.073043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.073068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.073199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.073289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.073315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.073411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.073508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.073534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.073636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.073777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.073804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.073909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.074032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.074059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.074191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.074295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.074321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.074421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.074587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.074620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.074780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.074935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.438 [2024-11-26 05:26:33.074962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.438 qpair failed and we were unable to recover it. 00:30:31.438 [2024-11-26 05:26:33.075094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.075242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.075269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.075365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.075487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.075513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.075670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.075803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.075830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.075963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.076117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.076143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.076276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.076370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.076396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.076509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.076603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.076628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.076730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.076826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.076851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.076955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.077103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.077129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.077286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.077438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.077463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.077595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.077718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.077744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.077872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.077968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.077995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.078152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.078255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.078282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.078447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.078545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.078571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.078666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.078826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.078853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.079006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.079110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.079136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.079248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.079342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.079369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.079502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.079608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.079636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.079777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.079907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.079933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.080039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.080203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.080229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.080367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.080490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.080516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.080672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.080818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.080845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.080976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.081080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.081106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.081235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.081371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.081397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.081507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.081642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.081669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.081808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.081938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.081963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.439 qpair failed and we were unable to recover it. 00:30:31.439 [2024-11-26 05:26:33.082114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.082234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.439 [2024-11-26 05:26:33.082259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.082402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.082502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.082528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.082620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.082743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.082769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.082872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.083027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.083053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.083189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.083278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.083303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.083403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.083530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.083556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.083649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.083752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.083780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.083907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.084011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.084036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.084192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.084344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.084370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.084499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.084621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.084646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.084852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.085005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.085031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.085183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.085338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.085364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.085499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.085620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.085645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.085762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.085888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.085915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.086021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.086148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.086174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.086300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.086426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.086452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.086604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.086728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.086755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.086885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.087003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.087029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.087159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.087286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.087311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.087474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.087606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.087632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.087767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.087873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.087901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.088016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.088144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.088169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.088266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.088421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.088447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.088565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.088720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.088747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.088857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.089012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.089042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.089199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.089322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.089348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.089478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.089575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.089600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.089700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.089805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.089832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.089928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.090082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.090109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.440 qpair failed and we were unable to recover it. 00:30:31.440 [2024-11-26 05:26:33.090237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.090364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.440 [2024-11-26 05:26:33.090390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.090492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.090624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.090651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.090760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.090865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.090893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.090997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.091095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.091122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.091274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.091402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.091429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.091556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.091677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.091713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.091825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.091925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.091953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.092088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.092216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.092243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.092344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.092468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.092496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.092651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.092778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.092804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.092936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.093059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.093085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.093217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.093304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.093329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.093458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.093614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.093640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.093778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.093909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.093936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.094038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.094142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.094168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.094324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.094455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.094483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.094619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.094722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.094749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.094877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.095010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.095036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.095138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.095284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.095311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.095448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.095574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.095600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.095724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.095835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.095861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.095966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.096092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.096117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.096246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.096395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.096421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.096554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.096651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.096677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.096818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.096925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.096951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.097049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.097199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.097224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.097357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.097483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.097510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.097639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.097763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.097791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.097895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.098015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.098041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.441 qpair failed and we were unable to recover it. 00:30:31.441 [2024-11-26 05:26:33.098196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.441 [2024-11-26 05:26:33.098294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.098321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.098419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.098570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.098597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.098728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.098839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.098866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.098967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.099116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.099143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.099270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.099392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.099417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.099555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.099702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.099729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.099886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.100016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.100042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.100172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.100303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.100329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.100464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.100566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.100592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.100745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.100850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.100876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.101037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.101168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.101196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.101321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.101472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.101497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.101593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.101728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.101756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.101885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.102042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.102068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.102224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.102326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.102352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.102504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.102633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.102659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.102824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.102950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.102977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.103108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.103270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.103301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.103427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.103523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.103548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.103669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.103833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.103859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.104000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.104101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.104127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.104247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.104400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.104426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.104559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.104713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.104742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.104875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.105032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.105058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.105187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.105313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.105340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.105463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.105567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.105595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.105722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.105831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.105857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.105957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.106052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.106083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.106182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.106304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.106331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.442 qpair failed and we were unable to recover it. 00:30:31.442 [2024-11-26 05:26:33.106427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.106548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.442 [2024-11-26 05:26:33.106574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.106702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.106799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.106825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.106977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.107135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.107161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.107322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.107442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.107467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.107593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.107713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.107739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.107843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.107943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.107969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.108102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.108227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.108254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.108385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.108505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.108531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.108665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.108800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.108826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.108968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.109070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.109096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.109252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.109402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.109428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.109561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.109698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.109725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.109836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.109960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.109986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.110081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.110211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.110238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.110397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.110547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.110573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.110705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.110837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.110863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.110992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.111120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.111145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.111270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.111402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.111428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.111534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.111634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.111659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.111793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.111921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.111946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.112075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.112226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.112253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.112359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.112453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.112480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.112585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.112683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.112724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.112818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.112922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.112948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 qpair failed and we were unable to recover it. 00:30:31.443 [2024-11-26 05:26:33.113038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.113035] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:31.443 [2024-11-26 05:26:33.113136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.443 [2024-11-26 05:26:33.113157] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:31.443 [2024-11-26 05:26:33.113162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.443 [2024-11-26 05:26:33.113177] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of eventsqpair failed and we were unable to recover it. 00:30:31.443 at runtime. 00:30:31.443 [2024-11-26 05:26:33.113193] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:31.444 [2024-11-26 05:26:33.113295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.113249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:31.444 [2024-11-26 05:26:33.113292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:31.444 [2024-11-26 05:26:33.113319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:31.444 [2024-11-26 05:26:33.113412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.113322] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:31.444 [2024-11-26 05:26:33.113442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.113553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.113674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.113709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.113855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.113956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.113982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.114139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.114238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.114264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.114363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.114472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.114498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.114600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.114707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.114734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.114868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.114997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.115024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.115152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.115251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.115277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.115378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.115476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.115504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.115607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.115737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.115764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.115865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.115987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.116013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.116116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.116270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.116296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.116400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.116495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.116522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.116659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.116791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.116818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.116913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.117042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.117069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.117196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.117301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.117328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.117452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.117557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.117583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.117698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.117804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.117831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.117932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.118057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.118083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.118195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.118324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.118351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.118477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.118573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.118599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.118731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.118834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.118860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.118985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.119093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.119119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.119226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.119354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.119381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.119510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.119608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.119635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.119768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.119895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.119922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.120022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.120121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.120147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.444 qpair failed and we were unable to recover it. 00:30:31.444 [2024-11-26 05:26:33.120270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.120373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.444 [2024-11-26 05:26:33.120399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.120503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.120603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.120629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.120740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.120857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.120883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.120982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.121085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.121111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.121215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.121304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.121330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.121434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.121591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.121618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.121708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.121806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.121833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.121935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.122035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.122062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.122185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.122279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.122305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.122425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.122546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.122573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.122704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.122823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.122850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.122948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.123083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.123110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.123206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.123308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.123334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.123424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.123551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.123577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.123730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.123832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.123860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.123980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.124114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.124141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.124300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.124452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.124478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.124606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.124698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.124725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.124821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.124942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.124969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.125093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.125184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.125210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.125332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.125431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.125458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.125590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.125698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.125725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.125824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.125955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.125981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.126094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.126201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.126227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.126324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.126449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.126475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.126571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.126702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.126734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.126866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.126968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.126994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.127149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.127246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.127273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.127376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.127473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.127499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.445 qpair failed and we were unable to recover it. 00:30:31.445 [2024-11-26 05:26:33.127601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.445 [2024-11-26 05:26:33.127726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.127753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.127855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.127953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.127981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.128072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.128223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.128250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.128378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.128503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.128530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.128627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.128762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.128789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.128888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.128979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.129005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.129136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.129232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.129264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.129393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.129485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.129511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.129605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.129701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.129727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.129850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.129974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.130000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.130120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.130242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.130268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.130361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.130468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.130494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.130602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.130737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.130764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.130869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.131008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.131035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.131144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.131273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.131299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.131395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.131488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.131514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.131640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.131754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.131787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.131917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.132016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.132042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.132136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.132241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.132267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.132364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.132518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.132544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.132645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.132773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.132800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.132891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.133017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.133043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.133144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.133238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.133264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.133371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.133516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.133542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.133633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.133743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.133769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.133871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.133974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.134000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.134155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.134306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.134332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.134494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.134592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.134618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.134742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.134841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.446 [2024-11-26 05:26:33.134867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.446 qpair failed and we were unable to recover it. 00:30:31.446 [2024-11-26 05:26:33.134961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.135084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.135110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.135230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.135326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.135352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.135442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.135568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.135594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.135751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.135854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.135880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.135983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.136080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.136106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.136238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.136333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.136358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.136480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.136575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.136601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.136703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.136821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.136847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.136964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.137092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.137117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.137220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.137344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.137370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.137469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.137597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.137622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.137747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.137841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.137867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.137966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.138100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.138126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.138234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.138353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.138379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.138512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.138669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.138703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.138804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.138895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.138921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.139055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.139162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.139187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.139313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.139436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.139461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.139584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.139697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.139724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.139834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.139936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.139961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.140118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.140241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.140266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.140397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.140518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.140545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.140667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.140800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.140826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.140921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.141030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.141056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.141190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.141319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.141345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.141471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.141600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.141626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.141727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.141823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.141848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.141939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.142028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.142053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.447 [2024-11-26 05:26:33.142151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.142281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.447 [2024-11-26 05:26:33.142307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.447 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.142434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.142528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.142554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.142703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.142797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.142824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.142916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.143045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.143071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.143199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.143291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.143317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.143425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.143577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.143603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.143728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.143857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.143883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.144013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.144153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.144179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.144277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.144373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.144398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.144528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.144627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.144653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.144770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.144898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.144929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.145061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.145187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.145213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.145344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.145440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.145465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.145592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.145728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.145754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.145860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.145963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.145989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.146120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.146246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.146271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.146395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.146521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.146546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.146677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.146779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.146805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.146896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.147016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.147042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.147132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.147228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.147253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.147365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.147462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.147488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.147621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.147760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.147787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.147886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.147983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.148008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.148107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.148237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.148263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.148357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.148461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.148487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.448 [2024-11-26 05:26:33.148613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.148749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.448 [2024-11-26 05:26:33.148776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.448 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.148875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.148983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.149010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.149101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.149228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.149254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.149357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.149451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.149477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.149576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.149697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.149723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.149816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.149948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.149973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.150081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.150201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.150227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.150324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.150420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.150445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.150565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.150660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.150694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.150785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.150903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.150929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.151057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.151148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.151174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.151285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.151412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.151438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.151563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.151704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.151730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.151836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.151963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.151988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.152095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.152216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.152242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.152347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.152451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.152477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.152634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.152737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.152763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.152894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.152988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.153014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.153137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.153286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.153312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.153422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.153513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.153539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.153666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.153806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.153833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.153939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.154106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.154132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.154287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.154382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.154407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.154513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.154636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.154662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.154794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.154894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.154919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.155060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.155184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.449 [2024-11-26 05:26:33.155209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.449 qpair failed and we were unable to recover it. 00:30:31.449 [2024-11-26 05:26:33.155341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.155444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.155470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.155624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.155757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.155784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.155890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.155992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.156018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.156116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.156239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.156264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.156420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.156514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.156539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.156638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.156737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.156763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.156863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.156958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.156983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.157074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.157202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.157227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.157326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.157456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.157482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.157580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.157681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.157713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.157867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.157995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.158024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.158136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.158261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.158287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.158396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.158515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.158540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.158664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.158764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.158790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.158887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.159025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.159052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.159185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.159295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.159321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.159420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.159519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.159545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.159673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.159792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.159819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.159918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.160033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.160059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.160167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.160253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.160279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.160367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.160487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.160513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.160650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.160795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.160823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.160989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.161115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.735 [2024-11-26 05:26:33.161142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.735 qpair failed and we were unable to recover it. 00:30:31.735 [2024-11-26 05:26:33.161281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.161434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.161461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.161564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.161723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.161752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.161856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.161978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.162004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.162105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.162235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.162261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.162357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.162457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.162484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.162607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.162769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.162796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.162896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.162999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.163025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.163146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.163249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.163276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.163378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.163471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.163497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.163598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.163697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.163724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.163815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.163945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.163971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.164097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.164230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.164257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.164364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.164488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.164516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.164609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.164705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.164732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.164843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.164996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.165023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.165120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.165220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.165247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.165399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.165520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.165546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.165647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.165747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.165774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.165886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.166002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.166029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.166156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.166262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.166290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.166412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.166509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.166536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.166626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.166766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.166793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.166920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.167046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.167074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.167199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.167324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.167351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.167458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.167554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.167582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.167747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.167844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.167870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.167962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.168103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.168130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.168229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.168359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.168386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.168486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.168611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.736 [2024-11-26 05:26:33.168639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.736 qpair failed and we were unable to recover it. 00:30:31.736 [2024-11-26 05:26:33.168747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.168874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.168901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.169026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.169181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.169208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.169339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.169479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.169506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.169612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.169702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.169730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.169854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.169959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.169987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.170088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.170215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.170242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.170344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.170449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.170476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.170602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.170734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.170762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.170865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.170962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.171001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.171100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.171197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.171228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.171355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.171491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.171518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.171648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.171792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.171820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.171929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.172041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.172070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.172167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.172290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.172316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.172452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.172546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.172573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.172704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.172806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.172833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.172965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.173094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.173121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.173264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.173389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.173416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.173551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.173677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.173711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.173820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.173913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.173947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.174108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.174207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.174234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.174339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.174467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.174495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.174617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.174744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.174771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.174864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.174958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.174996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.175151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.175250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.175278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.175379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.175474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.175502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.175600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.175753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.175780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.175882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.175980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.176008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.176170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.176263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.737 [2024-11-26 05:26:33.176290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.737 qpair failed and we were unable to recover it. 00:30:31.737 [2024-11-26 05:26:33.176419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.176510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.176537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.176639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.176774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.176802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.176905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.177003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.177029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.177134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.177232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.177259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.177384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.177497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.177524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.177648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.177784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.177811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.177918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.178054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.178082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.178217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.178312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.178339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.178449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.178579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.178606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.178711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.178844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.178870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.178978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.179111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.179138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.179272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.179397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.179424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.179526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.179616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.179643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.179767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.179931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.179958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.180085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.180212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.180238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.180395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.180499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.180525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.180627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.180734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.180761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.180859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.180946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.180972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.181112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.181215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.181241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.181338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.181425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.181452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.181553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.181654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.181681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.181794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.181890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.181916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.182031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.182157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.182186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.182292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.182413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.182440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.182568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.182658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.182693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.182808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.182926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.182951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.183062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.183161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.183188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.183315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.183452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.183479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.183590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.183683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.738 [2024-11-26 05:26:33.183717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.738 qpair failed and we were unable to recover it. 00:30:31.738 [2024-11-26 05:26:33.183832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.183927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.183953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.184089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.184219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.184245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.184347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.184474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.184501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.184630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.184763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.184789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.184913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.185071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.185098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.185206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.185339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.185366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.185499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.185595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.185621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.185750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.185852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.185879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.185979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.186076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.186102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.186204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.186304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.186331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.186462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.186571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.186599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.186723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.186813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.186840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.186944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.187038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.187069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.187162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.187295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.187322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.187448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.187549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.187575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.187695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.187796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.187823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.187913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.188015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.188042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.188145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.188276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.188303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.188434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.188561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.188588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.188731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.188857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.188884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.189005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.189155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.189181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.189280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.189388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.189415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.189509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.189611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.189638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.739 [2024-11-26 05:26:33.189746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.189858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.739 [2024-11-26 05:26:33.189884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.739 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.190012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.190108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.190136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.190238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.190359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.190386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.190483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.190581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.190607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.190707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.190817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.190844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.190952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.191116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.191142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.191261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.191386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.191413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.191543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.191640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.191667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.191809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.191900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.191927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.192025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.192118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.192144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.192285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.192413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.192440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.192565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.192657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.192683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.192786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.192885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.192912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.193022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.193177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.193204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.193304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.193438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.193465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.193589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.193717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.193744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.193849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.193943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.193970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.194079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.194238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.194265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.194419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.194518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.194544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.194641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.194754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.194782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.194884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.194996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.195023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.195153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.195244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.195270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.195375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.195510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.195536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.195671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.195788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.195815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.195945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.196099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.196126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.196254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.196377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.196405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.196506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.196624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.196651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.196794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.196898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.196926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.197027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.197159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.197186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.740 [2024-11-26 05:26:33.197286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.197440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.740 [2024-11-26 05:26:33.197467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.740 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.197593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.197699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.197727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.197885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.198010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.198036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.198142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.198270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.198297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.198418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.198514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.198541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.198675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.198780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.198808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.198907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.199001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.199027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.199117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.199206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.199233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.199365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.199487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.199514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.199633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.199804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.199832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.199927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.200021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.200049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.200176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.200303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.200335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.200460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.200593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.200620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.200733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.200835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.200861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.200955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.201074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.201100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.201225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.201312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.201339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.201441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.201579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.201606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.201729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.201829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.201856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.201962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.202062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.202089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.202196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.202320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.202346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.202444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.202572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.202599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.202699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.202829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.202856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.202970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.203101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.203128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.203233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.203385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.203412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.203516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.203705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.203733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.203838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.203968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.203996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.204122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.204230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.204257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.204380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.204480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.204508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.204633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.204739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.204769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.741 qpair failed and we were unable to recover it. 00:30:31.741 [2024-11-26 05:26:33.204905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.205032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.741 [2024-11-26 05:26:33.205060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.205153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.205281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.205308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.205414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.205513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.205542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.205649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.205786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.205815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.205918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.206016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.206043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.206138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.206270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.206297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.206454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.206581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.206609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.206739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.206832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.206859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.206960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.207060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.207087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.207209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.207300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.207328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.207430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.207522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.207549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.207655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.207782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.207810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.207911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.208069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.208096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.208198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.208298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.208324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.208416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.208511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.208538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.208643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.208778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.208805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.208938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.209036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.209063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.209217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.209349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.209376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.209476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.209608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.209635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.209737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.209837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.209864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.209982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.210078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.210104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.210240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.210330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.210357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.210456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.210605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.210632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.210731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.210829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.210857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.210955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.211108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.211135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.211234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.211341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.211368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.211457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.211547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.211573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.211702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.211802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.211829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.211928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.212054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.212081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.742 qpair failed and we were unable to recover it. 00:30:31.742 [2024-11-26 05:26:33.212188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.212279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.742 [2024-11-26 05:26:33.212305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.212401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.212520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.212546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.212700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.212794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.212820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.212914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.213017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.213043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.213173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.213276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.213310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.213416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.213548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.213575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.213673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.213828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.213856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.214009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.214107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.214134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.214266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.214364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.214391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.214488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.214584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.214610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.214737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.214830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.214856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.214988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.215117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.215144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.215278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.215396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.215423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.215552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.215649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.215676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.215788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.215895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.215922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.216052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.216154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.216180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.216283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.216379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.216407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.216512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.216642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.216668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.216807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.216907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.216934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.217062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.217210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.217237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.217358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.217458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.217485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.217580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.217706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.217733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.217887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.217985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.218011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.218161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.218256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.218284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.218436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.218557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.218583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.218706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.218815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.218842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.218948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.219069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.219096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.219222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.219314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.219341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.219467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.219565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.219592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.743 qpair failed and we were unable to recover it. 00:30:31.743 [2024-11-26 05:26:33.219733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.219838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.743 [2024-11-26 05:26:33.219865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.219962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.220089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.220117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.220244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.220344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.220370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.220500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.220625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.220652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.220763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.220894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.220921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.221022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.221112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.221139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.221252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.221378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.221407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.221514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.221617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.221644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.221774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.221872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.221900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.222001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.222104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.222135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.222232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.222324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.222351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.222477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.222597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.222624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.222751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.222847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.222874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.222978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.223111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.223138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.223269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.223365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.223394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.223500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.223619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.223647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.223805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.223904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.223932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.224032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.224125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.224153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.224280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.224377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.224405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.224538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.224635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.224663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.224796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.224926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.224953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.225052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.225159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.225186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.225304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.225418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.225446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.225547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.225646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.225674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.225785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.225875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.225902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.226028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.226114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.226141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.744 qpair failed and we were unable to recover it. 00:30:31.744 [2024-11-26 05:26:33.226264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.744 [2024-11-26 05:26:33.226391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.226422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.226518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.226637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.226663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.226772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.226929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.226956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.227058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.227190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.227217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.227344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.227442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.227469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.227600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.227725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.227753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.227914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.228004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.228031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.228153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.228254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.228281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.228375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.228527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.228554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.228704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.228834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.228861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.228983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.229084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.229115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.229248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.229343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.229370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.229458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.229560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.229587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.229716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.229818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.229845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.229941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.230057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.230083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.230183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.230274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.230301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.230400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.230520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.230546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.230635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.230725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.230751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.230865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.230965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.230992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.231092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.231182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.231209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.231338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.231457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.231484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.231586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.231691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.231718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.231812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.231935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.231962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.232052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.232171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.232197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.232329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.232458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.232486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.232607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.232727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.232754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.232876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.232968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.232995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.233087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.233220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.233247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.233373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.233496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.745 [2024-11-26 05:26:33.233524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.745 qpair failed and we were unable to recover it. 00:30:31.745 [2024-11-26 05:26:33.233621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.233753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.233780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.233936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.234030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.234057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.234181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.234275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.234301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.234457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.234554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.234580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.234678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.234813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.234839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.234934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.235052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.235078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.235203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.235331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.235357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.235511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.235638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.235665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.235770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.235862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.235888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.236013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.236105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.236133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.236221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.236318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.236347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.236444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.236538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.236565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.236698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.236833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.236861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.236960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.237080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.237107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.237207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.237311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.237338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.237438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.237525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.237551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.237692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.237826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.237854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.237956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.238047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.238074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.238172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.238273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.238299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.238396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.238513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.238540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.238697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.238795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.238822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.238920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.239041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.239068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.239164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.239267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.239294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.239415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.239539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.239565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.239720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.239844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.239871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.239999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.240095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.240121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.240222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.240345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.240372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.240472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.240598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.240624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.240719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.240819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.746 [2024-11-26 05:26:33.240846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.746 qpair failed and we were unable to recover it. 00:30:31.746 [2024-11-26 05:26:33.240936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.241087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.241114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.241233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.241352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.241380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.241474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.241563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.241590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.241716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.241821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.241852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.241972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.242102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.242129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.242254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.242355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.242382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.242481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.242600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.242627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.242748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.242878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.242905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.243033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.243131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.243159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.243282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.243375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.243402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.243507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.243659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.243694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.243818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.243941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.243969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.244102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.244198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.244226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.244333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.244461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.244488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.244593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.244708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.244736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.244837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.244959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.244986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.245145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.245233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.245259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.245357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.245465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.245492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.245589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.245715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.245742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.245872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.245967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.245994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.246126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.246256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.246284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.246436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.246534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.246561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.246655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.246763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.246791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.246913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.247048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.247075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.247198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.247300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.247327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.247455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.247553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.247581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.247691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.247792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.247819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.247948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.248102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.248130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.248228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.248365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.747 [2024-11-26 05:26:33.248392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.747 qpair failed and we were unable to recover it. 00:30:31.747 [2024-11-26 05:26:33.248493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.248603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.248631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.248731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.248861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.248888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.249016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.249114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.249142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.249250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.249375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.249402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.249521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.249647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.249675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.249830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.249933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.249960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.250089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.250211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.250238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.250333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.250424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.250451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.250556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.250694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.250722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.250820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.250920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.250947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.251049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.251171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.251198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.251294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.251385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.251412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.251506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.251627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.251654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.251783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.251882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.251908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.252033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.252134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.252161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.252285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.252417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.252443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.252564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.252719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.252747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.252851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.252946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.252972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.253066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.253194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.253222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.253326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.253423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.253449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.253544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.253640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.253667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.253780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.253873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.253899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.254006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.254131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.254158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.254300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.254421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.254447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.254570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.254703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.254730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.748 qpair failed and we were unable to recover it. 00:30:31.748 [2024-11-26 05:26:33.254828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.748 [2024-11-26 05:26:33.254953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.254984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.255080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.255211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.255239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.255340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.255429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.255455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.255556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.255683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.255717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.255836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.255925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.255951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.256053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.256178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.256205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.256323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.256408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.256435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.256563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.256698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.256725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.256820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.256931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.256958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.257069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.257195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.257222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.257347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.257473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.257501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.257634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.257732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.257760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.257880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.258008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.258035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.258133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.258258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.258285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.258375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.258499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.258526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.258624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.258746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.258773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.258878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.258979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.259006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.259117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.259240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.259268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.259364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.259457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.259484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.259578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.259676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.259710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.259831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.259952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.259979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.260112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.260211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.260238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.260354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.260473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.260499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.260600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.260724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.260752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.260846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.260944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.260970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.261075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.261163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.261189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.261320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.261441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.261467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.261565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.261672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.261714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.261820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.261954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.261981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.749 qpair failed and we were unable to recover it. 00:30:31.749 [2024-11-26 05:26:33.262084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.749 [2024-11-26 05:26:33.262237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.262264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.262395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.262488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.262514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.262641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.262773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.262800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.262924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.263020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.263047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.263169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.263323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.263349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.263442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.263567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.263593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.263716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.263809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.263836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.263944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.264065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.264091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.264188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.264311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.264337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.264436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.264532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.264559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.264692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.264783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.264809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.264909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.265034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.265060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.265218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.265326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.265353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.265486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.265586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.265612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.265708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.265808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.265834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.265926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.266027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.266055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.266180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.266302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.266329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.266430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.266527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.266554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.266677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.266785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.266813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.266901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.267027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.267055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.267156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.267262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.267289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.267441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.267561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.267588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.267722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.267825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.267857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.267964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.268116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.268143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.268241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.268345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.268372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.268473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.268568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.268595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.268726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.268827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.268855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.268981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.269087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.269114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.269236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.269356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.269383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.750 qpair failed and we were unable to recover it. 00:30:31.750 [2024-11-26 05:26:33.269483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.750 [2024-11-26 05:26:33.269603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.269629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.269758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.269859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.269885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.269997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.270119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.270146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.270246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.270339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.270370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.270462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.270593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.270620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.270724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.270829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.270857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.270954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.271053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.271080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.271215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.271345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.271371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.271490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.271616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.271643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.271776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.271883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.271911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.272030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.272165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.272192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.272305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.272398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.272425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.272549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.272665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.272698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.272797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.272924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.272952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.273084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.273209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.273236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.273336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.273433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.273460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.273591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.273709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.273737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.273833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.273960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.273987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.274088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.274209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.274236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.274326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.274476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.274503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.274629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.274729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.274757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.274887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.275009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.275036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.275132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.275258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.275285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.275409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.275540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.275568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.275670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.275790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.275817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.275915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.276012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.276039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.276166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.276291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.276318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.276441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.276533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.276560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.276659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.276789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.276816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.751 qpair failed and we were unable to recover it. 00:30:31.751 [2024-11-26 05:26:33.276921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.751 [2024-11-26 05:26:33.277022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.277049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.277179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.277270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.277296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.277387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.277512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.277538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.277638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.277741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.277768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.277888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.277986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.278012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.278111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.278241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.278268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.278394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.278493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.278520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.278619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.278723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.278750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.278847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.278944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.278971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.279086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.279179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.279205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.279332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.279428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.279454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.279584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.279721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.279749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.279845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.279967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.279993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.280121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.280216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.280242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.280343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.280465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.280491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.280590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.280736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.280764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.280897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.280995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.281021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.281124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.281225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.281252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.281378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.281472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.281500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.281630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.281731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.281759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.281855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.281944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.281971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.282097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.282247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.282274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.282392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.282520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.282547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.282671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.282777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.282806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.282902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.283011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.283038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.283135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.283259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.283290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.283417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.283535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.283562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.283655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.283757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.283785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.283890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.283986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.284013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.752 qpair failed and we were unable to recover it. 00:30:31.752 [2024-11-26 05:26:33.284106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.752 [2024-11-26 05:26:33.284233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.284259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.284347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.284446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.284473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.284596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.284703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.284730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.284853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.284954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.284980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.285131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.285229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.285255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.285353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.285473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.285499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.285598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.285727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.285754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.285880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.285971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.285997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.286102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.286201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.286227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.286331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.286479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.286505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.286608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.286715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.286743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.286843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.286961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.286988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.287117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.287220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.287246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.287375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.287532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.287559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.287680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.287808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.287834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.287924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.288050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.288076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.288228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.288365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.288392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.288522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.288643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.288670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.288782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.288914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.288940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.289051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.289176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.289203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.289323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.289415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.289441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.289573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.289668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.289704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.289827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.289957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.289984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.290082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.290183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.290210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.290333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.290455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.290482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.290608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.290711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.753 [2024-11-26 05:26:33.290739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.753 qpair failed and we were unable to recover it. 00:30:31.753 [2024-11-26 05:26:33.290892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.290989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.291016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.291141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.291232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.291259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.291384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.291503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.291530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.291629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.291722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.291750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.291888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.292041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.292067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.292159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.292310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.292337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.292433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.292528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.292556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.292684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.292817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.292844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.292958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.293066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.293093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.293186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.293282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.293309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.293434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.293565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.293592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.293698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.293791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.293818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.293913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.294017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.294043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.294140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.294270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.294296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.294405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.294548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.294575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.294669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.294782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.294809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.294938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.295034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.295061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.295161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.295280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.295306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.295395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.295486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.295513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.295618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.295748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.295775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.295877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.295982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.296008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.296098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.296216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.296247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.296348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.296447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.296475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.296600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.296764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.296792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.296915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.297004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.297030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.297131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.297260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.297287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.297411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.297512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.297539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.297668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.297773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.297801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.754 [2024-11-26 05:26:33.297900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.298025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.754 [2024-11-26 05:26:33.298052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.754 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.298153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.298252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.298278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.298379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.298498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.298525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.298678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.298809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.298837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.298939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.299046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.299073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.299175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.299271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.299297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.299447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.299553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.299579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.299712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.299835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.299862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.299958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.300065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.300092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.300187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.300308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.300335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.300462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.300590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.300618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.300768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.300894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.300921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.301053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.301151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.301178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.301282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.301378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.301406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.301512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.301617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.301644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.301770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.301894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.301921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.302023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.302175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.302202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.302297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.302404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.302432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.302530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.302657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.302712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.302814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.302911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.302939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.303034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.303139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.303165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.303306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.303414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.303442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.303534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.303632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.303659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.303760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.303884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.303910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.304041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.304159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.304186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.304329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.304451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.304478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.304604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.304702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.304730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.304857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.304981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.305008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.305140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.305265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.305292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.755 qpair failed and we were unable to recover it. 00:30:31.755 [2024-11-26 05:26:33.305415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.305510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.755 [2024-11-26 05:26:33.305536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.305627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.305768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.305795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.305916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.306021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.306047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.306148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.306253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.306280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.306403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.306499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.306527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.306636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.306775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.306803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.306925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.307024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.307050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.307151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.307278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.307304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.307434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.307525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.307552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.307646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.307757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.307784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.307897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.308026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.308052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.308153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.308259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.308285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.308437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.308535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.308561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.308656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.308757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.308784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.308906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.309003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.309030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.309172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.309295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.309325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.309447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.309534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.309561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.309705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.309827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.309853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.309952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.310081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.310109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.310239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.310392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.310419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.310518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.310616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.310642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.310804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.310901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.310927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.311025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.311147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.311173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.311330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.311426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.311453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.311580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.311692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.311720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.311849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.311951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.311979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.312110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.312204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.312231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.312333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.312453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.312479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.312600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.312705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.756 [2024-11-26 05:26:33.312733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.756 qpair failed and we were unable to recover it. 00:30:31.756 [2024-11-26 05:26:33.312824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.312932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.312958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.313050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.313148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.313175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.313298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.313449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.313475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.313574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.313662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.313707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.313820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.313938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.313965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.314067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.314190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.314217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.314317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.314414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.314441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.314548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.314678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.314714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.314846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.314968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.314993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.315099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.315192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.315220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.315326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.315456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.315483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.315587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.315742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.315770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.315876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.315978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.316005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.316107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.316206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.316234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.316353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.316451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.316478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.316573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.316701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.316728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.316821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.316913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.316940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.317043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.317164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.317192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.317302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.317391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.317419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.317525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.317678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.317719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.317817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.317918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.317945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.318066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.318169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.318196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.318322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.318424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.318450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.318548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.318646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.318672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.318804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.318904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.318931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.319070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.319167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.319193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.319291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.319419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.319446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.757 qpair failed and we were unable to recover it. 00:30:31.757 [2024-11-26 05:26:33.319552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.319653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.757 [2024-11-26 05:26:33.319681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.319788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.319888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.319916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.320048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.320165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.320192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.320291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.320443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.320469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.320560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.320661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.320695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.320820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.320919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.320945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.321053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.321173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.321200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.321293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.321417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.321444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.321565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.321657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.321692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.321801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.321889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.321916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.322040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.322188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.322219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.322343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.322469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.322495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.322622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.322758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.322785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.322880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.322999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.323025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.323151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.323305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.323332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.323424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.323527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.323553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.323647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.323751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.323778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.323900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.324001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.324027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.324154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.324255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.324281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.324436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.324558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.324584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.324692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.324789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.324821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.324932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.325040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.325066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.325169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.325280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.325307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.325405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.325502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.325530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.325661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.325801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.325829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.325922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.326076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.326102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.326204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.326294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.326320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.758 qpair failed and we were unable to recover it. 00:30:31.758 [2024-11-26 05:26:33.326419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.758 [2024-11-26 05:26:33.326509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.326536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.326669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.326798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.326825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.326945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.327043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.327069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.327168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.327293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.327320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.327447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.327534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.327560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.327662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.327826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.327854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.327951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.328078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.328106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.328198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.328325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.328351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.328479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.328584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.328610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.328706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.328800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.328827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.328953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.329078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.329105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.329201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.329297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.329324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.329426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.329546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.329573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.329698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.329827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.329854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.329993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.330100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.330127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.330256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.330352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.330380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.330511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.330606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.330633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.330720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.330830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.330858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.330953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.331078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.331104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.331233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.331356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.331384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.331508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.331659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.331692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.331795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.331923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.331951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.332047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.332152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.332180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.332279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.332374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.332400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.332525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.332627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.332654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.332770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.332863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.332889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.332995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.333121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.333149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.333279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.333383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.333409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.333503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.333597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.333624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.759 qpair failed and we were unable to recover it. 00:30:31.759 [2024-11-26 05:26:33.333755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.759 [2024-11-26 05:26:33.333858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.333885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.334014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.334141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.334168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.334265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.334390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.334417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.334565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.334660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.334693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.334825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.334914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.334940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.335047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.335175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.335203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.335335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.335428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.335455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.335548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.335642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.335670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.335776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.335898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.335924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.336026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.336124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.336150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.336248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.336347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.336374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.336476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.336608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.336636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.336734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.336828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.336855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.336944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.337044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.337070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.337167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.337258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.337284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.337390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.337482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.337513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.337618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.337721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.337749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.337879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.337976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.338002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.338134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.338255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.338282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.338386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.338488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.338515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.338644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.338745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.338772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.338902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.339007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.339033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.339132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.339230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.339256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.339348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.339477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.339505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.339658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.339776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.339803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.339933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.340022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.340049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.340183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.340304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.340330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.340455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.340564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.340590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.340692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.340789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.340816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.760 qpair failed and we were unable to recover it. 00:30:31.760 [2024-11-26 05:26:33.340916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.760 [2024-11-26 05:26:33.341046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.341072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.341200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.341293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.341320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.341447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.341545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.341572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.341678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.341832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.341860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.341986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.342081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.342109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.342237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.342368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.342395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.342523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.342693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.342720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.342852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.343004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.343031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.343128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.343231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.343258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.343363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.343489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.343517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.343653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.343766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.343794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.343925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.344019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.344046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.344169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.344271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.344298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.344388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.344497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.344523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.344615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.344769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.344796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.344892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.344988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.345015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.345146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.345277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.345304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.345399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.345521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.345548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.345672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.345809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.345837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.345977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.346100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.346127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.346258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.346381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.346408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.346536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.346655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.346683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.346798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.346896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.346923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.347011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.347107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.347134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.347235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.347320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.347346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.347447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.347577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.347604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.347729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.347851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.347877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.348035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.348167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.348195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.348300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.348428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.348456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.761 qpair failed and we were unable to recover it. 00:30:31.761 [2024-11-26 05:26:33.348587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.761 [2024-11-26 05:26:33.348697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.348725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.348848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.348949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.348975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.349096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.349218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.349245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.349367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.349492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.349517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.349607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.349730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.349759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.349862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.349956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.349984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.350112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.350213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.350241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.350345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.350442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.350468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.350596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.350696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.350728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.350857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.350963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.350991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.351116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.351242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.351269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.351389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.351485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.351512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.351612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.351757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.351785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.351912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.352009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.352035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.352133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.352230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.352256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.352343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.352450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.352476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.352574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.352672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.352706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.352810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.352907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.352935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.353034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.353158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.353186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.353297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.353399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.353425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.353515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.353622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.353648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.353834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.353960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.353987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.354145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.354243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.354271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.354372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.354465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.354491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.354588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.354717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.354745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.762 [2024-11-26 05:26:33.354874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.354973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.762 [2024-11-26 05:26:33.355000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.762 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.355101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.355192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.355219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.355322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.355476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.355502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.355653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.355751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.355778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.355884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.355977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.356003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.356132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.356230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.356257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.356359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.356457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.356483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.356583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.356688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.356715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.356809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.356913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.356940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.357040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.357172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.357199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.357354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.357452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.357479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.357602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.357768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.357796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.357949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.358077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.358103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.358209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.358332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.358358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.358455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.358546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.358572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.358663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.358824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.358851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.358945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.359032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.359058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.359212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.359339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.359365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.359468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.359598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.359624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.359716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.359839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.359865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.359969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.360119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.360146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.360238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.360334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.360360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.360475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.360591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.360618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.360765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.360869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.360895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.361002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.361109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.361136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.361258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.361355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.361381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.361500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.361632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.361658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.361770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.361899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.361926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.362050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.362174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.362201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.763 [2024-11-26 05:26:33.362296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.362423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.763 [2024-11-26 05:26:33.362450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.763 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.362583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.362674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.362707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.362817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.362908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.362935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.363092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.363181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.363208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.363362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.363513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.363540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.363663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.363799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.363830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.363924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.364024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.364050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.364152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.364250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.364276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.364433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.364530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.364557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.364648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.364807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.364836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.364936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.365067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.365094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.365222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.365349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.365375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.365498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.365627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.365653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.365791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.365914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.365940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.366040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.366172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.366199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.366321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.366421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.366452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.366574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.366677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.366714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.366816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.366927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.366954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.367059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.367180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.367206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.367309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.367428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.367456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.367576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.367669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.367704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.367834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.367931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.367959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.368127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.368246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.368272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.368399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.368495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.368521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.368616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.368711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.368739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.368836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.368965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.368992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.369093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.369182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.369208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.369310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.369434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.369460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.369559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.369680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.369714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.764 [2024-11-26 05:26:33.369822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.369920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.764 [2024-11-26 05:26:33.369946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.764 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.370041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.370135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.370164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.370291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.370414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.370441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.370539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.370657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.370683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.370790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.370891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.370917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.371037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.371135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.371161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.371290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.371413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.371439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.371573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.371674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.371707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.371807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.371932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.371959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.372058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.372148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.372174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.372265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.372357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.372384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.372482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.372580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.372607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.372706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.372801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.372827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.372932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.373019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.373046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.373157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.373283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.373309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.373405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.373502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.373529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.373633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.373765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.373792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.373956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.374058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.374085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.374186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.374308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.374334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.374466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.374598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.374624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.374729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.374884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.374911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.375007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.375103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.375130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.375229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.375347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.375373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.375466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.375597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.375624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.375751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.375858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.375885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.376040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.376134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.376161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.376283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.376409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.376436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.376564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.376694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.376722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.376827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.376935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.376962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.765 [2024-11-26 05:26:33.377090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.377186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.765 [2024-11-26 05:26:33.377213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.765 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.377334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.377439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.377466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.377560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.377679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.377735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.377859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.377989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.378016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.378141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.378272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.378299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.378399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.378522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.378550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.378649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.378764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.378792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.378884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.378983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.379009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.379109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.379227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.379257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.379381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.379474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.379501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.379626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.379758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.379785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.379889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.379988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.380014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.380131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.380222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.380248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.380343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.380446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.380472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.380565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.380718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.380744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.380856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.380945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.380971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.381103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.381199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.381225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.381328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.381422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.381448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.381544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.381667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.381701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.381838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.381941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.381969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.382094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.382200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.382227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.382319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.382454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.382481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.382579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.382678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.382712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.382807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.382908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.382935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.383030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.383158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.383185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.383287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.383373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.383399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.383532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.383625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.383651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.383762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.383886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.383912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.384028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.384132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.384158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.766 qpair failed and we were unable to recover it. 00:30:31.766 [2024-11-26 05:26:33.384268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.384362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.766 [2024-11-26 05:26:33.384389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.384516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.384615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.384642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.384784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.384876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.384903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.385001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.385125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.385152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.385276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.385371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.385398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.385497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.385618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.385645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.385805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.385906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.385933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.386056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.386157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.386184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.386280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.386373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.386401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.386525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.386616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.386643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.386788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.386884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.386911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.387039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.387131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.387158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.387253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.387350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.387376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.387470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.387571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.387599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.387721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.387832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.387858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.387965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.388097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.388124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.388220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.388314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.388340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.388447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.388597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.388624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.388746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.388845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.388871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.388966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.389059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.389086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.389191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.389292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.389320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.389453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.389546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.389573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.389671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.389804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.389832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.389926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.390011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.390038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.390137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.390238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.390266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.767 [2024-11-26 05:26:33.390387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.390495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.767 [2024-11-26 05:26:33.390521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.767 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.390650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.390786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.390814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.390936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.391031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.391058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.391164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.391264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.391292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.391420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.391519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.391547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.391641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.391755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.391787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.391893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.391986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.392012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.392133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.392242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.392268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.392362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.392448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.392474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.392573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.392667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.392702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.392829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.392929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.392956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.393046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.393177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.393203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.393302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.393429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.393456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.393559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.393682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.393740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.393831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.393927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.393954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.394079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.394172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.394199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.394297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.394427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.394455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.394614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.394710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.394738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.394829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.394955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.394983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.395079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.395173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.395202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.395293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.395443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.395471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.395558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.395653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.395680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.395790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.395921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.395949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.396050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.396170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.396196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.396302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.396390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.396417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.396520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.396705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.396733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.396890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.397017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.397044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.397148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.397284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.397311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.397402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.397527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.397554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.768 [2024-11-26 05:26:33.397676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.397807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.768 [2024-11-26 05:26:33.397834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.768 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.397995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.398120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.398148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.398244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.398343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.398371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.398468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.398566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.398594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.398693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.398794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.398820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.398920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.399019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.399045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.399168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.399298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.399324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.399420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.399514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.399540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.399666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.399773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.399800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.399901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.400060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.400087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.400213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.400308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.400335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.400483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.400572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.400599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.400713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.400812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.400838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.400938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.401036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.401062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.401189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.401284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.401311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.401432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.401560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.401586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.401712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.401813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.401839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.401930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.402038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.402065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.402166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.402263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.402291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.402424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.402519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.402546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.402675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.402810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.402837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.402931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.403084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.403112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.403240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.403363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.403390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.403516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.403618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.403644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.403748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.403846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.403872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.403975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.404070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.404098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.404197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.404357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.404385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.404515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.404630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.404661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.404797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.404953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.404980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.769 qpair failed and we were unable to recover it. 00:30:31.769 [2024-11-26 05:26:33.405102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.769 [2024-11-26 05:26:33.405227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.405254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.405380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.405503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.405530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.405624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.405719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.405746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.405854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.405976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.406002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.406167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.406327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.406353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.406480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.406576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.406600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.406702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.406794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.406820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.406955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.407048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.407075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.407171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.407302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.407329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.407438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.407532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.407559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.407654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.407784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.407811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.407904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.408007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.408035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.408156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.408303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.408331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.408432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.408551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.408578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.408718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.408811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.408838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.408935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.409056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.409083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.409177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.409281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.409308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.409409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.409506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.409533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.409660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.409775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.409803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.409913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.410046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.410073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.410204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.410290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.410316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.410467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.410561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.410587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.410681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.410778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.410805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.410906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.411026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.411053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.411155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.411253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.411280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.411378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.411478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.411505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.411605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.411703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.411731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.411832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.411960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.411988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.412080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.412181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.412209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.770 qpair failed and we were unable to recover it. 00:30:31.770 [2024-11-26 05:26:33.412313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.770 [2024-11-26 05:26:33.412442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.412468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.412574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.412668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.412720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.412828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.412952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.412978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.413132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.413229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.413255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.413356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.413444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.413470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.413598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.413695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.413722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.413816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.413914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.413940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.414032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.414130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.414156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.414252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.414375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.414402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.414498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.414595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.414621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.414721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.414853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.414880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.414980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.415076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.415102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.415253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.415379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.415406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.415526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.415647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.415673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.415777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.415868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.415894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.416000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.416133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.416159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.416312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.416442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.416468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.416560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.416650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.416676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.416805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.416907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.416933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.417034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.417164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.417189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.417285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.417380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.417411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.417537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.417670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.417705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.417809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.417899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.417925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.418046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.418147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.418173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.418266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.418394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.418420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.418573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.418677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.771 [2024-11-26 05:26:33.418713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.771 qpair failed and we were unable to recover it. 00:30:31.771 [2024-11-26 05:26:33.418814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.418909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.418936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.419034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.419132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.419158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.419256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.419352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.419378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.419495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.419622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.419648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.419753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.419875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.419906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.420030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.420129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.420156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.420249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.420348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.420376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.420471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.420622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.420649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.420747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.420882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.420909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.421008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.421161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.421188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.421286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.421406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.421433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.421559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.421649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.421677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.421794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.421896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.421923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.422013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.422111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.422137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.422260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.422350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.422377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.422536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.422634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.422660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.422799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.422891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.422917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.423005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.423106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.423132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.423251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.423347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.423374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.423462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.423587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.423616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.423712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.423819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.423846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.423944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.424040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.424067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.424186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.424336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.424362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.424488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.424576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.424603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.424697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.424808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.424835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.424940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.425097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.425124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.425253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.425377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.425404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.425524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.425615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.425642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.425754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.425875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.772 [2024-11-26 05:26:33.425902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.772 qpair failed and we were unable to recover it. 00:30:31.772 [2024-11-26 05:26:33.425995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.426100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.426127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.426248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.426374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.426400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.426493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.426614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.426641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.426750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.426847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.426874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.426979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.427076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.427103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.427209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.427330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.427357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.427444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.427575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.427602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.427711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.427809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.427836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.427958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.428048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.428074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.428176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.428273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.428300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.428404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.428511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.428537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.428668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.428773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.428802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.428897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.428986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.429014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.429146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.429268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.429295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.429401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.429527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.429555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.429648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.429775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.429803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.429952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.430051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.430079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.430171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.430269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.430297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.430395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.430515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.430542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.430638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.430757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.430785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.430918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.431014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.431041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.431138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.431267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.431294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.431421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.431555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.431582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.431714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.431817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.431845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.431936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.432057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.432084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.432193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.432314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.432342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.432463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.432557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.432588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.432743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.432832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.432859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.773 qpair failed and we were unable to recover it. 00:30:31.773 [2024-11-26 05:26:33.433014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.433140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.773 [2024-11-26 05:26:33.433167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.433264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.433385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.433412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.433508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.433597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.433624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.433748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.433852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.433885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.433984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.434081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.434109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.434209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.434333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.434361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.434456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.434581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.434608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.434739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.434832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.434859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.434954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.435083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.435110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.435267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.435369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.435397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.435487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.435617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.435645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.435754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.435855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.435884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.435986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.436087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.436113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.436201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.436322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.436348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.436452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.436581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.436607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.436710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.436831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.436858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.436958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.437087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.437114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.437240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.437338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.437365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.437458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.437589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.437617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.437735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.437826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.437854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.437956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.438056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.438083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.438191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.438341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.438368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.438458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.438585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.438612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.438708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.438842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.438869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.439001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.439097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.439124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.439242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.439362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.439388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.439517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.439636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.439663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.439822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.439968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.440000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.440139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.440264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.440291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.774 qpair failed and we were unable to recover it. 00:30:31.774 [2024-11-26 05:26:33.440426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.440556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.774 [2024-11-26 05:26:33.440583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.440740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.440848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.440876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.440974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.441068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.441095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.441221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.441324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.441353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.441455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.441579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.441606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.441740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.441836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.441864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.441995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.442144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.442171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.442265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.442395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.442422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.442525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.442653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.442680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.442813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.442921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.442948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.443073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.443173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.443200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.443345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.443477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.443505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.443636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.443744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.443771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.443867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.444019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.444046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.444137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.444234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.444261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.444359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.444464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.444493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.444649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.444780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.444808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.444951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.445042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.445069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.445200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.445357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.445385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.445484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.445582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.445612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.445715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.445841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.445869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.446007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.446096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.446124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.446212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.446335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.446362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.446458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.446565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.446593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.446696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.446806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.446834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.446941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.447044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.447071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.447170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.447314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.447341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.447461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.447594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.447621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.447759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.447860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.447888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.775 qpair failed and we were unable to recover it. 00:30:31.775 [2024-11-26 05:26:33.447996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.775 [2024-11-26 05:26:33.448087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.448115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.448217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.448321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.448349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.448483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.448579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.448606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.448704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.448834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.448861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.448999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.449096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.449123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.449258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.449464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.449492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.449620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.449717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.449745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.449877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.449985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.450013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.450112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.450211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.450238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.450331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.450462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.450489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.450585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.450724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.450753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.450856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.450957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.450985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.451079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.451208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.451236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.451374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.451466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.451494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.451617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.451710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.451738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.451837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.451939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.451966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.452099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.452193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.452220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.452340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.452468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.452495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.452618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.452746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.452776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.452912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.453040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.453067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.453192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.453326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.453354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.453454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.453543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.453575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.453678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.453795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.453823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.453923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.454021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.454049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.454181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.454275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.454303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.776 qpair failed and we were unable to recover it. 00:30:31.776 [2024-11-26 05:26:33.454406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.776 [2024-11-26 05:26:33.454533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.454560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.454652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.454784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.454812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.454935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.455069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.455095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.455249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.455350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.455377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.455477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.455683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.455717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.455817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.455927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.455955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.456053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.456152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.456184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.456285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.456439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.456466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.456562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.456670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.456706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.456811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.456952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.456979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.457104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.457228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.457255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.457357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.457478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.457506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.457636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.457734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.457762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.457889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.458017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.458045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.458140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.458228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.458255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.458376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.458465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.458492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.458594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.458716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.458748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.458875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.459007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.459035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.459162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.459286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.459313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.459411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.459508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.459535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.459629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.459724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.459752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.459854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.459942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.459969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.460069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.460174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.460203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.460304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.460402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.460430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.460551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.460697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.460725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.460857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.460964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.460992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.461093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.461211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.461243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.461347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.461474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.461501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.461621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.461720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.777 [2024-11-26 05:26:33.461747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.777 qpair failed and we were unable to recover it. 00:30:31.777 [2024-11-26 05:26:33.461848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.461979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.462006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.462139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.462260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.462287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.462440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.462563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.462591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.462696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.462821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.462848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.462969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.463093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.463121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.463222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.463324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.463353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.463480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.463581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.463610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.463712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.463843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.463871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.463985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.464113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.464142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.464300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.464396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.464423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.464559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.464657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.464693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.464799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.464909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.464937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.465065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.465171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.465198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.465299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.465397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.465424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.465530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.465661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.465707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.465832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.465929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.465956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.466082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.466187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.466215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.466347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.466502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.466530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.466639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.466779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.466808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.466910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.467010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.467038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.467171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.467268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.467295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.467398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.467606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.467633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.467767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.467893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.467921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.468021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.468116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.468143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.468271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.468395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.468422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.468554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.468682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.468714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.468813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.468922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.468950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.469045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.469250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.469279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.778 [2024-11-26 05:26:33.469438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.469566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.778 [2024-11-26 05:26:33.469593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.778 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.469697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.469820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.469848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.469952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.470050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.470078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.470173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.470303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.470330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.470418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.470512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.470541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.470650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.470753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.470780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.470914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.471017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.471045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.471146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.471307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.471335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.471432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.471567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.471595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.471729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.471833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.471860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.471995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.472119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.472147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.472246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.472347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.472377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.472508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.472662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.472695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.472822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.472944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.472971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.473095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.473185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.473213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.473338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.473431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.473458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.473583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.473715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.473743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.473950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.474070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.474097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.474229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.474352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.474379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.474466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.474620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.474647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.474867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.474967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.779 [2024-11-26 05:26:33.474994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:31.779 qpair failed and we were unable to recover it. 00:30:31.779 [2024-11-26 05:26:33.475094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.062 [2024-11-26 05:26:33.475197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.062 [2024-11-26 05:26:33.475226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.062 qpair failed and we were unable to recover it. 00:30:32.062 [2024-11-26 05:26:33.475344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.062 [2024-11-26 05:26:33.475468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.062 [2024-11-26 05:26:33.475496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.062 qpair failed and we were unable to recover it. 00:30:32.062 [2024-11-26 05:26:33.475616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.062 [2024-11-26 05:26:33.475820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.062 [2024-11-26 05:26:33.475849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.062 qpair failed and we were unable to recover it. 00:30:32.062 [2024-11-26 05:26:33.475977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.062 [2024-11-26 05:26:33.476109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.062 [2024-11-26 05:26:33.476136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.062 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.476259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.476362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.476390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.476493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.476591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.476618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.476825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.476918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.476945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.477066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.477165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.477193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.477295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.477403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.477431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.477535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.477660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.477693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.477850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.477977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.478004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.478098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.478191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.478218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.478320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.478444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.478471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.478569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.478664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.478696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.478905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.479027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.479054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.479150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.479303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.479330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.479483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.479576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.479603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.479701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.479807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.479835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.479940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.480071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.480099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.480222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.480362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.480394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.480533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.480640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.480669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.480782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.480889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.480917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.481018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.481113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.481141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.481242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.481398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.481426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.481520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.481619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.481647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.481750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.481879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.481907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.482032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.482171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.482198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.482298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.482404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.482431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.482528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.482628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.482655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.482794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.482894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.482923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.483051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.483190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.483217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.063 [2024-11-26 05:26:33.483366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.483499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.063 [2024-11-26 05:26:33.483526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.063 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.483655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.483767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.483795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.483924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.484028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.484055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.484157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.484308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.484334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.484456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.484588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.484614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.484720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.484824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.484851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.484948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.485047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.485073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.485171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.485263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.485290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.485379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.485481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.485508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.485610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.485731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.485758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.485886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.485976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.486003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.486130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.486220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.486247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.486346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.486467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.486494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.486624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.486721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.486749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.486844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.486943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.486969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.487065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.487189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.487216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.487349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.487446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.487472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.487597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.487701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.487728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.487860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.487993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.488019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.488116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.488235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.488261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.488357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.488481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.488507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.488602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.488719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.488746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.488847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.488951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.488977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.489108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.489227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.489254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.489362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.489486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.489512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.489619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.489717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.489744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.489844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.489973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.489999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.490101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.490218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.490244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.490341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.490443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.490470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.064 qpair failed and we were unable to recover it. 00:30:32.064 [2024-11-26 05:26:33.490611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.490729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.064 [2024-11-26 05:26:33.490755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.490886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.490991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.491017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.491147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.491296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.491322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.491448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.491577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.491603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.491708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.491807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.491834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.491939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.492036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.492063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.492173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.492293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.492320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.492410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.492513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.492539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.492629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.492738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.492765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.492869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.492967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.492994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.493118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.493244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.493270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.493399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.493496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.493523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.493643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.493753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.493781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.493878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.493978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.494005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.494131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.494228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.494254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.494408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.494529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.494556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.494661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.494760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.494788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.494880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.494981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.495007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.495139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.495231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.495257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.495360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.495488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.495519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.495649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.495775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.495802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.495905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.495994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.496020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.496150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.496270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.496296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.496392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.496488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.496514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.496620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.496726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.496753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.496865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.496988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.497014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.497113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.497241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.497268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.497401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.497526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.497552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.497653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.497748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.497774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.065 qpair failed and we were unable to recover it. 00:30:32.065 [2024-11-26 05:26:33.497883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.065 [2024-11-26 05:26:33.497978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.498010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.498132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.498262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.498288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.498418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.498514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.498540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.498635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.498727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.498753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.498853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.498952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.498979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.499077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.499203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.499229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.499380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.499475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.499501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.499630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.499758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.499785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.499923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.500044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.500070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.500163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.500284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.500310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.500430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.500581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.500611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.500708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.500806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.500832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.500962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.501054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.501080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.501177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.501301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.501328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.501430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.501522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.501549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.501655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.501762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.501789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.501882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.501985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.502011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.502138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.502286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.502313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.502407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.502498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.502523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.502621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.502743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.502770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.502869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.502966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.502996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.503120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.503244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.503271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.503363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.503495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.503521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.503641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.503778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.503805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.503896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.504018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.504044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.504144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.504265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.504291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.504423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.504548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.504574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.504673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.504799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.504825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.066 [2024-11-26 05:26:33.504918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.505009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.066 [2024-11-26 05:26:33.505035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.066 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.505173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.505324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.505351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.505446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.505543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.505570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.505710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.505802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.505828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.505938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.506063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.506090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.506188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.506312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.506338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.506435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.506529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.506555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.506655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.506785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.506812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.506923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.507016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.507042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.507207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.507302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.507329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.507427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.507516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.507542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.507647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.507810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.507837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.507931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.508024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.508050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.508147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.508237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.508264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.508359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.508481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.508507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.508611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.508763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.508790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.508885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.508982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.509009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.509134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.509281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.509307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.509434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.509531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.509557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.509662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.509788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.509815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.067 [2024-11-26 05:26:33.509912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.510010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.067 [2024-11-26 05:26:33.510037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.067 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.510162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.510248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.510274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.510374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.510463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.510489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.510602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.510696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.510723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.510823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.510914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.510941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.511037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.511135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.511162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.511290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.511381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.511408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.511513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.511667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.511700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.511797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.511903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.511930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.512055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.512153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.512179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.512276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.512397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.512423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.512515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.512662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.512695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.512802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.512906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.512932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.513035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.513157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.513183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.513288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.513412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.513438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.513568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.513655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.513682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.513830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.513925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.513952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.514045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.514172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.514198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.514303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.514451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.514476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.514606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.514735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.514762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.514854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.514977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.515004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.515134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.515302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.515328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.515449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.515538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.515565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.515670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.515803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.515831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.515957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.516058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.516083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.516207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.516297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.516323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.516421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.516549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.516575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.516681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.516781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.516808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.516902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.517006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.517032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.068 qpair failed and we were unable to recover it. 00:30:32.068 [2024-11-26 05:26:33.517158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.068 [2024-11-26 05:26:33.517281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.517307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.517440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.517567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.517595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.517718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.517847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.517873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.517962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.518050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.518077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.518212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.518302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.518328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.518426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.518551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.518577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.518712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.518814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.518840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.518949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.519081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.519107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.519231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.519330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.519356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.519453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.519587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.519614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.519706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.519795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.519822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.519918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.520048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.520074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.520176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.520269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.520295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.520393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.520497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.520523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.520659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.520765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.520791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.520889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.521040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.521066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.521162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.521287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.521313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.521419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.521536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.521562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.521706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.521814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.521841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.521966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.522092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.522118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.522222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.522346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.522372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.522529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.522657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.522683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.522824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.522943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.522969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.523126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.523247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.523274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.523444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.523560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.523590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.523706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.523829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.523855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.523960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.524062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.524088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.524212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.524306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.524332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.524459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.524583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.524609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.069 qpair failed and we were unable to recover it. 00:30:32.069 [2024-11-26 05:26:33.524715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.069 [2024-11-26 05:26:33.524808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.524834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.524935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.525092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.525117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.525245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.525351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.525377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.525534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.525625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.525651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.525759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.525852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.525879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.525976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.526113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.526140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.526269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.526400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.526425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.526519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.526627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.526653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.526763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.526857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.526884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.526996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.527091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.527117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.527207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.527332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.527357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.527464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.527563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.527589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.527746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.527878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.527904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.528033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.528123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.528149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.528301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.528397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.528423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.528521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.528651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.528683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.528789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.528908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.528934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.529058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.529185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.529211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.529314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.529438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.529464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.529560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.529694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.529721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.529849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.529943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.529969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.530066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.530175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.530202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.530294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.530387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.530414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.530522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.530617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.530643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.530778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.530882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.530908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.531015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.531114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.531141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.531285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.531415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.531441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.531534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.531659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.531694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.531824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.531930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.531958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.070 qpair failed and we were unable to recover it. 00:30:32.070 [2024-11-26 05:26:33.532095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.070 [2024-11-26 05:26:33.532187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.532214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.532334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.532437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.532464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.532568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.532658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.532693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.532791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.532885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.532911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.533013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.533137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.533163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.533261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.533360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.533386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.533474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.533595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.533621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.533720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.533852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.533878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.533980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.534081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.534107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.534257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.534360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.534386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.534478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.534602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.534629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.534739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.534863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.534888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.534993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.535090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.535117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.535207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.535305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.535330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.535424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.535548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.535575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.535716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.535847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.535873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.535966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.536058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.536084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.536188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.536308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.536334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.536454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.536579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.536606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.536706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.536828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.536854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.536977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.537103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.537129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.537226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.537318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.537344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.537492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.537611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.537638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.537797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.537897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.537923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.538050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.538171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.538197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.538325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.538423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.538450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.538550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.538682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.538716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.538811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.538916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.538943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.539049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.539146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.539172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.071 qpair failed and we were unable to recover it. 00:30:32.071 [2024-11-26 05:26:33.539280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.071 [2024-11-26 05:26:33.539376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.539403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.539500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.539587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.539613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.539727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.539822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.539848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.539956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.540053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.540080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.540205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.540332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.540359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.540489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.540589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.540616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.540724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.540815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.540841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.540940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.541091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.541118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.541213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.541352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.541384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.541479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.541572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.541599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.541722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.541849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.541876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.541985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.542074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.542100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.542225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.542327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.542353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.542452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.542558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.542586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.542682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.542810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.542837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.542959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.543077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.543103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.543199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.543332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.543358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.543456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.543550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.543577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.543672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.543774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.543805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.543931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.544038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.544064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.544157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.544247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.544274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.544372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.544468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.544495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.544599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.544698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.544725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.544835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.544927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.544954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.545053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.545185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.545211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.072 qpair failed and we were unable to recover it. 00:30:32.072 [2024-11-26 05:26:33.545309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.072 [2024-11-26 05:26:33.545431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.545457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.545558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.545651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.545677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.545820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.545942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.545969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.546067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.546165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.546191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.546320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.546423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.546450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.546545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.546672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.546728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.546843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.546970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.546997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.547097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.547194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.547220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.547309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.547403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.547429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.547535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.547656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.547682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.547815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.547916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.547942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.548071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.548160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.548186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.548287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.548436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.548462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.548585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.548693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.548720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.548834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.548930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.548956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.549077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.549201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.549227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.549353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.549475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.549501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.549654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.549756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.549784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.549882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.550035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.550062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.550187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.550316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.550342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.550462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.550551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.550577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.550676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.550803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.550829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.550928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.551028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.551053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.551147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.551272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.551299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.551420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.551575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.551602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.551698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.551800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.551828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.551940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.552095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.552122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.552253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.552342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.552368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.552495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.552586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.552612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.073 qpair failed and we were unable to recover it. 00:30:32.073 [2024-11-26 05:26:33.552720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.073 [2024-11-26 05:26:33.552814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.552841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.552939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.553036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.553062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.553151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.553272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.553298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.553423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.553528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.553554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.553652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.553751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.553778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.553879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.554030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.554060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.554190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.554281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.554307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.554439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.554558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.554584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.554678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.554782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.554808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.554933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.555054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.555080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.555177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.555297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.555323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.555420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.555520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.555546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.555646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.555753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.555780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.555873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.555962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.555988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.556089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.556212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.556238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.556387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.556487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.556518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.556638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.556775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.556802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.556937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.557027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.557053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.557157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.557252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.557277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.557377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.557528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.557554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.557648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.557751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.557778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.557911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.558037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.558064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.558166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.558268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.558295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.558390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.558508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.558535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.558644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.558740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.558767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.558857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.558980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.559006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.559103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.559224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.559250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.559380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.559468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.559495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.559613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.559736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.559763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-11-26 05:26:33.559889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.074 [2024-11-26 05:26:33.559997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.560024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.560153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.560302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.560328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.560455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.560544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.560570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.560669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.560795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.560822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.560952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.561073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.561099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.561186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.561283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.561309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.561399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.561515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.561541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.561666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.561807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.561834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.561938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.562062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.562088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.562187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.562292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.562317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.562411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.562512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.562538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.562642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.562738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.562765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.562867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.562995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.563022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.563126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.563221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.563247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.563345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.563466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.563492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.563595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.563692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.563719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.563820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.563918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.563944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.564052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.564151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.564178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.564278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.564376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.564404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.564533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.564673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.564705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.564809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.564913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.564939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.565032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.565154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.565181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.565281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.565369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.565395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.565482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.565612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.565638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.565736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.565828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.565854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.565974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.566099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.566126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.566226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.566327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.566353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.566445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.566575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.566602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.566728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.566825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.566851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-11-26 05:26:33.566980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.075 [2024-11-26 05:26:33.567082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.567108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.567229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.567316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.567342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.567438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.567561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.567587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.567695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.567787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.567814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.567905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.568033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.568061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.568151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.568284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.568310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.568399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.568499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.568525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.568648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.568751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.568778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.568880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.568983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.569016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.569139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.569238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.569264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.569372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.569470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.569496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.569599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.569724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.569752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.569875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.569969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.569996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.570088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.570176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.570203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.570293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.570388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.570414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.570521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.570616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.570642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.570743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.570843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.570870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.570970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.571086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.571112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.571240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.571362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.571388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.571515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.571641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.571667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.571811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.571945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.571971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.572069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.572199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.572225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.572350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.572449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.572475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.572574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.572681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.572714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.572841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.572945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.572971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-11-26 05:26:33.573066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.573164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.076 [2024-11-26 05:26:33.573191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.573290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.573388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.573416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.573505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.573627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.573653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.573766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.573863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.573890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.573992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.574142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.574168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.574289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.574393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.574419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.574512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.574605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.574631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.574762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.574867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.574894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.574993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.575113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.575139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.575270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.575357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.575383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.575503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.575600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.575628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.575760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.575855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.575882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.576034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.576157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.576184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.576288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.576384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.576411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.576511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.576632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.576659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.576772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.576930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.576956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.577078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.577228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.577254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.577354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.577477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.577505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.577634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.577747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.577774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.577865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.577957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.577984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.578114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.578218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.578244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.578369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.578474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.578500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.578624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.578720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.578748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.578850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.578938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.578964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.579057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.579177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.579204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.579296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.579394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.579420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.579540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.579633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.579660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.579772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.579864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.579890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.580046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.580138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.580164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.077 [2024-11-26 05:26:33.580290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.580393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.077 [2024-11-26 05:26:33.580419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.077 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.580519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.580616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.580642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.580741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.580837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.580863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.580970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.581120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.581147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.581271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.581404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.581430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.581531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.581629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.581659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.581764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.581893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.581919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.582074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.582162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.582188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.582308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.582440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.582467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.582569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.582728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.582754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.582853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.582942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.582968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.583098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.583225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.583250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.583344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.583432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.583458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.583589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.583696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.583723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.583849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.583969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.583996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.584128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.584218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.584245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.584381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.584474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.584501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.584630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.584732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.584760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.584856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.584975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.585002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.585102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.585197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.585225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.585317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.585418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.585444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.585545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.585643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.585670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.585794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.585891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.585918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.586043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.586170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.586197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.586302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.586424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.586450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.586548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.586702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.586730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.586842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.586965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.586991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.587098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.587190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.587218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.587344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.587471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.587498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.078 qpair failed and we were unable to recover it. 00:30:32.078 [2024-11-26 05:26:33.587591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.587744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.078 [2024-11-26 05:26:33.587771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.587867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.587970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.587997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.588119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.588212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.588238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.588394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.588510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.588536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.588663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.588764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.588790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.588893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.588994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.589021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.589151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.589281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.589307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.589405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.589553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.589580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.589683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.589777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.589803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.589906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.590000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.590027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.590121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.590218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.590244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.590372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.590490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.590517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.590610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.590710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.590744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.590853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.590975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.591001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.591092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.591211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.591237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.591361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.591479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.591505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.591604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.591729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.591756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.591852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.591993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.592020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.592144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.592242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.592269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.592362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.592462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.592491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.592614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.592725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.592752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.592857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.592987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.593013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.593105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.593203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.593231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.593360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.593454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.593481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.593595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.593759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.593786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.593882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.593978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.594004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.594153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.594245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.594272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.594368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.594462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.594494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.594594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.594752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.594779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.079 qpair failed and we were unable to recover it. 00:30:32.079 [2024-11-26 05:26:33.594920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.079 [2024-11-26 05:26:33.595048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.595075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.595199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.595338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.595365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.595499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.595624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.595651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.595761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.595884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.595911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.596014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.596113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.596140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.596238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.596357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.596383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.596516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.596610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.596636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.596738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.596829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.596855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.597013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.597115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.597146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.597237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.597357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.597383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.597479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.597607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.597633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.597740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.597870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.597897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.598012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.598106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.598133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.598245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.598402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.598428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.598551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.598658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.598693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.598837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.598942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.598969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.599089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.599192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.599219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.599320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.599477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.599504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.599603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.599705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.599739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.599848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.599978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.600005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.600100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.600230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.600257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.600389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.600515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.600542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.600669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.600789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.600816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.600915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.601047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.601074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.601222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.601344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.601370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.601462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.601558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.601584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.601718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.601817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.601843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.601936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.602065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.602092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.602201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.602325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.602351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.080 qpair failed and we were unable to recover it. 00:30:32.080 [2024-11-26 05:26:33.602451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.080 [2024-11-26 05:26:33.602554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.602580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.602673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.602779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.602806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.602907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.602997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.603023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.603113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.603246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.603273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.603392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.603485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.603511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.603628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.603765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.603794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.603930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.604028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.604055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.604151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.604253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.604279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.604402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.604497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.604524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.604648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.604773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.604800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.604923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.605052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.605079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.605242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.605337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.605364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.605459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.605582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.605608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.605723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.605856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.605883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.606009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.606162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.606188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.606288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.606410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.606436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.606540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.606663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.606694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.606824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.606919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.606947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.607069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.607170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.607196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.607324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.607423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.607449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.607567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.607731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.607759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.607915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.608010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.608037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.608132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.608220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.608246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.608348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.608439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.608465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.608566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.608696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.608723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.608831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.608927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.081 [2024-11-26 05:26:33.608953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.081 qpair failed and we were unable to recover it. 00:30:32.081 [2024-11-26 05:26:33.609051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.609203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.609230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.609334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.609426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.609452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.609547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.609633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.609659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.609811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.609937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.609963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.610091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.610185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.610215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.610315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.610470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.610496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.610592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.610714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.610741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.610897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.611019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.611045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.611144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.611293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.611319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.611443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.611537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.611563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.611658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.611785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.611811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.611940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.612035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.612061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.612169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.612287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.612313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.612405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.612509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.612536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.612631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.612770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.612797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.612934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.613056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.613082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.613180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.613279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.613305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.613404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.613505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.613531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.613631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.613728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.613755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.613885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.614003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.614029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.614153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.614258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.614284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.614381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.614511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.614537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.614644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.614747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.614774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.614929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.615055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.615082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.615180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.615306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.615333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.615439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.615558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.615584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.615715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.615839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.615865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.615966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.616090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.616116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.616247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.616345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.082 [2024-11-26 05:26:33.616371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.082 qpair failed and we were unable to recover it. 00:30:32.082 [2024-11-26 05:26:33.616463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.616568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.616593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.616682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.616794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.616820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.616925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.617053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.617079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.617178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.617299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.617325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.617466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.617596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.617622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.617728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.617824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.617850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.617986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.618083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.618110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.618236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.618359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.618385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.618481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.618605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.618631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.618763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.618857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.618883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.619035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.619158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.619184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.619309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.619398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.619424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.619573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.619670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.619702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.619803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.619929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.619957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.620085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.620215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.620242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.620361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.620514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.620540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.620638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.620742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.620769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.620927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.621023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.621049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.621202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.621318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.621344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.621480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.621578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.621605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.621726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.621825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.621852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.621950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.622035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.622061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.622184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.622311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.622338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.622430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.622581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.622607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.622709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.622831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.622858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.622955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.623047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.623072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.623225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.623348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.623378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.623509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.623631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.623657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.623770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.623903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.083 [2024-11-26 05:26:33.623930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.083 qpair failed and we were unable to recover it. 00:30:32.083 [2024-11-26 05:26:33.624064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.624158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.624184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.624305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.624398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.624424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.624531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.624659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.624690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.624785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.624878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.624905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.625037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.625138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.625165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.625266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.625364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.625390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.625491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.625644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.625670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.625803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.625903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.625929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.626027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.626124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.626151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.626251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.626349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.626375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.626531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.626633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.626660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.626768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.626868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.626894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.626989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.627139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.627165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.627264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.627352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.627379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.627502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.627598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.627623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.627718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.627842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.627868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.627964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.628054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.628080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.628205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.628358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.628384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.628520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.628622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.628648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.628804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.628896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.628922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.629033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.629158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.629185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.629284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.629413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.629439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.629532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.629659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.629714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.629813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.629939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.629967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.630065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.630158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.630184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.630303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.630392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.630419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.630527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.630678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.630709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.630808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.630905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.630932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.631058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.631180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.084 [2024-11-26 05:26:33.631206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.084 qpair failed and we were unable to recover it. 00:30:32.084 [2024-11-26 05:26:33.631328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.631427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.631453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.631556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.631691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.631718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.631821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.631912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.631938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.632031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.632130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.632157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.632261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.632387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.632413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.632521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.632615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.632642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.632772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.632875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.632901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.633003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.633095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.633121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.633221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.633310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.633336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.633427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.633529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.633555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.633677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.633816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.633842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.633946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.634040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.634066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.634159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.634248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.634274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.634373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.634527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.634553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.634648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.634776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.634803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.634922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.635023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.635050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.635145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.635244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.635270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.635392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.635495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.635523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.635652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.635765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.635792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.635888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.635981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.636013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.636139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.636262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.636289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.636440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.636536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.636563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.636668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.636773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.636800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.636904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.637009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.637035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.637171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.637266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.637292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.085 [2024-11-26 05:26:33.637387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.637512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.085 [2024-11-26 05:26:33.637538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.085 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.637710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.637844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.637870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.637992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.638092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.638118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.638223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.638317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.638343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.638436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.638537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.638567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.638695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.638795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.638821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.638923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.639049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.639074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.639177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.639307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.639334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.639457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.639615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.639641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.639752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.639882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.639908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.640036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.640130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.640157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.640250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.640373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.640400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.640528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.640650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.640676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.640788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.640877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.640904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.641025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.641151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.641178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.641285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.641380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.641406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.641502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.641623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.641649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.641755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.641883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.641909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.642006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.642134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.642160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.642259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.642351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.642377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.642508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.642602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.642628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.642765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.642861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.642888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.642981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.643080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.643107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.643235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.643337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.643363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.643489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.643612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.643637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.643751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.643881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.643907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.644001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.644120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.644146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.644236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.644324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.644351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.644439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.644593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.644619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.086 qpair failed and we were unable to recover it. 00:30:32.086 [2024-11-26 05:26:33.644734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.644868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.086 [2024-11-26 05:26:33.644894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.645024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.645121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.645148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.645246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.645336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.645362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.645462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.645610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.645636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.645748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.645851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.645878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.646005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.646105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.646132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.646287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.646383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.646409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.646512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.646641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.646667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.646776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.646872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.646899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.647026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.647149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.647175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.647267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.647365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.647391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.647496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.647620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.647646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.647753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.647848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.647875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.647968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.648067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.648093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.648192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.648318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.648344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.648449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.648575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.648601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.648725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.648854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.648880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.649004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.649129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.649156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.649283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.649435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.649461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.649558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.649654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.649680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.649782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.649878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.649905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.650003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.650110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.650136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.650256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.650350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.650376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.650532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.650651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.650678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.650784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.650880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.650906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.650997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.651091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.651118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.651240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.651332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.651363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.651457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.651554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.651580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.651709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.651836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.651862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.087 qpair failed and we were unable to recover it. 00:30:32.087 [2024-11-26 05:26:33.651980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.652078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.087 [2024-11-26 05:26:33.652105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.652201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.652300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.652327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.652436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.652561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.652588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.652698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.652789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.652815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.652968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.653065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.653092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.653189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.653313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.653339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.653433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.653564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.653590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.653747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.653844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.653871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.653965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.654090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.654116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.654214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.654315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.654341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.654466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.654586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.654612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.654743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.654872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.654899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.655001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.655131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.655158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.655253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.655342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.655368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.655495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.655595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.655622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.655731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.655830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.655856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.655984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.656102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.656128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.656234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.656330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.656355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.656454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.656542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.656568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.656694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.656790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.656816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.656939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.657039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.657065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.657171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.657269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.657295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.657395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.657520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.657546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.657640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.657761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.657788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.657916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.658010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.658037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.658136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.658269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.658295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.658391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.658520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.658546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.658642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.658748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.658776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.658903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.659002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.659029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.088 [2024-11-26 05:26:33.659120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.659248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.088 [2024-11-26 05:26:33.659274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.088 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.659366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.659490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.659516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.659613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.659767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.659794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.659918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.660006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.660032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.660124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.660241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.660267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.660362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.660512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.660538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.660661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.660766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.660793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.660916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.661044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.661071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.661194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.661344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.661370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.661496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.661651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.661678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.661837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.661941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.661968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.662060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.662161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.662187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.662340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.662463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.662490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.662621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.662747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.662774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.662875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.662999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.663025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.663123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.663224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.663250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.663350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.663445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.663472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.663628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.663722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.663749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.663877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.663973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.663999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.664100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.664225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.664256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.664348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.664500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.664526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.664683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.664783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.664809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.664935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.665063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.665089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.665187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.665336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.665362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.665461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.665582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.665608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.665733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.665827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.665853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.665986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.666107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.666133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.666234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.666366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.666392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.666482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.666607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.666633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.089 qpair failed and we were unable to recover it. 00:30:32.089 [2024-11-26 05:26:33.666744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.089 [2024-11-26 05:26:33.666833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.666860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.666967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.667119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.667146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.667237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.667330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.667356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.667455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.667549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.667574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.667675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.667772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.667799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.667907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.668031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.668057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.668190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.668282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.668308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.668435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.668522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.668549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.668643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.668767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.668795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.668893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.668985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.669012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.669114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.669212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.669238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.669396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.669495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.669521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.669614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.669740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.669767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.669872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.669996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.670022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.670118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.670238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.670265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.670362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.670454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.670480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.670578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.670698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.670726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.670837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.670939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.670966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.671061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.671191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.671217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.671344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.671440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.671467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.671600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.671695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.671722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.671827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.671920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.671946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.672073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.672167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.672193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.672293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.672444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.672471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.672561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.672711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.672738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.672840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.672938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.672964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.090 qpair failed and we were unable to recover it. 00:30:32.090 [2024-11-26 05:26:33.673084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.090 [2024-11-26 05:26:33.673178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.673204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.673332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.673430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.673457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.673582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.673727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.673753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.673874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.673970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.673997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.674151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.674275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.674301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.674392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.674550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.674576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.674676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.674784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.674810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.674931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.675034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.675060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.675161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.675256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.675282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.675416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.675539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.675564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.675690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.675782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.675807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.675938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.676058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.676084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.676173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.676262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.676289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.676399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.676549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.676575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.676670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.676828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.676855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.676952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.677042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.677074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.677204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.677343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.677369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.677494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.677591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.677617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.677745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.677840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.677867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.677971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.678097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.678123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.678254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.678372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.678398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.678526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.678625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.678652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.678781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.678875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.678903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.679033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.679161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.679187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.679276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.679399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.679425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.679524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.679658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.679690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.679829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.679925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.679951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.680048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.680202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.680228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.680325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.680446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.680472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.091 qpair failed and we were unable to recover it. 00:30:32.091 [2024-11-26 05:26:33.680569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.091 [2024-11-26 05:26:33.680696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.680723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.680830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.680931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.680959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.681056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.681179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.681205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.681296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.681416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.681442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.681540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.681628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.681654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.681789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.681884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.681910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.682032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.682122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.682148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.682250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.682377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.682403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.682558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.682648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.682693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.682855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.682954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.682986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.683112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.683240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.683266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.683360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.683493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.683520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.683614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.683750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.683777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.683879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.683977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.684003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.684092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.684182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.684208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.684330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.684422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.684448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.684577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.684665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.684696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.684828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.684918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.684944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.685070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.685195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.685221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.685338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.685455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.685481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.685634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.685765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.685791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.685884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.685968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.685998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.686103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.686221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.686247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.686365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.686497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.686523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.686627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.686716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.686743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.686880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.686968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.686997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.687110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.687234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.687260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.687355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.687478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.687504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.092 [2024-11-26 05:26:33.687608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.687758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.092 [2024-11-26 05:26:33.687786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.092 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.687891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.687980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.688006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.688128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.688252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.688278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.688433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.688530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.688556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.688651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.688765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.688791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.688884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.688981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.689007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.689105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.689206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.689232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.689331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.689457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.689482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.689576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.689713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.689740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.689845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.689969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.690002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.690099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.690250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.690276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.690396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.690504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.690530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.690653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.690766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.690793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.690885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.690986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.691012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.691163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.691289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.691315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.691412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.691566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.691592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.691704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.691800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.691826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.691952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.692056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.692083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.692184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.692334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.692360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.692489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.692579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.692609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.692719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.692810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.692837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.692957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.693108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.693134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.693252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.693355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.693380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.693469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.693570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.693596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.693696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.693795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.693821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.693932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.694042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.694068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.694197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.694317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.694343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.694447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.694544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.694578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.694706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.694832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.694858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.093 [2024-11-26 05:26:33.694962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.695050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.093 [2024-11-26 05:26:33.695076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.093 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.695174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.695292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.695318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.695410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.695539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.695564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.695664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.695819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.695845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.695939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.696061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.696087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.696190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.696312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.696338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.696436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.696558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.696585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.696691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.696783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.696809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.696938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.697064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.697090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.697212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.697317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.697343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.697436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.697524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.697550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.697660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.697788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.697815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.697910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.698029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.698055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.698177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.698303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.698329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.698458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.698551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.698577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.698681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.698808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.698834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.698934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.699086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.699112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.699241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.699335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.699363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.699464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.699579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.699606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.699703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.699821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.699847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.699972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.700128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.700154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.700259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.700362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.700389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.700543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.700637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.700663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.700798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.700895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.700921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.701047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.701144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.701171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.701294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.701418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.701443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.094 qpair failed and we were unable to recover it. 00:30:32.094 [2024-11-26 05:26:33.701544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.094 [2024-11-26 05:26:33.701662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.701693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.701789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.701887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.701913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.702012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.702113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.702139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.702267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.702353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.702379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.702467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.702585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.702611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.702739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.702835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.702861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.702986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.703085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.703111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.703236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.703385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.703411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.703510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.703664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.703697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.703829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.703916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.703942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.704068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.704159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.704185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.704335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.704421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.704448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.704549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.704676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.704710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.704840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.704941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.704967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.705070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.705189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.705215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.705319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.705439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.705470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.705564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.705662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.705696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.705854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.705982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.706007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.706104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.706228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.706254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.706341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.706466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.706491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.706580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.706706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.706733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.706886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.706975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.707001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.707102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.707254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.707280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.707368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.707471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.707498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.707591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.707711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.707738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.707840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.707963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.707989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.708155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.708280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.708306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.708461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.708580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.708605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.708726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.708853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.708880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.095 qpair failed and we were unable to recover it. 00:30:32.095 [2024-11-26 05:26:33.709012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.095 [2024-11-26 05:26:33.709103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.709129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.709231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.709318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.709344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.709497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.709596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.709622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.709714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.709844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.709870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.709966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.710058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.710083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.710212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.710340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.710365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.710456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.710585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.710611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.710716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.710811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.710837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.710928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.711024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.711050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.711154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.711250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.711276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.711406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.711497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.711523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.711614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.711737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.711764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.711864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.711988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.712014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.712116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.712237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.712263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.712359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.712451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.712477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.712571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.712662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.712699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.712810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.712906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.712934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.713037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.713136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.713162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.713282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.713407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.713433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.713532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.713630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.713656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.713767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.713865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.713891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.714023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.714115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.714141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.714246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.714347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.714374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.714473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.714571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.714597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.714728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.714831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.714857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.714947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.715064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.715090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.715186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.715282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.715308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.715400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.715529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.715556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.715655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.715755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.715782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.096 qpair failed and we were unable to recover it. 00:30:32.096 [2024-11-26 05:26:33.715904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.096 [2024-11-26 05:26:33.716004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.716030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.716129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.716226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.716252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.716343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.716474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.716500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.716590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.716710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.716737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.716831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.716949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.716975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.717066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.717212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.717239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.717334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.717440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.717466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.717589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.717711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.717739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.717842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.717935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.717967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.718091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.718188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.718214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.718343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.718465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.718491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.718592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.718695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.718722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.718815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.718903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.718929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.719023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.719119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.719145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.719238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.719341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.719367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.719487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.719612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.719639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.719726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.719877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.719903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.720001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.720107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.720133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.720225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.720374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.720400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.720503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.720655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.720681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.720840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.720935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.720962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.721111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.721238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.721264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.721366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.721488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.721514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.721615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.721737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.721764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.721857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.721953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.721980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.722107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.722195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.722221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.722315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.722410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.722436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.722559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.722650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.722677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.722778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.722874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.097 [2024-11-26 05:26:33.722900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.097 qpair failed and we were unable to recover it. 00:30:32.097 [2024-11-26 05:26:33.723016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.723104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.723130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.723229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.723354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.723379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.723510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.723602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.723628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.723734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.723867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.723894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.724020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.724142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.724168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.724263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.724351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.724377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.724477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.724603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.724630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.724765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.724865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.724890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.724986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.725116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.725141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.725263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.725358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.725385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.725482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.725604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.725630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.725759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.725881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.725908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.726005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.726131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.726157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.726254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.726407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.726433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.726538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.726663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.726694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.726794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.726914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.726940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.727040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.727132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.727158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.727291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.727386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.727412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.727509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.727630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.727656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.727762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.727884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.727910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.728061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.728184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.728210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.728313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.728407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.728433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.728526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.728657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.728683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.728785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.728874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.728900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.728997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.729121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.729147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.729273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.729389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.729416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.729509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.729603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.729629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.729729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.729817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.729843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.729949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.730069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.098 [2024-11-26 05:26:33.730095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.098 qpair failed and we were unable to recover it. 00:30:32.098 [2024-11-26 05:26:33.730199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.730329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.730355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.730446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.730597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.730627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.730721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.730816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.730842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.730935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.731054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.731081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.731173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.731293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.731319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.731428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.731559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.731585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.731680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.731781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.731808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.731907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.732029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.732056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.732164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.732321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.732347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.732473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.732596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.732623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.732740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.732833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.732859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.733011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.733112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.733143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.733242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.733362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.733388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.733509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.733598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.733624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.733731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.733826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.733852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.733946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.734078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.734104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.734234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.734335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.734365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.734488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.734607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.734633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.734761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.734861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.734888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.734988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.735115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.735141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.735268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.735357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.735383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.735504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.735623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.735649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.735756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.735856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.735883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.736007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.736104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.736131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.736228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.736334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.736361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.099 [2024-11-26 05:26:33.736491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.736581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.099 [2024-11-26 05:26:33.736607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.099 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.736727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.736824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.736850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.736953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.737101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.737127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.737226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.737334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.737362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.737483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.737606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.737632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.737729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.737824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.737852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.737957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.738059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.738085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.738217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.738316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.738342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.738440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.738540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.738566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.738714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.738804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.738831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.738962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.739090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.739118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.739252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.739359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.739387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.739508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.739607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.739634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.739753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.739875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.739901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.740007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.740103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.740129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.740255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.740357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.740385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.740515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.740639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.740666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.740764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.740871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.740897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.740999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.741118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.741145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.741244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.741341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.741368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.741469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.741590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.741616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.741733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.741825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.741852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.741944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.742066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.742093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.742189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.742293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.742319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.742445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.742566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.742592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.742693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.742796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.742822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.742911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.743020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.743046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.743187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.743314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.743341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.743466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.743595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.743621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.100 qpair failed and we were unable to recover it. 00:30:32.100 [2024-11-26 05:26:33.743733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.743834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.100 [2024-11-26 05:26:33.743860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.743989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.744078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.744104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.744231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.744350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.744376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.744470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.744595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.744621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.744748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.744846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.744872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.744976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.745094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.745121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.745215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.745339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.745365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.745489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.745608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.745634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.745743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.745842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.745873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.745968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.746088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.746114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.746221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.746351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.746377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.746473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.746634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.746662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.746819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.746918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.746945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.747038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.747159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.747185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.747283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.747420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.747454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.747578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.747715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.747743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.747848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.747942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.747981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.748078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.748199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.748225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.748348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.748444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.748483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.748587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.748722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.748749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.748850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.748955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.748992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.749098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.749216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.749243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.749345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.749445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.749480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.749611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.749744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.749771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.749881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.750008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.750033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.750186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.750314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.750341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.750432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.750550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.750576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.750678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.750781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.750808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.750901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.751029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.751056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.101 qpair failed and we were unable to recover it. 00:30:32.101 [2024-11-26 05:26:33.751217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.751379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.101 [2024-11-26 05:26:33.751405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.751555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.751661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.751694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.751801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.751902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.751928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.752059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.752152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.752180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.752276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.752375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.752402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.752529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.752621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.752647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.752753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.752841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.752867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.753002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.753103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.753129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.753244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.753342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.753368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.753490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.753585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.753612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.753722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.753846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.753872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.754005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.754106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.754132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.754305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.754396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.754422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.754527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.754618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.754644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.754763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.754884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.754911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.755052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.755156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.755182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.755337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.755439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.755465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.755589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.755677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.755717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.755818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.755940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.755967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.756100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.756194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.756230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.756355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.756480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.756506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.756631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.756771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.756799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.756924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.757050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.757076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.757237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.757326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.757352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.757453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.757557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.757584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.757690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.757795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.757821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.757919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.758009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.758035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.758145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.758299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.758326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.758447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.758587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.758614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.102 qpair failed and we were unable to recover it. 00:30:32.102 [2024-11-26 05:26:33.758725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.102 [2024-11-26 05:26:33.758819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.758845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.758998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.759099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.759130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.759291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.759415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.759441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.759536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.759632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.759659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.759772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.759901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.759928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.760057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.760166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.760193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.760324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.760446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.760472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.760567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.760667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.760702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.760833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.760923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.760950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.761089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.761212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.761239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.761365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.761466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.761492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.761583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.761680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.761711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.761817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.761910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.761936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.762044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.762167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.762193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.762316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.762413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.762439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.762574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.762718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.762745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.762874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.762974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.763010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.763102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.763253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.763279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.763374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.763470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.763496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.763623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.763753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.763780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.763875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.763976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.764007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.764116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.764213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.764239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.764369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.764497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.764528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.764637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.764761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.764790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.764894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.764983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.765013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.765167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.765258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.765283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.765392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.765489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.765517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.765623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.765735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.765764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.103 qpair failed and we were unable to recover it. 00:30:32.103 [2024-11-26 05:26:33.765858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.765948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.103 [2024-11-26 05:26:33.765974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.766082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.766235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.766261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.766396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.766494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.766530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.766628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.766725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.766753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.766857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.766949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.766986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.767139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.767237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.767262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.767355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.767479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.767505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.767604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.767740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.767767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.767918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.768047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.768073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.768199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.768286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.768313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.768415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.768511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.768538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.768638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.768739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.768766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.768868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.768993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.769019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.769121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.769220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.769246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.769358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.769493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.769519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.769670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.769820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.769847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.769942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.770046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.770072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.770179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.770308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.770334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.770460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.770555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.770581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.770724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.770814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.770840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.770966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.771101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.771127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.771230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.771321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.771347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.771444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.771548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.771574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.771678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.771810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.771836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.771968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.772066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.772097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.772204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.772375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.772401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.104 [2024-11-26 05:26:33.772507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.772626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.104 [2024-11-26 05:26:33.772652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.104 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.772759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.772868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.772894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.773036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.773122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.773148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.773274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.773376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.773402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.773497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.773646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.773672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.773788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.773883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.773910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.774027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.774149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.774175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.774265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.774403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.774429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.774556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.774695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.774722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.774853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.774953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.774989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.775091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.775200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.775228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.775328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.775467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.775493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.775590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.775724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.775750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.775846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.775943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.775970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.776099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.776226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.776252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.776388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.776509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.776535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.776629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.776737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.776764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.776862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.777010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.777036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.777165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.777292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.777318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.777417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.777521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.777547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.777670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.777781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.777807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.777915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.778044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.778072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.778202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.778306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.778332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.778432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.778571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.778599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.778711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.778812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.778839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.778948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.779048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.779074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.779180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.779273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.779299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.779394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.779516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.779542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.779648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.779764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.779790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.779893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.780023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.780049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.780169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.780278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.780304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.105 [2024-11-26 05:26:33.780409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.780508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.105 [2024-11-26 05:26:33.780535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.105 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.780627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.780734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.780761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.780868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.781073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.781099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.781192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.781314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.781340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.781438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.781596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.781634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.781751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.781882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.781908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.782042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.782170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.782196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.782285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.782488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.782514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.782646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.782765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.782792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.782919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.783023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.783049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.783190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.783293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.783320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.783425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.783526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.783552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.783640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.783801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.783828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.783927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.784015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.784041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.784139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.784274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.784300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.784406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.784501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.784528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.784629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.784731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.784758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.784863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.784984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.785018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.785125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.785228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.785259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.785386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.785521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.785547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.785637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.785765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.785792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.785933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.786030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.786068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.786190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.786305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.786332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.786483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.786590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.786616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.786737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.786859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.786886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.786981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.787080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.787106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.787233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.787359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.787386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.787493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.787587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.787615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.787743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.787845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.787876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.788015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.788139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.788165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.788288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.788399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.788427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.788522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.788649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.788675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.106 qpair failed and we were unable to recover it. 00:30:32.106 [2024-11-26 05:26:33.788781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.106 [2024-11-26 05:26:33.788905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.788931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.789037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.789138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.789164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.789295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.789423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.789449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.789553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.789698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.789726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.789858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.789957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.789983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.790120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.790210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.790238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.790368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.790497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.790523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.790653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.790800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.790826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.790965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.791099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.791125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.791224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.791331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.791357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.791462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.791587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.791613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.791720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.791858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.791885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.791987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.792074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.792104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.792215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.792360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.792387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.792487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.792613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.792640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.792751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.792875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.792901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.793040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.793191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.793226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.793369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.793490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.793516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.793610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.793708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.793735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.793859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.794014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.794041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.794169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.794295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.794321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.794443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.794536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.794564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.794666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.794828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.794855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.794957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.795103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.795129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.795218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.795323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.795349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.795450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.795549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.795575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.795697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.795789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.795815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.795908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.796064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.796091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.796193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.796288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.796316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.796437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.796555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.796581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.796712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.796837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.796863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.107 qpair failed and we were unable to recover it. 00:30:32.107 [2024-11-26 05:26:33.797001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.797096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.107 [2024-11-26 05:26:33.797122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.797226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.797346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.797372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.797473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.797569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.797595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.797696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.797827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.797853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.797953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.798056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.798082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.798727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.798886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.798917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.799024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.799151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.799178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.799274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.799377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.799403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.799525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.799650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.799677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.799821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.799920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.799946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.800073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.800166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.800193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.800284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.800389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.800414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.800524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.800617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.800643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.800754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.800881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.800907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.801015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.801144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.801169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.801276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.801366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.801391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.801532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.801695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.801726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.801838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.801995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.802021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.802116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.802259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.802292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.802417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.802519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.802547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.802648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.802744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.108 [2024-11-26 05:26:33.802771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.108 qpair failed and we were unable to recover it. 00:30:32.108 [2024-11-26 05:26:33.802897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.382 [2024-11-26 05:26:33.803005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.382 [2024-11-26 05:26:33.803031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.382 qpair failed and we were unable to recover it. 00:30:32.382 [2024-11-26 05:26:33.803125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.382 [2024-11-26 05:26:33.803279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.382 [2024-11-26 05:26:33.803305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.382 qpair failed and we were unable to recover it. 00:30:32.382 [2024-11-26 05:26:33.803401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.382 [2024-11-26 05:26:33.803500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.382 [2024-11-26 05:26:33.803527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.382 qpair failed and we were unable to recover it. 00:30:32.382 [2024-11-26 05:26:33.803653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.382 [2024-11-26 05:26:33.803756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.803782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.803889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.804009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.804035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.804138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.804261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.804287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.804421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.804521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.804547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.804654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.804757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.804784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.804891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.805041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.805074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.805182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.805273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.805299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.805418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.805515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.805541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.805665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.805787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.805814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.805938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.806029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.806054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.806156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.806265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.806291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.806389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.806490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.806516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.806650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.806763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.806790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.806922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.807016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.807042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.807165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.807316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.807341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.807441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.807536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.807561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.807683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.807788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.807815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.807918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.808039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.808065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.808162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.808253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.808280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.808412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.808506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.808532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.808634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.808736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.808763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.808885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.809005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.809031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.809132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.809256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.809282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.809417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.809516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.809544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.809650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.809751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.809778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.809900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.810031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.810056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.810160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.810281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.810306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.383 qpair failed and we were unable to recover it. 00:30:32.383 [2024-11-26 05:26:33.810402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.810510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.383 [2024-11-26 05:26:33.810536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.810636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.810744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.810771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.810910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.811019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.811045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.811168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.811273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.811299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.811421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.811515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.811542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.811648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.811789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.811815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.811902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.812015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.812041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.812158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.812276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.812302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.812421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.812512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.812538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.812666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.812791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.812817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.812936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.813039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.813072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.813201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.813330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.813356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.813455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.813574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.813600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.813741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.813868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.813894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.813997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.814122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.814158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.814263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.814357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.814383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.814483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.814575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.814606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.814721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.814822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.814850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.814954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.815090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.815116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.815226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.815324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.815350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.815489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.815625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.815651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.815762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.815859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.815885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.815982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.816072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.816098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.816226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.816364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.816389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.816482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.816609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.816635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.816777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.816901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.816927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.817022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.817114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.817139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.817270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.817363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.817389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.817498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.817621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.817646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.384 qpair failed and we were unable to recover it. 00:30:32.384 [2024-11-26 05:26:33.817749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.384 [2024-11-26 05:26:33.817842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.817868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.817958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.818086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.818112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.818205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.818330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.818355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.818481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.818588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.818614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.818756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.818882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.818908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.819003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.819122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.819148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.819254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.819407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.819444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.819549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.819645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.819670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.819792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.819919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.819945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.820044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.820135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.820160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.820259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.820380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.820415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.820548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.820676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.820708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.820839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.820928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.820955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.821061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.821158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.821184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.821304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.821456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.821481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.821602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.821699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.821726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.821864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.821985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.822018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.822111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.822220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.822256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.822362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.822462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.822488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.822587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.822682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.822715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.822813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.822903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.822929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.823041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.823190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.823221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.823312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.823435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.823466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.823576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.823720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.823747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.823842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.823961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.823987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.824084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.824184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.824211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.824332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.824492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.824518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.824640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.824805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.824831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.824964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.825058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.385 [2024-11-26 05:26:33.825085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.385 qpair failed and we were unable to recover it. 00:30:32.385 [2024-11-26 05:26:33.825181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.825323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.825351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.825447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.825568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.825593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.825681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.825791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.825817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.825921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.826052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.826077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.826181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.826289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.826316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.826410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.826541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.826570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.826721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.826823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.826848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.826972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.827077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.827103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.827197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.827287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.827313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.827407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.827529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.827558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.827659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.827775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.827801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.827890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.828015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.828041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.828147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.828247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.828272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.828397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.828492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.828519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.828613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.828723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.828750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.828875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.828976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.829010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.829107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.829212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.829237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.829345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.829439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.829465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.829556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.829653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.829679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.829856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.829956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.829986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.830081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.830207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.830232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.830325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.830433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.830458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.830608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.830736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.830764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.830866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.830961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.830987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.831090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.831182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.831208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.831340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.831459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.831485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.831632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.831735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.831763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.831889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.831977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.832012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.832109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.832202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.386 [2024-11-26 05:26:33.832227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.386 qpair failed and we were unable to recover it. 00:30:32.386 [2024-11-26 05:26:33.832368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.832464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.832490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.832620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.832718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.832745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.832878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.832976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.833001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.833121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.833226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.833252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.833353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.833444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.833470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.833579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.833679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.833711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.833826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.833922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.833948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.834056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.834154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.834180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.834305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.834427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.834453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.834539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.834644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.834671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.834856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.834942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.834968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.835101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.835194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.835220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.835345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.835439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.835464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.835560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.835654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.835681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.835852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.835950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.835976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.836078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.836174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.836199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.836312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.836431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.836457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.836551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.836647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.836672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.836781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.836907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.836932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.837034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.837149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.837174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.837265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.837390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.837417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.837512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.837610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.837638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.837809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.837929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.837956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.387 qpair failed and we were unable to recover it. 00:30:32.387 [2024-11-26 05:26:33.838061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.838153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.387 [2024-11-26 05:26:33.838182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.838283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.838404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.838430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.838527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.838648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.838674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.838816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.838907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.838933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.839059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.839160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.839186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.839309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.839405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.839430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.839525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.839623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.839648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.839805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.839921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.839952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.840064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.840170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.840196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.840326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.840429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.840454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.840554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.840649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.840676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.840834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.840961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.840998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.841129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.841216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.841241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.841333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.841430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.841456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.841563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.841668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.841704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.841829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.841924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.841949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.842050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.842145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.842170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.842272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.842377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.842402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.842511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.842598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.842629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.842743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.842838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.842864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.842962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.843095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.843121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.843216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.843320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.843346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.843481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.843611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.843636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.843744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.843872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.843898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.844026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.844128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.844153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.844289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.844426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.844451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.844542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.844657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.844682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.844811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.844906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.844932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.845064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.845190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.845220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.388 qpair failed and we were unable to recover it. 00:30:32.388 [2024-11-26 05:26:33.845322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.388 [2024-11-26 05:26:33.845420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.845447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.845543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.845654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.845679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.845789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.845884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.845910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.846047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.846173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.846198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.846321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.846420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.846445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.846545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.846668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.846719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.846810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.846907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.846933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.847036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.847166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.847192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.847317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.847408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.847434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.847522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.847611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.847641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.847787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.847885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.847912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.848058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.848161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.848194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.848300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.848418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.848444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.848539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.848638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.848664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.848811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.848909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.848935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.849070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.849188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.849215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.849319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.849416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.849442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.849542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.849646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.849672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.849775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.849875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.849901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.850031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.850132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.850158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.850295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.850397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.850424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.850517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.850616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.850643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.850776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.850869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.850895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.850993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.851150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.851176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.851303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.851432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.851457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.851553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.851649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.851675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.851783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.851880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.851906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.852047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.852147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.852174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.389 [2024-11-26 05:26:33.852270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.852359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.389 [2024-11-26 05:26:33.852385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.389 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.852483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.852584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.852610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.852715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.852803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.852829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.852962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.853110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.853135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.853234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.853328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.853354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.853454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.853576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.853601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.853693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.853788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.853814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.853939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.854066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.854093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.854193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.854284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.854310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.854408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.854502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.854528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.854623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.854755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.854781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.854888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.854986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.855017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.855122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.855249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.855275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.855377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.855472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.855498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.855595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.855683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.855742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.855864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.855959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.855985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.856085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.856182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.856208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.856328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.856451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.856476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.856592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.856695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.856720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.856850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.856939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.856965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.857063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.857191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.857217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.857321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.857414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.857440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.857592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.857692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.857720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.857822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.857941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.857967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.858100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.858195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.858221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.858318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.858410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.858435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.858533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.858675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.858708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.858846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.858942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.858969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.859090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.859210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.859235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.390 [2024-11-26 05:26:33.859358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.859454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.390 [2024-11-26 05:26:33.859480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.390 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.859578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.859669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.859708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.859811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.859902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.859928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.860022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.860120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.860150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.860280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.860373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.860399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.860520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.860622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.860647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1402f20 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.860768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.860880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.860909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.861018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.861126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.861153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.861253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.861358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.861384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.861484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.861610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.861637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.861755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.861856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.861883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.861972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.862105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.862131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.862258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.862358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.862384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.862498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.862624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.862656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.862772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.862867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.862894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.863028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.863124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.863150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.863280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.863379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.863406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.863541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.863644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.863672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.863787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.863887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.863913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.864016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.864144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.864169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.864272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.864376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.864404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.864528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.864652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.864679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.864811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.864912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.864938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.865071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.865169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.865202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.865298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.865405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.865431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.865536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.865657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.865684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.865819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.865941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.865967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.866090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.866211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.866236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.866337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.866484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.391 [2024-11-26 05:26:33.866510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.391 qpair failed and we were unable to recover it. 00:30:32.391 [2024-11-26 05:26:33.866654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.866750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.866777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.866898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.867011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.867037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.867147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.867247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.867272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.867363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.867460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.867484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.867613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.867718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.867745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.867875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.867995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.868020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.868121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.868240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.868265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.868392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.868525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.868551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.868683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.868782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.868808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.868906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.869035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.869062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.869186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.869283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.869309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.869430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.869546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.869571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.869712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.869800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.869826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.869927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.870052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.870078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.870204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.870298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.870324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.870507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.870604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.870630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.870746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.870872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.870898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.871033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.871163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.871189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.871344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.871438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.871466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.871618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.871712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.871738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.871840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.871936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.871963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.872060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.872183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.872209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.872329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.872451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.872475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.872571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.872693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.872719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.392 [2024-11-26 05:26:33.872871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.872969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.392 [2024-11-26 05:26:33.872994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.392 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.873125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.873218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.873245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.873377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.873500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.873525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.873652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.873757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.873783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.873909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.874039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.874064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.874153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.874246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.874272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.874379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.874475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.874501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.874593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.874694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.874721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.874844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.874975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.875000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.875104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.875199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.875226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.875347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.875451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.875477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.875610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.875710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.875736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.875839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.875966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.875993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.876091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.876190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.876217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.876306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.876437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.876464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.876585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.876709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.876736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.876838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.876960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.876986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.877084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.877187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.877213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.877336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.877435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.877461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.877561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.877661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.877691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.877795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.877915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.877941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.878056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.878185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.878211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.878302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.878395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.878419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.878520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.878646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.878671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.878791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.878911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.878936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.879068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.879159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.879184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.879277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.879403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.879427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.879537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.879633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.879659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.879782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.879905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.879931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.393 qpair failed and we were unable to recover it. 00:30:32.393 [2024-11-26 05:26:33.880059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.393 [2024-11-26 05:26:33.880180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.880206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.880306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.880395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.880421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.880552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.880641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.880667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.880804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.880901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.880927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.881015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.881102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.881127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.881258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.881353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.881379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.881478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.881613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.881638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.881757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.881852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.881877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.881976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.882089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.882115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.882212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.882310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.882335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.882457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.882562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.882587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.882692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.882789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.882814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.882918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.883048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.883073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.883171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.883261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.883287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.883414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.883513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.883538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.883634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.883768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.883795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.883947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.884040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.884067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.884204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.884304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.884330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.884480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.884570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.884596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.884730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.884856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.884882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.884981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.885138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.885163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.885294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.885418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.885443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.885550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.885652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.885678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.885789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.885916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.885942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.886067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.886179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.886206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.886309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.886404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.886431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.886589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.886717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.886744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.886844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.886965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.886991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.887121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.887244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.394 [2024-11-26 05:26:33.887269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.394 qpair failed and we were unable to recover it. 00:30:32.394 [2024-11-26 05:26:33.887365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.887456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.887482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.887580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.887674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.887706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.887807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.887907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.887933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.888077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.888187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.888213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.888334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.888427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.888452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.888549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.888641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.888667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.888790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.888882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.888908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.889013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.889142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.889168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.889294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.889417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.889444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.889537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.889638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.889665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.889809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.889935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.889963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.890093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.890223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.890248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.890399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.890498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.890523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.890640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.890758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.890784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.890896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.890987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.891012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.891129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.891252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.891279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.891374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.891467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.891493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.891620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.891758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.891786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.891896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.891995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.892021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.892148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.892236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.892262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.892360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.892455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.892481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.892592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.892730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.892755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.892855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.892978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.893003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.893095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.893191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.893217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.893305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.893426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.893452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.893547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.893672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.893707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.893833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.893928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.893955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.894078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.894201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.894227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.894327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.894421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.395 [2024-11-26 05:26:33.894448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.395 qpair failed and we were unable to recover it. 00:30:32.395 [2024-11-26 05:26:33.894605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.894716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.894742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.894869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.894956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.894983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.895078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.895188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.895216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.895372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.895470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.895496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.895601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.895736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.895764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.895867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.895996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.896023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.896150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.896238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.896264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.896361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.896510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.896535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.896638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.896736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.896763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.896896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.896985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.897011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.897160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.897281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.897306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.897438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.897534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.897559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.897715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.897817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.897842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.897974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.898068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.898093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.898211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.898332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.898362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.898488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.898574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.898599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.898695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.898823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.898849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.898979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.899073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.899099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.899197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.899350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.899375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.899481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.899583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.899608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.899711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.899805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.899831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.899929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.900021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.900046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.900170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.900290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.900316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.900416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.900509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.900534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.396 [2024-11-26 05:26:33.900658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.900788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.396 [2024-11-26 05:26:33.900818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.396 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.900924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.901024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.901049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.901143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.901274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.901300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.901398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.901516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.901542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.901665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.901765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.901791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.901925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.902052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.902078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.902200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.902297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.902323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.902453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.902553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.902578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.902714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.902836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.902862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.902987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.903109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.903134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.903240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.903362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.903393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.903493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.903617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.903643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.903747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.903844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.903870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.903973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.904067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.904092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.904244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.904342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.904367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.904490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.904583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.904608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.904719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.904850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.904875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.904985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.905112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.905137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.905230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.905352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.905377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.905471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.905589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.905614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.905747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.905850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.905880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.905980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.906083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.906109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.906260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.906361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.906388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.906489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.906587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.906612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.906750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.906883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.906909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.907015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.907155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.907180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.907311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.907437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.907463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.907553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.907647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.907672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.907787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.907889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.907917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.397 qpair failed and we were unable to recover it. 00:30:32.397 [2024-11-26 05:26:33.908022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.908116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.397 [2024-11-26 05:26:33.908142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.908275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.908397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.908423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.908557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.908660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.908693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.908797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.908893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.908919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.909018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.909104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.909130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.909225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.909322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.909348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.909448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.909581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.909606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.909738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.909856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.909882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.910011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.910105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.910131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.910231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.910361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.910386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.910507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.910633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.910659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.910765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.910889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.910915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.911025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.911130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.911156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.911309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.911427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.911453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.911549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.911643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.911669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.911780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.911902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.911927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.912029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.912135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.912161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.912291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.912417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.912443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.912543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.912677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.912709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.912814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.912907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.912934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.913058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.913152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.913177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.913307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.913395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.913420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.913518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.913612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.913637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.913735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.913839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.913866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.913971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.914098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.914122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.914219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.914316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.914341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.914470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.914573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.914600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.914714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.914846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.914872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.914978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.915096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.915121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.398 qpair failed and we were unable to recover it. 00:30:32.398 [2024-11-26 05:26:33.915217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.398 [2024-11-26 05:26:33.915337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.915362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.915456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.915576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.915601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.915729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.915833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.915859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.915964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.916062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.916087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.916213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.916309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.916336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.916471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.916591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.916617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.916708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.916797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.916822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.916918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.917042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.917068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.917189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.917274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.917300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.917398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.917497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.917522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.917624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.917721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.917747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.917882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.917977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.918002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.918096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.918194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.918219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.918349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.918447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.918474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.918596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.918699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.918724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.918819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.918910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.918935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.919036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.919127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.919152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.919265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.919363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.919388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.919489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.919611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.919636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.919745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.919870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.919896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.919998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.920118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.920143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.920274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.920366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.920391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.920489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.920610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.920635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.920756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.920860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.920886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.921003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.921128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.921154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.921281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.921383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.921408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.921514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.921650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.921676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.921791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.921881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.921906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.922026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.922124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.399 [2024-11-26 05:26:33.922151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.399 qpair failed and we were unable to recover it. 00:30:32.399 [2024-11-26 05:26:33.922239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.922344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.922370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.922508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.922603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.922629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.922744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.922911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.922937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.923065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.923173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.923199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.923302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.923395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.923420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.923529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.923616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.923641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.923763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.923885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.923911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.924011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.924133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.924158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.924255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.924357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.924383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.924488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.924638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.924663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.924775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.924901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.924927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.925032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.925127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.925154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.925257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.925355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.925380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.925484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.925581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.925605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5964000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.925725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.925829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.925858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.925966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.926069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.926096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.926225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.926315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.926341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.926551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.926647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.926673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.927028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.927160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.927185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.927336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.927598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.927623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.927743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.927840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.927865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.927965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 05:26:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:32.400 [2024-11-26 05:26:33.928096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.928122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 05:26:33 -- common/autotest_common.sh@862 -- # return 0 00:30:32.400 [2024-11-26 05:26:33.928237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 05:26:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:32.400 [2024-11-26 05:26:33.928334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.928360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 05:26:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:32.400 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:30:32.400 [2024-11-26 05:26:33.928479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.928577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.928609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.928746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.928845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.928870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.928978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.929066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.929093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.929197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.929301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.929328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.400 [2024-11-26 05:26:33.929451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.929549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.400 [2024-11-26 05:26:33.929576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.400 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.929675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.929786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.929812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.929940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.930030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.930056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.930181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.930308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.930334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.930465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.930567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.930591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.930700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.930801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.930826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.930923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.931029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.931060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.931165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.931290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.931315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.931440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.931562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.931588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.931694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.931788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.931814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.931937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.932073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.932098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.932199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.932330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.932355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.932476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.932579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.932604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.932701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.932825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.932850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.932947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.933047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.933072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.933170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.933304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.933329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.933449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.933565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.933595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.933730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.933835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.933861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.933959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.934065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.934090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.934250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.934342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.934368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.934499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.934651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.934676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.934774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.934870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.934895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.935038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.935135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.935160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.935285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.935421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.935447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.935546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.935651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.935676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.935819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.935951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.935976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.401 qpair failed and we were unable to recover it. 00:30:32.401 [2024-11-26 05:26:33.936107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.401 [2024-11-26 05:26:33.936235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.936262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.936377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.936473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.936500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.936597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.936740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.936766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.936871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.937021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.937046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.937150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.937248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.937275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.937409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.937539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.937564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.937668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.937779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.937806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.937902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.938012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.938037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.938144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.938272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.938298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.938394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.938488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.938514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.938619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.938739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.938765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.938865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.938994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.939019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.939118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.939224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.939249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.939375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.939471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.939499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.939629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.939731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.939757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.939881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.939993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.940020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.940141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.940261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.940291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.940400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.940524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.940550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.940647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.940785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.940811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.940909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.941014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.941040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.941142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.941265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.941290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.941393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.941484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.941509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.941629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.941759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.941785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.941885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.942009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.942034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.942162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.942284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.942309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.942402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.942498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.942529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.942629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.942752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.942777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.942934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.943066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.943092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.402 [2024-11-26 05:26:33.943190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.943287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.402 [2024-11-26 05:26:33.943312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.402 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.943416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.943539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.943565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.943654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.943781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.943807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.943937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.944066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.944093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.944222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.944350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.944375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.944470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.944607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.944632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.944735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.944836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.944862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.944990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 05:26:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:32.403 [2024-11-26 05:26:33.945116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.945142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 05:26:33 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:32.403 [2024-11-26 05:26:33.945263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 05:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.403 [2024-11-26 05:26:33.945352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.945378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:30:32.403 [2024-11-26 05:26:33.945506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.945611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.945638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.945740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.945833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.945858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.945959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.946075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.946099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.946201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.946324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.946350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.946451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.946547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.946572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.946664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.946808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.946834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.946935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.947037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.947064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.947167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.947261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.947286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.947440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.947561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.947586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.947715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.947812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.947837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.947931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.948072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.948097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.948215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.948305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.948329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.948432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.948548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.948573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.948668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.948798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.948823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.948975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.949107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.949133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.949231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.949320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.949345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.949457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.949585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.949610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.949712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.949814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.949839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.949939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.950045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.950071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.403 qpair failed and we were unable to recover it. 00:30:32.403 [2024-11-26 05:26:33.950194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.403 [2024-11-26 05:26:33.950287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.950312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.950444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.950567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.950592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.950690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.950813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.950838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.950962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.951084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.951109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.951201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.951325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.951351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.951450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.951578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.951603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.951714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.951856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.951881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.952001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.952100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.952125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.952215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.952312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.952337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.952437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.952564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.952588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.952713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.952839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.952864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.952956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.953107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.953131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.953286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.953391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.953418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.953527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.953628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.953655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.953763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.953870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.953896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.954031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.954157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.954182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.954335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.954439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.954464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.954592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.954727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.954755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.954885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.955018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.955042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.955189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.955306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.955332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.955435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.955591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.955617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.955753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.955851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.955876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.955967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.956071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.956096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.956193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.956330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.956355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.956484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.956588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.956615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.956737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.956834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.956860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.956983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.957115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.957140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.957264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.957353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.957379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.957482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.957579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.404 [2024-11-26 05:26:33.957605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.404 qpair failed and we were unable to recover it. 00:30:32.404 [2024-11-26 05:26:33.957716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.957840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.957865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.957968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.958110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.958135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.958231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.958322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.958347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.958445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.958547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.958572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.958668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.958761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.958786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.958922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.959048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.959077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.959184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.959319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.959345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.959471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.959577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.959603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.959744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.959841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.959866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.959959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.960065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.960090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.960197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.960341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.960366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.960468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.960577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.960605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.960748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.960850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.960875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.961003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.961146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.961171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.961278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.961405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.961431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.961535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.961633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.961662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.961800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.961920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.961945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.962053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.962172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.962197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.962296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.962455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.962480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.962614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.962722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.962748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.962913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.963020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.963047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.963176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.963286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.963314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.963456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.963600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.963625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.963726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.963833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.963858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.963993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.964130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.405 [2024-11-26 05:26:33.964155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.405 qpair failed and we were unable to recover it. 00:30:32.405 [2024-11-26 05:26:33.964277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.964384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.964414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.964517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.964618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.964643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.964747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.964844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.964869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.964969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.965106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.965132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.965220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.965346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.965371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.965462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.965553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.965578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.965698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.965830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.965855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.965982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.966078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.966105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.966233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.966344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.966369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.966470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.966566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.966591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.966722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.966824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.966854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.966960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.967059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.967086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.967211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.967337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.967362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.967474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 Malloc0 00:30:32.406 [2024-11-26 05:26:33.967568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.967593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.967729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.967824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.967849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 05:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.406 [2024-11-26 05:26:33.967947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 05:26:33 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:32.406 [2024-11-26 05:26:33.968091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.968118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 05:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.406 [2024-11-26 05:26:33.968208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:30:32.406 [2024-11-26 05:26:33.968299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.968325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.968449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.968545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.968570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.968676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.968809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.968836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.968937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.969041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.969068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.969184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.969307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.969332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.969428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.969521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.969546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.969647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.969749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.969774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.969875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.969966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.969996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.970116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.970210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.970235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.970331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.970453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.970478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.970607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.970710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.970736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.406 [2024-11-26 05:26:33.970843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.970948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.406 [2024-11-26 05:26:33.970973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.406 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.971075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.971174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.971201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.971245] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:32.407 [2024-11-26 05:26:33.971337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.971463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.971487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.971588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.971730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.971755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.971883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.971986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.972012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.972114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.972242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.972266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.972387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.972483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.972508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.972613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.972719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.972745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.972875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.972976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.973001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.973115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.973207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.973233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.973364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.973467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.973493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.973602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.973726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.973752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.973849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.973961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.973985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.974090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.974212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.974237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.974363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.974462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.974489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.974589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.974693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.974719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.974849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.974946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.974972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.975108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.975198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.975224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.975332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.975457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.975482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.975575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.975674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.975727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.975836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.975932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.975957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.976062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.976181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.976206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.976358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.976462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.976487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.976588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.976724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.976751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.976847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.976940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.976965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.977080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.977182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.977207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.977307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.977434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.977460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.977560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.977655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.977680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.977802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.977896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.977920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.407 qpair failed and we were unable to recover it. 00:30:32.407 [2024-11-26 05:26:33.978050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.407 [2024-11-26 05:26:33.978199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.978224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.978322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.978416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.978441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.978568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.978690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.978716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.978813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.978912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.978937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f596c000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.979097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.979209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.979242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.979347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 05:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.408 [2024-11-26 05:26:33.979474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.979502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 05:26:33 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:32.408 [2024-11-26 05:26:33.979593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.979722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 05:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.408 [2024-11-26 05:26:33.979749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:30:32.408 [2024-11-26 05:26:33.979873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.979984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.980011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.980144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.980240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.980266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.980375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.980475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.980502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.980601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.980699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.980725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.980857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.980959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.980986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.981096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.981198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.981224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.981325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.981457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.981483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.981579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.981722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.981749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.981854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.981948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.981974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.982071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.982207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.982233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.982334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.982434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.982460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.982551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.982655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.982681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.982795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.982949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.982982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.983114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.983240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.983266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.983396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.983496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.983522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.983630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.983754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.983781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.983883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.983989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.984021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.984125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.984248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.984273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.984367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.984485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.984510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.984603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.984718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.984746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.984875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.984980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.985005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.408 qpair failed and we were unable to recover it. 00:30:32.408 [2024-11-26 05:26:33.985106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.408 [2024-11-26 05:26:33.985200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.985226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.985327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.985450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.985477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.985632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.985744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.985771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.985878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.986005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.986031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.986129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.986226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.986253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.986358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.986457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.986488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.986584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.986711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.986737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.986838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.986934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.986959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.987083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.987216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.987245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.987382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 05:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.409 [2024-11-26 05:26:33.987479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.987505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.987601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 05:26:33 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:32.409 [2024-11-26 05:26:33.987716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.987742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 05:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.987847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:30:32.409 [2024-11-26 05:26:33.987946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.987971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.988114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.988268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.988293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.988395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.988524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.988550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.988677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.988777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.988803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.988909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.989031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.989057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.989183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.989284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.989310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.989406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.989511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.989537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.989636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.989745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.989773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.989873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.990001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.990027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.990127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.990254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.990279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.990380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.990470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.990496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.990596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.990707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.990736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.990836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.990941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.990967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.991064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.991200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.991225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.991334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.991457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.991482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.991591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.991717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.991743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.991870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.991976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.992002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.409 qpair failed and we were unable to recover it. 00:30:32.409 [2024-11-26 05:26:33.992116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.409 [2024-11-26 05:26:33.992210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.992236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.992334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.992458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.992484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.992580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.992741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.992767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.992897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.993041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.993067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.993163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.993259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.993285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.993410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.993505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.993531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.993633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.993743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.993770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.993878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.994018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.994044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.994152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.994244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.994270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.994395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.994519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.994544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.994670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.994810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.994838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.994936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.995043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.995069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.995157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.995283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.995308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.995405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 05:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.410 [2024-11-26 05:26:33.995528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.995554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.995653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 05:26:33 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:32.410 [2024-11-26 05:26:33.995769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.995795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 05:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.410 [2024-11-26 05:26:33.995910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:30:32.410 [2024-11-26 05:26:33.996013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.996039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.996133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.996243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.996269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.996394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.996488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.996514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.996622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.996723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.996750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.996848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.996946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.996972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.997102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.997225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.997251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.997343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.997466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.997492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.997599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.997766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.997793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.997889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.998001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.998027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.410 [2024-11-26 05:26:33.998124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.998245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.410 [2024-11-26 05:26:33.998270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.410 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:33.998412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.411 [2024-11-26 05:26:33.998503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.411 [2024-11-26 05:26:33.998529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:33.998703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.411 [2024-11-26 05:26:33.998806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.411 [2024-11-26 05:26:33.998833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:33.998927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.411 [2024-11-26 05:26:33.999037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.411 [2024-11-26 05:26:33.999063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:33.999187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.411 [2024-11-26 05:26:33.999278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:32.411 [2024-11-26 05:26:33.999304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5960000b90 with addr=10.0.0.2, port=4420 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:33.999765] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:32.411 [2024-11-26 05:26:34.001903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.411 [2024-11-26 05:26:34.002028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.411 [2024-11-26 05:26:34.002057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.411 [2024-11-26 05:26:34.002073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.411 [2024-11-26 05:26:34.002087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.411 [2024-11-26 05:26:34.002122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 05:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.411 05:26:34 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:32.411 05:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.411 05:26:34 -- common/autotest_common.sh@10 -- # set +x 00:30:32.411 05:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.411 05:26:34 -- host/target_disconnect.sh@58 -- # wait 3429255 00:30:32.411 [2024-11-26 05:26:34.011811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.411 [2024-11-26 05:26:34.011912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.411 [2024-11-26 05:26:34.011939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.411 [2024-11-26 05:26:34.011953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.411 [2024-11-26 05:26:34.011967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.411 [2024-11-26 05:26:34.011996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:34.021794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.411 [2024-11-26 05:26:34.021898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.411 [2024-11-26 05:26:34.021926] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.411 [2024-11-26 05:26:34.021940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.411 [2024-11-26 05:26:34.021960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.411 [2024-11-26 05:26:34.021992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:34.031862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.411 [2024-11-26 05:26:34.031975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.411 [2024-11-26 05:26:34.032001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.411 [2024-11-26 05:26:34.032015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.411 [2024-11-26 05:26:34.032028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.411 [2024-11-26 05:26:34.032059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:34.041790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.411 [2024-11-26 05:26:34.041891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.411 [2024-11-26 05:26:34.041917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.411 [2024-11-26 05:26:34.041932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.411 [2024-11-26 05:26:34.041944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.411 [2024-11-26 05:26:34.041975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:34.051852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.411 [2024-11-26 05:26:34.051956] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.411 [2024-11-26 05:26:34.051983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.411 [2024-11-26 05:26:34.051997] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.411 [2024-11-26 05:26:34.052010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.411 [2024-11-26 05:26:34.052040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:34.061850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.411 [2024-11-26 05:26:34.061948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.411 [2024-11-26 05:26:34.061976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.411 [2024-11-26 05:26:34.061991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.411 [2024-11-26 05:26:34.062004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.411 [2024-11-26 05:26:34.062034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:34.071886] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.411 [2024-11-26 05:26:34.071994] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.411 [2024-11-26 05:26:34.072021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.411 [2024-11-26 05:26:34.072035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.411 [2024-11-26 05:26:34.072048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.411 [2024-11-26 05:26:34.072092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:34.081929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.411 [2024-11-26 05:26:34.082056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.411 [2024-11-26 05:26:34.082082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.411 [2024-11-26 05:26:34.082096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.411 [2024-11-26 05:26:34.082109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.411 [2024-11-26 05:26:34.082139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:34.091928] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.411 [2024-11-26 05:26:34.092034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.411 [2024-11-26 05:26:34.092061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.411 [2024-11-26 05:26:34.092075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.411 [2024-11-26 05:26:34.092088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.411 [2024-11-26 05:26:34.092119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.411 [2024-11-26 05:26:34.101952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.411 [2024-11-26 05:26:34.102055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.411 [2024-11-26 05:26:34.102081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.411 [2024-11-26 05:26:34.102096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.411 [2024-11-26 05:26:34.102109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.411 [2024-11-26 05:26:34.102140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.411 qpair failed and we were unable to recover it. 00:30:32.412 [2024-11-26 05:26:34.111991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.412 [2024-11-26 05:26:34.112109] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.412 [2024-11-26 05:26:34.112135] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.412 [2024-11-26 05:26:34.112150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.412 [2024-11-26 05:26:34.112168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.412 [2024-11-26 05:26:34.112200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.412 qpair failed and we were unable to recover it. 00:30:32.412 [2024-11-26 05:26:34.122008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.412 [2024-11-26 05:26:34.122122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.412 [2024-11-26 05:26:34.122147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.412 [2024-11-26 05:26:34.122161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.412 [2024-11-26 05:26:34.122175] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.412 [2024-11-26 05:26:34.122205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.412 qpair failed and we were unable to recover it. 00:30:32.672 [2024-11-26 05:26:34.132222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.672 [2024-11-26 05:26:34.132356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.672 [2024-11-26 05:26:34.132383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.672 [2024-11-26 05:26:34.132397] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.672 [2024-11-26 05:26:34.132410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.672 [2024-11-26 05:26:34.132440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.672 qpair failed and we were unable to recover it. 00:30:32.672 [2024-11-26 05:26:34.142228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.672 [2024-11-26 05:26:34.142335] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.672 [2024-11-26 05:26:34.142360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.672 [2024-11-26 05:26:34.142375] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.672 [2024-11-26 05:26:34.142388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.672 [2024-11-26 05:26:34.142417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.672 qpair failed and we were unable to recover it. 00:30:32.672 [2024-11-26 05:26:34.152170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.672 [2024-11-26 05:26:34.152272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.672 [2024-11-26 05:26:34.152298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.672 [2024-11-26 05:26:34.152313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.672 [2024-11-26 05:26:34.152325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.672 [2024-11-26 05:26:34.152356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.672 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.162156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.162254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.673 [2024-11-26 05:26:34.162280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.673 [2024-11-26 05:26:34.162294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.673 [2024-11-26 05:26:34.162309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.673 [2024-11-26 05:26:34.162339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.673 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.172151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.172244] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.673 [2024-11-26 05:26:34.172270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.673 [2024-11-26 05:26:34.172284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.673 [2024-11-26 05:26:34.172298] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.673 [2024-11-26 05:26:34.172328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.673 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.182258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.182414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.673 [2024-11-26 05:26:34.182463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.673 [2024-11-26 05:26:34.182486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.673 [2024-11-26 05:26:34.182502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5960000b90 00:30:32.673 [2024-11-26 05:26:34.182547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:32.673 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.192245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.192350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.673 [2024-11-26 05:26:34.192386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.673 [2024-11-26 05:26:34.192403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.673 [2024-11-26 05:26:34.192417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.673 [2024-11-26 05:26:34.192447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.673 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.202238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.202340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.673 [2024-11-26 05:26:34.202368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.673 [2024-11-26 05:26:34.202389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.673 [2024-11-26 05:26:34.202403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.673 [2024-11-26 05:26:34.202433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.673 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.212292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.212391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.673 [2024-11-26 05:26:34.212417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.673 [2024-11-26 05:26:34.212432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.673 [2024-11-26 05:26:34.212445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.673 [2024-11-26 05:26:34.212473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.673 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.222305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.222400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.673 [2024-11-26 05:26:34.222428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.673 [2024-11-26 05:26:34.222442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.673 [2024-11-26 05:26:34.222454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.673 [2024-11-26 05:26:34.222482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.673 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.232335] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.232439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.673 [2024-11-26 05:26:34.232466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.673 [2024-11-26 05:26:34.232480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.673 [2024-11-26 05:26:34.232493] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.673 [2024-11-26 05:26:34.232521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.673 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.242394] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.242517] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.673 [2024-11-26 05:26:34.242543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.673 [2024-11-26 05:26:34.242557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.673 [2024-11-26 05:26:34.242570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.673 [2024-11-26 05:26:34.242597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.673 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.252405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.252511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.673 [2024-11-26 05:26:34.252537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.673 [2024-11-26 05:26:34.252551] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.673 [2024-11-26 05:26:34.252564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.673 [2024-11-26 05:26:34.252592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.673 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.262414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.262513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.673 [2024-11-26 05:26:34.262539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.673 [2024-11-26 05:26:34.262553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.673 [2024-11-26 05:26:34.262565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.673 [2024-11-26 05:26:34.262594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.673 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.272450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.272553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.673 [2024-11-26 05:26:34.272578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.673 [2024-11-26 05:26:34.272593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.673 [2024-11-26 05:26:34.272605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.673 [2024-11-26 05:26:34.272633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.673 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.282486] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.282590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.673 [2024-11-26 05:26:34.282616] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.673 [2024-11-26 05:26:34.282630] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.673 [2024-11-26 05:26:34.282643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.673 [2024-11-26 05:26:34.282671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.673 qpair failed and we were unable to recover it. 00:30:32.673 [2024-11-26 05:26:34.292502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.673 [2024-11-26 05:26:34.292625] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.292651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.292672] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.674 [2024-11-26 05:26:34.292692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.674 [2024-11-26 05:26:34.292723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.674 qpair failed and we were unable to recover it. 00:30:32.674 [2024-11-26 05:26:34.302521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.674 [2024-11-26 05:26:34.302620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.302646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.302660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.674 [2024-11-26 05:26:34.302674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.674 [2024-11-26 05:26:34.302709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.674 qpair failed and we were unable to recover it. 00:30:32.674 [2024-11-26 05:26:34.312569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.674 [2024-11-26 05:26:34.312678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.312710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.312724] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.674 [2024-11-26 05:26:34.312737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.674 [2024-11-26 05:26:34.312768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.674 qpair failed and we were unable to recover it. 00:30:32.674 [2024-11-26 05:26:34.322610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.674 [2024-11-26 05:26:34.322721] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.322746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.322761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.674 [2024-11-26 05:26:34.322775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.674 [2024-11-26 05:26:34.322805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.674 qpair failed and we were unable to recover it. 00:30:32.674 [2024-11-26 05:26:34.332642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.674 [2024-11-26 05:26:34.332755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.332780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.332794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.674 [2024-11-26 05:26:34.332807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.674 [2024-11-26 05:26:34.332835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.674 qpair failed and we were unable to recover it. 00:30:32.674 [2024-11-26 05:26:34.342707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.674 [2024-11-26 05:26:34.342810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.342835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.342850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.674 [2024-11-26 05:26:34.342862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.674 [2024-11-26 05:26:34.342890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.674 qpair failed and we were unable to recover it. 00:30:32.674 [2024-11-26 05:26:34.352723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.674 [2024-11-26 05:26:34.352831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.352856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.352869] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.674 [2024-11-26 05:26:34.352882] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.674 [2024-11-26 05:26:34.352910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.674 qpair failed and we were unable to recover it. 00:30:32.674 [2024-11-26 05:26:34.362747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.674 [2024-11-26 05:26:34.362847] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.362873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.362887] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.674 [2024-11-26 05:26:34.362899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.674 [2024-11-26 05:26:34.362927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.674 qpair failed and we were unable to recover it. 00:30:32.674 [2024-11-26 05:26:34.372758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.674 [2024-11-26 05:26:34.372872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.372897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.372911] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.674 [2024-11-26 05:26:34.372923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.674 [2024-11-26 05:26:34.372951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.674 qpair failed and we were unable to recover it. 00:30:32.674 [2024-11-26 05:26:34.382776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.674 [2024-11-26 05:26:34.382872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.382897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.382917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.674 [2024-11-26 05:26:34.382930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.674 [2024-11-26 05:26:34.382960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.674 qpair failed and we were unable to recover it. 00:30:32.674 [2024-11-26 05:26:34.392849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.674 [2024-11-26 05:26:34.392958] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.392987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.393002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.674 [2024-11-26 05:26:34.393014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.674 [2024-11-26 05:26:34.393043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.674 qpair failed and we were unable to recover it. 00:30:32.674 [2024-11-26 05:26:34.402858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.674 [2024-11-26 05:26:34.402962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.402988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.403002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.674 [2024-11-26 05:26:34.403014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.674 [2024-11-26 05:26:34.403042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.674 qpair failed and we were unable to recover it. 00:30:32.674 [2024-11-26 05:26:34.412921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.674 [2024-11-26 05:26:34.413039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.413064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.413078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.674 [2024-11-26 05:26:34.413091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.674 [2024-11-26 05:26:34.413119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.674 qpair failed and we were unable to recover it. 00:30:32.674 [2024-11-26 05:26:34.422893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.674 [2024-11-26 05:26:34.422987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.674 [2024-11-26 05:26:34.423013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.674 [2024-11-26 05:26:34.423026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.675 [2024-11-26 05:26:34.423039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.675 [2024-11-26 05:26:34.423066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.675 qpair failed and we were unable to recover it. 00:30:32.675 [2024-11-26 05:26:34.432974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.675 [2024-11-26 05:26:34.433091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.675 [2024-11-26 05:26:34.433115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.675 [2024-11-26 05:26:34.433129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.675 [2024-11-26 05:26:34.433141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.675 [2024-11-26 05:26:34.433169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.675 qpair failed and we were unable to recover it. 00:30:32.936 [2024-11-26 05:26:34.442973] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.936 [2024-11-26 05:26:34.443081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.936 [2024-11-26 05:26:34.443106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.936 [2024-11-26 05:26:34.443120] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.936 [2024-11-26 05:26:34.443132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.936 [2024-11-26 05:26:34.443160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.936 qpair failed and we were unable to recover it. 00:30:32.936 [2024-11-26 05:26:34.452995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.937 [2024-11-26 05:26:34.453093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.937 [2024-11-26 05:26:34.453118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.937 [2024-11-26 05:26:34.453132] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.937 [2024-11-26 05:26:34.453144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.937 [2024-11-26 05:26:34.453172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.937 qpair failed and we were unable to recover it. 00:30:32.937 [2024-11-26 05:26:34.463020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.937 [2024-11-26 05:26:34.463118] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.937 [2024-11-26 05:26:34.463144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.937 [2024-11-26 05:26:34.463157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.937 [2024-11-26 05:26:34.463170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.937 [2024-11-26 05:26:34.463197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.937 qpair failed and we were unable to recover it. 00:30:32.937 [2024-11-26 05:26:34.473097] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.937 [2024-11-26 05:26:34.473213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.937 [2024-11-26 05:26:34.473243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.937 [2024-11-26 05:26:34.473258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.937 [2024-11-26 05:26:34.473271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.937 [2024-11-26 05:26:34.473298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.937 qpair failed and we were unable to recover it. 00:30:32.937 [2024-11-26 05:26:34.483123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.937 [2024-11-26 05:26:34.483233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.937 [2024-11-26 05:26:34.483261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.937 [2024-11-26 05:26:34.483275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.937 [2024-11-26 05:26:34.483287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.937 [2024-11-26 05:26:34.483317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.937 qpair failed and we were unable to recover it. 00:30:32.937 [2024-11-26 05:26:34.493143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.937 [2024-11-26 05:26:34.493258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.937 [2024-11-26 05:26:34.493283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.937 [2024-11-26 05:26:34.493297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.937 [2024-11-26 05:26:34.493309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.937 [2024-11-26 05:26:34.493338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.937 qpair failed and we were unable to recover it. 00:30:32.937 [2024-11-26 05:26:34.503135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.937 [2024-11-26 05:26:34.503236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.937 [2024-11-26 05:26:34.503261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.937 [2024-11-26 05:26:34.503275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.937 [2024-11-26 05:26:34.503287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.937 [2024-11-26 05:26:34.503315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.937 qpair failed and we were unable to recover it. 00:30:32.937 [2024-11-26 05:26:34.513197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.937 [2024-11-26 05:26:34.513316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.937 [2024-11-26 05:26:34.513341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.937 [2024-11-26 05:26:34.513355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.937 [2024-11-26 05:26:34.513367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.937 [2024-11-26 05:26:34.513395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.937 qpair failed and we were unable to recover it. 00:30:32.937 [2024-11-26 05:26:34.523220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.937 [2024-11-26 05:26:34.523316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.937 [2024-11-26 05:26:34.523342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.937 [2024-11-26 05:26:34.523356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.937 [2024-11-26 05:26:34.523368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.937 [2024-11-26 05:26:34.523396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.937 qpair failed and we were unable to recover it. 00:30:32.937 [2024-11-26 05:26:34.533222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.937 [2024-11-26 05:26:34.533331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.937 [2024-11-26 05:26:34.533356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.937 [2024-11-26 05:26:34.533369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.937 [2024-11-26 05:26:34.533382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.937 [2024-11-26 05:26:34.533410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.937 qpair failed and we were unable to recover it. 00:30:32.937 [2024-11-26 05:26:34.543273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.937 [2024-11-26 05:26:34.543371] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.937 [2024-11-26 05:26:34.543397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.937 [2024-11-26 05:26:34.543410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.937 [2024-11-26 05:26:34.543423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.937 [2024-11-26 05:26:34.543451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.937 qpair failed and we were unable to recover it. 00:30:32.937 [2024-11-26 05:26:34.553301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.937 [2024-11-26 05:26:34.553400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.937 [2024-11-26 05:26:34.553426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.937 [2024-11-26 05:26:34.553439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.937 [2024-11-26 05:26:34.553452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.937 [2024-11-26 05:26:34.553480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.937 qpair failed and we were unable to recover it. 00:30:32.937 [2024-11-26 05:26:34.563333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.937 [2024-11-26 05:26:34.563446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.937 [2024-11-26 05:26:34.563477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.937 [2024-11-26 05:26:34.563492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.937 [2024-11-26 05:26:34.563504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.937 [2024-11-26 05:26:34.563532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.937 qpair failed and we were unable to recover it. 00:30:32.937 [2024-11-26 05:26:34.573358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.937 [2024-11-26 05:26:34.573462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.937 [2024-11-26 05:26:34.573488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.937 [2024-11-26 05:26:34.573501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.937 [2024-11-26 05:26:34.573514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.937 [2024-11-26 05:26:34.573541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.937 qpair failed and we were unable to recover it. 00:30:32.938 [2024-11-26 05:26:34.583356] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.938 [2024-11-26 05:26:34.583452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.938 [2024-11-26 05:26:34.583477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.938 [2024-11-26 05:26:34.583491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.938 [2024-11-26 05:26:34.583503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.938 [2024-11-26 05:26:34.583531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.938 qpair failed and we were unable to recover it. 00:30:32.938 [2024-11-26 05:26:34.593422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.938 [2024-11-26 05:26:34.593524] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.938 [2024-11-26 05:26:34.593549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.938 [2024-11-26 05:26:34.593562] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.938 [2024-11-26 05:26:34.593575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.938 [2024-11-26 05:26:34.593602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.938 qpair failed and we were unable to recover it. 00:30:32.938 [2024-11-26 05:26:34.603419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.938 [2024-11-26 05:26:34.603516] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.938 [2024-11-26 05:26:34.603542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.938 [2024-11-26 05:26:34.603556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.938 [2024-11-26 05:26:34.603568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.938 [2024-11-26 05:26:34.603596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.938 qpair failed and we were unable to recover it. 00:30:32.938 [2024-11-26 05:26:34.613460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.938 [2024-11-26 05:26:34.613564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.938 [2024-11-26 05:26:34.613589] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.938 [2024-11-26 05:26:34.613603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.938 [2024-11-26 05:26:34.613616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.938 [2024-11-26 05:26:34.613643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.938 qpair failed and we were unable to recover it. 00:30:32.938 [2024-11-26 05:26:34.623476] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.938 [2024-11-26 05:26:34.623568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.938 [2024-11-26 05:26:34.623594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.938 [2024-11-26 05:26:34.623607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.938 [2024-11-26 05:26:34.623620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.938 [2024-11-26 05:26:34.623647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.938 qpair failed and we were unable to recover it. 00:30:32.938 [2024-11-26 05:26:34.633520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.938 [2024-11-26 05:26:34.633621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.938 [2024-11-26 05:26:34.633646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.938 [2024-11-26 05:26:34.633660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.938 [2024-11-26 05:26:34.633672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.938 [2024-11-26 05:26:34.633708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.938 qpair failed and we were unable to recover it. 00:30:32.938 [2024-11-26 05:26:34.643590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.938 [2024-11-26 05:26:34.643707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.938 [2024-11-26 05:26:34.643733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.938 [2024-11-26 05:26:34.643747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.938 [2024-11-26 05:26:34.643758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.938 [2024-11-26 05:26:34.643786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.938 qpair failed and we were unable to recover it. 00:30:32.938 [2024-11-26 05:26:34.653563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.938 [2024-11-26 05:26:34.653663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.938 [2024-11-26 05:26:34.653699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.938 [2024-11-26 05:26:34.653715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.938 [2024-11-26 05:26:34.653727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.938 [2024-11-26 05:26:34.653756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.938 qpair failed and we were unable to recover it. 00:30:32.938 [2024-11-26 05:26:34.663591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.938 [2024-11-26 05:26:34.663695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.938 [2024-11-26 05:26:34.663721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.938 [2024-11-26 05:26:34.663735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.938 [2024-11-26 05:26:34.663747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.938 [2024-11-26 05:26:34.663775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.938 qpair failed and we were unable to recover it. 00:30:32.938 [2024-11-26 05:26:34.673648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.938 [2024-11-26 05:26:34.673762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.938 [2024-11-26 05:26:34.673787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.938 [2024-11-26 05:26:34.673802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.938 [2024-11-26 05:26:34.673814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.938 [2024-11-26 05:26:34.673842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.938 qpair failed and we were unable to recover it. 00:30:32.938 [2024-11-26 05:26:34.683715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.938 [2024-11-26 05:26:34.683823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.938 [2024-11-26 05:26:34.683848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.938 [2024-11-26 05:26:34.683862] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.938 [2024-11-26 05:26:34.683874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.938 [2024-11-26 05:26:34.683901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.938 qpair failed and we were unable to recover it. 00:30:32.938 [2024-11-26 05:26:34.693705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.938 [2024-11-26 05:26:34.693801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.938 [2024-11-26 05:26:34.693826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.938 [2024-11-26 05:26:34.693840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.938 [2024-11-26 05:26:34.693852] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:32.938 [2024-11-26 05:26:34.693885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:32.938 qpair failed and we were unable to recover it. 00:30:33.201 [2024-11-26 05:26:34.703726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.201 [2024-11-26 05:26:34.703826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.201 [2024-11-26 05:26:34.703852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.201 [2024-11-26 05:26:34.703866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.201 [2024-11-26 05:26:34.703878] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.201 [2024-11-26 05:26:34.703906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.201 qpair failed and we were unable to recover it. 00:30:33.201 [2024-11-26 05:26:34.713788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.201 [2024-11-26 05:26:34.713896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.201 [2024-11-26 05:26:34.713921] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.201 [2024-11-26 05:26:34.713935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.201 [2024-11-26 05:26:34.713948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.201 [2024-11-26 05:26:34.713975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.201 qpair failed and we were unable to recover it. 00:30:33.201 [2024-11-26 05:26:34.723796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.201 [2024-11-26 05:26:34.723907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.201 [2024-11-26 05:26:34.723933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.201 [2024-11-26 05:26:34.723946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.201 [2024-11-26 05:26:34.723959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.201 [2024-11-26 05:26:34.723986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.201 qpair failed and we were unable to recover it. 00:30:33.201 [2024-11-26 05:26:34.733863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.201 [2024-11-26 05:26:34.733961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.201 [2024-11-26 05:26:34.733986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.201 [2024-11-26 05:26:34.734000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.201 [2024-11-26 05:26:34.734013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.201 [2024-11-26 05:26:34.734040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.201 qpair failed and we were unable to recover it. 00:30:33.201 [2024-11-26 05:26:34.743925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.201 [2024-11-26 05:26:34.744028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.201 [2024-11-26 05:26:34.744058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.201 [2024-11-26 05:26:34.744074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.201 [2024-11-26 05:26:34.744087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.201 [2024-11-26 05:26:34.744114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.201 qpair failed and we were unable to recover it. 00:30:33.201 [2024-11-26 05:26:34.753920] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.201 [2024-11-26 05:26:34.754039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.201 [2024-11-26 05:26:34.754063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.201 [2024-11-26 05:26:34.754077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.201 [2024-11-26 05:26:34.754089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.201 [2024-11-26 05:26:34.754116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.201 qpair failed and we were unable to recover it. 00:30:33.201 [2024-11-26 05:26:34.763889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.201 [2024-11-26 05:26:34.763987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.201 [2024-11-26 05:26:34.764013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.201 [2024-11-26 05:26:34.764027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.201 [2024-11-26 05:26:34.764039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.201 [2024-11-26 05:26:34.764066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.201 qpair failed and we were unable to recover it. 00:30:33.201 [2024-11-26 05:26:34.773972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.201 [2024-11-26 05:26:34.774092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.201 [2024-11-26 05:26:34.774117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.201 [2024-11-26 05:26:34.774131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.201 [2024-11-26 05:26:34.774143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.201 [2024-11-26 05:26:34.774171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.201 qpair failed and we were unable to recover it. 00:30:33.201 [2024-11-26 05:26:34.783952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.201 [2024-11-26 05:26:34.784053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.201 [2024-11-26 05:26:34.784078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.201 [2024-11-26 05:26:34.784092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.201 [2024-11-26 05:26:34.784104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.201 [2024-11-26 05:26:34.784137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.201 qpair failed and we were unable to recover it. 00:30:33.201 [2024-11-26 05:26:34.794040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.201 [2024-11-26 05:26:34.794159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.201 [2024-11-26 05:26:34.794185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.201 [2024-11-26 05:26:34.794198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.201 [2024-11-26 05:26:34.794211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.201 [2024-11-26 05:26:34.794238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.201 qpair failed and we were unable to recover it. 00:30:33.201 [2024-11-26 05:26:34.804021] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.201 [2024-11-26 05:26:34.804117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.201 [2024-11-26 05:26:34.804142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.201 [2024-11-26 05:26:34.804155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.804168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.804195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.814037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.202 [2024-11-26 05:26:34.814139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.202 [2024-11-26 05:26:34.814163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.202 [2024-11-26 05:26:34.814177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.814189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.814217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.824074] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.202 [2024-11-26 05:26:34.824167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.202 [2024-11-26 05:26:34.824192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.202 [2024-11-26 05:26:34.824206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.824218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.824245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.834206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.202 [2024-11-26 05:26:34.834312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.202 [2024-11-26 05:26:34.834342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.202 [2024-11-26 05:26:34.834357] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.834369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.834397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.844170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.202 [2024-11-26 05:26:34.844304] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.202 [2024-11-26 05:26:34.844329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.202 [2024-11-26 05:26:34.844343] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.844355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.844384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.854294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.202 [2024-11-26 05:26:34.854406] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.202 [2024-11-26 05:26:34.854431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.202 [2024-11-26 05:26:34.854445] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.854457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.854484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.864193] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.202 [2024-11-26 05:26:34.864295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.202 [2024-11-26 05:26:34.864320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.202 [2024-11-26 05:26:34.864334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.864346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.864374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.874252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.202 [2024-11-26 05:26:34.874356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.202 [2024-11-26 05:26:34.874381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.202 [2024-11-26 05:26:34.874395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.874407] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.874441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.884259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.202 [2024-11-26 05:26:34.884359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.202 [2024-11-26 05:26:34.884387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.202 [2024-11-26 05:26:34.884400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.884413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.884440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.894316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.202 [2024-11-26 05:26:34.894439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.202 [2024-11-26 05:26:34.894465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.202 [2024-11-26 05:26:34.894479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.894492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.894519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.904318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.202 [2024-11-26 05:26:34.904421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.202 [2024-11-26 05:26:34.904447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.202 [2024-11-26 05:26:34.904461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.904474] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.904503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.914461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.202 [2024-11-26 05:26:34.914581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.202 [2024-11-26 05:26:34.914609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.202 [2024-11-26 05:26:34.914624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.914636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.914665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.924361] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.202 [2024-11-26 05:26:34.924467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.202 [2024-11-26 05:26:34.924500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.202 [2024-11-26 05:26:34.924515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.924527] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.924556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.934400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.202 [2024-11-26 05:26:34.934497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.202 [2024-11-26 05:26:34.934523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.202 [2024-11-26 05:26:34.934537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.202 [2024-11-26 05:26:34.934549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.202 [2024-11-26 05:26:34.934577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.202 qpair failed and we were unable to recover it. 00:30:33.202 [2024-11-26 05:26:34.944456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.203 [2024-11-26 05:26:34.944584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.203 [2024-11-26 05:26:34.944611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.203 [2024-11-26 05:26:34.944625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.203 [2024-11-26 05:26:34.944638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.203 [2024-11-26 05:26:34.944667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.203 qpair failed and we were unable to recover it. 00:30:33.203 [2024-11-26 05:26:34.954520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.203 [2024-11-26 05:26:34.954678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.203 [2024-11-26 05:26:34.954717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.203 [2024-11-26 05:26:34.954746] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.203 [2024-11-26 05:26:34.954759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.203 [2024-11-26 05:26:34.954788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.203 qpair failed and we were unable to recover it. 00:30:33.463 [2024-11-26 05:26:34.964478] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.463 [2024-11-26 05:26:34.964581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.463 [2024-11-26 05:26:34.964608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.463 [2024-11-26 05:26:34.964623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.463 [2024-11-26 05:26:34.964640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.463 [2024-11-26 05:26:34.964672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.463 qpair failed and we were unable to recover it. 00:30:33.463 [2024-11-26 05:26:34.974568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.463 [2024-11-26 05:26:34.974679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.463 [2024-11-26 05:26:34.974710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.464 [2024-11-26 05:26:34.974735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.464 [2024-11-26 05:26:34.974747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.464 [2024-11-26 05:26:34.974776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.464 qpair failed and we were unable to recover it. 00:30:33.464 [2024-11-26 05:26:34.984542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.464 [2024-11-26 05:26:34.984645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.464 [2024-11-26 05:26:34.984673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.464 [2024-11-26 05:26:34.984696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.464 [2024-11-26 05:26:34.984710] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.464 [2024-11-26 05:26:34.984749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.464 qpair failed and we were unable to recover it. 00:30:33.464 [2024-11-26 05:26:34.994574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.464 [2024-11-26 05:26:34.994677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.464 [2024-11-26 05:26:34.994710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.464 [2024-11-26 05:26:34.994736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.464 [2024-11-26 05:26:34.994749] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.464 [2024-11-26 05:26:34.994777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.464 qpair failed and we were unable to recover it. 00:30:33.464 [2024-11-26 05:26:35.004608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.464 [2024-11-26 05:26:35.004715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.464 [2024-11-26 05:26:35.004746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.464 [2024-11-26 05:26:35.004760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.464 [2024-11-26 05:26:35.004773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.464 [2024-11-26 05:26:35.004802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.464 qpair failed and we were unable to recover it. 00:30:33.464 [2024-11-26 05:26:35.014669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.464 [2024-11-26 05:26:35.014776] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.464 [2024-11-26 05:26:35.014811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.464 [2024-11-26 05:26:35.014831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.464 [2024-11-26 05:26:35.014844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.464 [2024-11-26 05:26:35.014874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.464 qpair failed and we were unable to recover it. 00:30:33.464 [2024-11-26 05:26:35.024654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.464 [2024-11-26 05:26:35.024762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.464 [2024-11-26 05:26:35.024788] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.464 [2024-11-26 05:26:35.024809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.464 [2024-11-26 05:26:35.024822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.464 [2024-11-26 05:26:35.024850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.464 qpair failed and we were unable to recover it. 00:30:33.464 [2024-11-26 05:26:35.034722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.464 [2024-11-26 05:26:35.034825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.464 [2024-11-26 05:26:35.034851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.464 [2024-11-26 05:26:35.034866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.464 [2024-11-26 05:26:35.034878] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.464 [2024-11-26 05:26:35.034906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.464 qpair failed and we were unable to recover it. 00:30:33.464 [2024-11-26 05:26:35.044739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.464 [2024-11-26 05:26:35.044852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.464 [2024-11-26 05:26:35.044877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.464 [2024-11-26 05:26:35.044892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.464 [2024-11-26 05:26:35.044903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.464 [2024-11-26 05:26:35.044933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.464 qpair failed and we were unable to recover it. 00:30:33.464 [2024-11-26 05:26:35.054767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.464 [2024-11-26 05:26:35.054866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.464 [2024-11-26 05:26:35.054891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.464 [2024-11-26 05:26:35.054905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.464 [2024-11-26 05:26:35.054923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.464 [2024-11-26 05:26:35.054953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.464 qpair failed and we were unable to recover it. 00:30:33.464 [2024-11-26 05:26:35.064809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.464 [2024-11-26 05:26:35.064924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.464 [2024-11-26 05:26:35.064948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.464 [2024-11-26 05:26:35.064962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.464 [2024-11-26 05:26:35.064975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.464 [2024-11-26 05:26:35.065004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.464 qpair failed and we were unable to recover it. 00:30:33.464 [2024-11-26 05:26:35.074857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.464 [2024-11-26 05:26:35.074981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.464 [2024-11-26 05:26:35.075006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.464 [2024-11-26 05:26:35.075020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.464 [2024-11-26 05:26:35.075034] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.464 [2024-11-26 05:26:35.075063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.464 qpair failed and we were unable to recover it. 00:30:33.464 [2024-11-26 05:26:35.084834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.464 [2024-11-26 05:26:35.084931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.464 [2024-11-26 05:26:35.084956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.464 [2024-11-26 05:26:35.084970] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.464 [2024-11-26 05:26:35.084982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.464 [2024-11-26 05:26:35.085011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.464 qpair failed and we were unable to recover it. 00:30:33.464 [2024-11-26 05:26:35.094887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.464 [2024-11-26 05:26:35.095009] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.464 [2024-11-26 05:26:35.095036] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.464 [2024-11-26 05:26:35.095051] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.464 [2024-11-26 05:26:35.095064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.464 [2024-11-26 05:26:35.095093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.464 qpair failed and we were unable to recover it. 00:30:33.464 [2024-11-26 05:26:35.105043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.465 [2024-11-26 05:26:35.105194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.465 [2024-11-26 05:26:35.105224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.465 [2024-11-26 05:26:35.105240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.465 [2024-11-26 05:26:35.105253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.465 [2024-11-26 05:26:35.105282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.465 qpair failed and we were unable to recover it. 00:30:33.465 [2024-11-26 05:26:35.114962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.465 [2024-11-26 05:26:35.115069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.465 [2024-11-26 05:26:35.115094] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.465 [2024-11-26 05:26:35.115108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.465 [2024-11-26 05:26:35.115121] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.465 [2024-11-26 05:26:35.115151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.465 qpair failed and we were unable to recover it. 00:30:33.465 [2024-11-26 05:26:35.124984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.465 [2024-11-26 05:26:35.125087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.465 [2024-11-26 05:26:35.125114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.465 [2024-11-26 05:26:35.125129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.465 [2024-11-26 05:26:35.125141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.465 [2024-11-26 05:26:35.125170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.465 qpair failed and we were unable to recover it. 00:30:33.465 [2024-11-26 05:26:35.134976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.465 [2024-11-26 05:26:35.135071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.465 [2024-11-26 05:26:35.135097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.465 [2024-11-26 05:26:35.135112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.465 [2024-11-26 05:26:35.135124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.465 [2024-11-26 05:26:35.135154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.465 qpair failed and we were unable to recover it. 00:30:33.465 [2024-11-26 05:26:35.145010] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.465 [2024-11-26 05:26:35.145107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.465 [2024-11-26 05:26:35.145134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.465 [2024-11-26 05:26:35.145148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.465 [2024-11-26 05:26:35.145168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.465 [2024-11-26 05:26:35.145198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.465 qpair failed and we were unable to recover it. 00:30:33.465 [2024-11-26 05:26:35.155069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.465 [2024-11-26 05:26:35.155181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.465 [2024-11-26 05:26:35.155206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.465 [2024-11-26 05:26:35.155222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.465 [2024-11-26 05:26:35.155235] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.465 [2024-11-26 05:26:35.155264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.465 qpair failed and we were unable to recover it. 00:30:33.465 [2024-11-26 05:26:35.165129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.465 [2024-11-26 05:26:35.165228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.465 [2024-11-26 05:26:35.165252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.465 [2024-11-26 05:26:35.165266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.465 [2024-11-26 05:26:35.165279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.465 [2024-11-26 05:26:35.165307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.465 qpair failed and we were unable to recover it. 00:30:33.465 [2024-11-26 05:26:35.175218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.465 [2024-11-26 05:26:35.175327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.465 [2024-11-26 05:26:35.175352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.465 [2024-11-26 05:26:35.175371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.465 [2024-11-26 05:26:35.175385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.465 [2024-11-26 05:26:35.175415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.465 qpair failed and we were unable to recover it. 00:30:33.465 [2024-11-26 05:26:35.185128] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.465 [2024-11-26 05:26:35.185237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.465 [2024-11-26 05:26:35.185263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.465 [2024-11-26 05:26:35.185277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.465 [2024-11-26 05:26:35.185290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.465 [2024-11-26 05:26:35.185319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.465 qpair failed and we were unable to recover it. 00:30:33.465 [2024-11-26 05:26:35.195163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.465 [2024-11-26 05:26:35.195275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.465 [2024-11-26 05:26:35.195301] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.465 [2024-11-26 05:26:35.195317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.465 [2024-11-26 05:26:35.195329] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.465 [2024-11-26 05:26:35.195358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.465 qpair failed and we were unable to recover it. 00:30:33.465 [2024-11-26 05:26:35.205188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.465 [2024-11-26 05:26:35.205287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.465 [2024-11-26 05:26:35.205314] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.465 [2024-11-26 05:26:35.205328] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.465 [2024-11-26 05:26:35.205341] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.465 [2024-11-26 05:26:35.205370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.465 qpair failed and we were unable to recover it. 00:30:33.465 [2024-11-26 05:26:35.215220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.465 [2024-11-26 05:26:35.215322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.465 [2024-11-26 05:26:35.215348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.465 [2024-11-26 05:26:35.215363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.465 [2024-11-26 05:26:35.215376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.465 [2024-11-26 05:26:35.215406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.465 qpair failed and we were unable to recover it. 00:30:33.465 [2024-11-26 05:26:35.225233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.465 [2024-11-26 05:26:35.225330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.465 [2024-11-26 05:26:35.225356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.465 [2024-11-26 05:26:35.225371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.465 [2024-11-26 05:26:35.225384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.465 [2024-11-26 05:26:35.225413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.465 qpair failed and we were unable to recover it. 00:30:33.725 [2024-11-26 05:26:35.235304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.725 [2024-11-26 05:26:35.235411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.725 [2024-11-26 05:26:35.235435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.725 [2024-11-26 05:26:35.235449] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.725 [2024-11-26 05:26:35.235468] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.725 [2024-11-26 05:26:35.235498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.725 qpair failed and we were unable to recover it. 00:30:33.725 [2024-11-26 05:26:35.245305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.725 [2024-11-26 05:26:35.245407] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.725 [2024-11-26 05:26:35.245431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.725 [2024-11-26 05:26:35.245445] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.725 [2024-11-26 05:26:35.245457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.725 [2024-11-26 05:26:35.245487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.725 qpair failed and we were unable to recover it. 00:30:33.725 [2024-11-26 05:26:35.255353] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.725 [2024-11-26 05:26:35.255501] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.725 [2024-11-26 05:26:35.255529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.725 [2024-11-26 05:26:35.255544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.725 [2024-11-26 05:26:35.255556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.725 [2024-11-26 05:26:35.255598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.725 qpair failed and we were unable to recover it. 00:30:33.725 [2024-11-26 05:26:35.265373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.725 [2024-11-26 05:26:35.265473] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.725 [2024-11-26 05:26:35.265497] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.725 [2024-11-26 05:26:35.265511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.725 [2024-11-26 05:26:35.265524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.725 [2024-11-26 05:26:35.265552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.725 qpair failed and we were unable to recover it. 00:30:33.725 [2024-11-26 05:26:35.275416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.725 [2024-11-26 05:26:35.275565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.725 [2024-11-26 05:26:35.275591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.725 [2024-11-26 05:26:35.275606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.725 [2024-11-26 05:26:35.275619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.725 [2024-11-26 05:26:35.275647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.725 qpair failed and we were unable to recover it. 00:30:33.725 [2024-11-26 05:26:35.285459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.725 [2024-11-26 05:26:35.285572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.725 [2024-11-26 05:26:35.285597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.725 [2024-11-26 05:26:35.285611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.725 [2024-11-26 05:26:35.285624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.725 [2024-11-26 05:26:35.285653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.725 qpair failed and we were unable to recover it. 00:30:33.725 [2024-11-26 05:26:35.295466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.725 [2024-11-26 05:26:35.295566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.725 [2024-11-26 05:26:35.295590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.725 [2024-11-26 05:26:35.295604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.725 [2024-11-26 05:26:35.295617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.725 [2024-11-26 05:26:35.295647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.725 qpair failed and we were unable to recover it. 00:30:33.725 [2024-11-26 05:26:35.305523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.725 [2024-11-26 05:26:35.305624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.725 [2024-11-26 05:26:35.305648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.725 [2024-11-26 05:26:35.305663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.725 [2024-11-26 05:26:35.305676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.726 [2024-11-26 05:26:35.305710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.315560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.726 [2024-11-26 05:26:35.315672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.726 [2024-11-26 05:26:35.315703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.726 [2024-11-26 05:26:35.315718] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.726 [2024-11-26 05:26:35.315731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.726 [2024-11-26 05:26:35.315760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.325553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.726 [2024-11-26 05:26:35.325655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.726 [2024-11-26 05:26:35.325680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.726 [2024-11-26 05:26:35.325707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.726 [2024-11-26 05:26:35.325721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.726 [2024-11-26 05:26:35.325750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.335600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.726 [2024-11-26 05:26:35.335710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.726 [2024-11-26 05:26:35.335735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.726 [2024-11-26 05:26:35.335749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.726 [2024-11-26 05:26:35.335761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.726 [2024-11-26 05:26:35.335790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.345625] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.726 [2024-11-26 05:26:35.345733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.726 [2024-11-26 05:26:35.345758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.726 [2024-11-26 05:26:35.345772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.726 [2024-11-26 05:26:35.345784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.726 [2024-11-26 05:26:35.345813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.355646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.726 [2024-11-26 05:26:35.355757] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.726 [2024-11-26 05:26:35.355782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.726 [2024-11-26 05:26:35.355796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.726 [2024-11-26 05:26:35.355809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.726 [2024-11-26 05:26:35.355837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.365719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.726 [2024-11-26 05:26:35.365825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.726 [2024-11-26 05:26:35.365849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.726 [2024-11-26 05:26:35.365864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.726 [2024-11-26 05:26:35.365877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1402f20 00:30:33.726 [2024-11-26 05:26:35.365906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.375724] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.726 [2024-11-26 05:26:35.375824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.726 [2024-11-26 05:26:35.375856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.726 [2024-11-26 05:26:35.375871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.726 [2024-11-26 05:26:35.375884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.726 [2024-11-26 05:26:35.375915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.385783] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.726 [2024-11-26 05:26:35.385892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.726 [2024-11-26 05:26:35.385918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.726 [2024-11-26 05:26:35.385932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.726 [2024-11-26 05:26:35.385945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.726 [2024-11-26 05:26:35.385975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.395901] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.726 [2024-11-26 05:26:35.396010] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.726 [2024-11-26 05:26:35.396035] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.726 [2024-11-26 05:26:35.396049] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.726 [2024-11-26 05:26:35.396062] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.726 [2024-11-26 05:26:35.396092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.405808] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.726 [2024-11-26 05:26:35.405915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.726 [2024-11-26 05:26:35.405940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.726 [2024-11-26 05:26:35.405954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.726 [2024-11-26 05:26:35.405967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.726 [2024-11-26 05:26:35.405996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.415818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.726 [2024-11-26 05:26:35.415916] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.726 [2024-11-26 05:26:35.415941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.726 [2024-11-26 05:26:35.415961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.726 [2024-11-26 05:26:35.415974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.726 [2024-11-26 05:26:35.416003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.425857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.726 [2024-11-26 05:26:35.425952] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.726 [2024-11-26 05:26:35.425978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.726 [2024-11-26 05:26:35.425993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.726 [2024-11-26 05:26:35.426005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.726 [2024-11-26 05:26:35.426048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.435902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.726 [2024-11-26 05:26:35.436009] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.726 [2024-11-26 05:26:35.436035] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.726 [2024-11-26 05:26:35.436049] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.726 [2024-11-26 05:26:35.436062] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.726 [2024-11-26 05:26:35.436091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.726 qpair failed and we were unable to recover it. 00:30:33.726 [2024-11-26 05:26:35.445921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.727 [2024-11-26 05:26:35.446054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.727 [2024-11-26 05:26:35.446080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.727 [2024-11-26 05:26:35.446095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.727 [2024-11-26 05:26:35.446109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.727 [2024-11-26 05:26:35.446139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.727 qpair failed and we were unable to recover it. 00:30:33.727 [2024-11-26 05:26:35.455939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.727 [2024-11-26 05:26:35.456079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.727 [2024-11-26 05:26:35.456105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.727 [2024-11-26 05:26:35.456120] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.727 [2024-11-26 05:26:35.456134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.727 [2024-11-26 05:26:35.456163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.727 qpair failed and we were unable to recover it. 00:30:33.727 [2024-11-26 05:26:35.465971] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.727 [2024-11-26 05:26:35.466081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.727 [2024-11-26 05:26:35.466108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.727 [2024-11-26 05:26:35.466123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.727 [2024-11-26 05:26:35.466136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.727 [2024-11-26 05:26:35.466166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.727 qpair failed and we were unable to recover it. 00:30:33.727 [2024-11-26 05:26:35.476061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.727 [2024-11-26 05:26:35.476163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.727 [2024-11-26 05:26:35.476189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.727 [2024-11-26 05:26:35.476204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.727 [2024-11-26 05:26:35.476216] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.727 [2024-11-26 05:26:35.476245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.727 qpair failed and we were unable to recover it. 00:30:33.727 [2024-11-26 05:26:35.486018] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.727 [2024-11-26 05:26:35.486153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.727 [2024-11-26 05:26:35.486179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.727 [2024-11-26 05:26:35.486194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.727 [2024-11-26 05:26:35.486207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.727 [2024-11-26 05:26:35.486240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.727 qpair failed and we were unable to recover it. 00:30:33.986 [2024-11-26 05:26:35.496066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.986 [2024-11-26 05:26:35.496166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.986 [2024-11-26 05:26:35.496193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.986 [2024-11-26 05:26:35.496208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.986 [2024-11-26 05:26:35.496220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.986 [2024-11-26 05:26:35.496251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.986 qpair failed and we were unable to recover it. 00:30:33.986 [2024-11-26 05:26:35.506095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.986 [2024-11-26 05:26:35.506198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.986 [2024-11-26 05:26:35.506225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.986 [2024-11-26 05:26:35.506246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.986 [2024-11-26 05:26:35.506261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.986 [2024-11-26 05:26:35.506292] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.986 qpair failed and we were unable to recover it. 00:30:33.986 [2024-11-26 05:26:35.516183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.986 [2024-11-26 05:26:35.516297] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.986 [2024-11-26 05:26:35.516324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.986 [2024-11-26 05:26:35.516339] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.986 [2024-11-26 05:26:35.516352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.986 [2024-11-26 05:26:35.516383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.986 qpair failed and we were unable to recover it. 00:30:33.986 [2024-11-26 05:26:35.526174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.986 [2024-11-26 05:26:35.526276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.986 [2024-11-26 05:26:35.526303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.986 [2024-11-26 05:26:35.526317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.986 [2024-11-26 05:26:35.526330] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.986 [2024-11-26 05:26:35.526361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.986 qpair failed and we were unable to recover it. 00:30:33.986 [2024-11-26 05:26:35.536171] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.986 [2024-11-26 05:26:35.536270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.986 [2024-11-26 05:26:35.536296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.986 [2024-11-26 05:26:35.536310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.986 [2024-11-26 05:26:35.536323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.986 [2024-11-26 05:26:35.536354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.987 qpair failed and we were unable to recover it. 00:30:33.987 [2024-11-26 05:26:35.546204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.987 [2024-11-26 05:26:35.546308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.987 [2024-11-26 05:26:35.546334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.987 [2024-11-26 05:26:35.546348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.987 [2024-11-26 05:26:35.546361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.987 [2024-11-26 05:26:35.546392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.987 qpair failed and we were unable to recover it. 00:30:33.987 [2024-11-26 05:26:35.556241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.987 [2024-11-26 05:26:35.556342] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.987 [2024-11-26 05:26:35.556368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.987 [2024-11-26 05:26:35.556383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.987 [2024-11-26 05:26:35.556396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.987 [2024-11-26 05:26:35.556426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.987 qpair failed and we were unable to recover it. 00:30:33.987 [2024-11-26 05:26:35.566286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.987 [2024-11-26 05:26:35.566395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.987 [2024-11-26 05:26:35.566421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.987 [2024-11-26 05:26:35.566435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.987 [2024-11-26 05:26:35.566448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.987 [2024-11-26 05:26:35.566479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.987 qpair failed and we were unable to recover it. 00:30:33.987 [2024-11-26 05:26:35.576295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.987 [2024-11-26 05:26:35.576395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.987 [2024-11-26 05:26:35.576421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.987 [2024-11-26 05:26:35.576436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.987 [2024-11-26 05:26:35.576449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.987 [2024-11-26 05:26:35.576479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.987 qpair failed and we were unable to recover it. 00:30:33.987 [2024-11-26 05:26:35.586335] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.987 [2024-11-26 05:26:35.586439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.987 [2024-11-26 05:26:35.586465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.987 [2024-11-26 05:26:35.586479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.987 [2024-11-26 05:26:35.586492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.987 [2024-11-26 05:26:35.586523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.987 qpair failed and we were unable to recover it. 00:30:33.987 [2024-11-26 05:26:35.596375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.987 [2024-11-26 05:26:35.596497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.987 [2024-11-26 05:26:35.596535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.987 [2024-11-26 05:26:35.596552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.987 [2024-11-26 05:26:35.596566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.987 [2024-11-26 05:26:35.596611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.987 qpair failed and we were unable to recover it. 00:30:33.987 [2024-11-26 05:26:35.606378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.987 [2024-11-26 05:26:35.606486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.987 [2024-11-26 05:26:35.606513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.987 [2024-11-26 05:26:35.606528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.987 [2024-11-26 05:26:35.606541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.987 [2024-11-26 05:26:35.606572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.987 qpair failed and we were unable to recover it. 00:30:33.987 [2024-11-26 05:26:35.616552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.987 [2024-11-26 05:26:35.616679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.987 [2024-11-26 05:26:35.616718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.987 [2024-11-26 05:26:35.616733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.987 [2024-11-26 05:26:35.616747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.987 [2024-11-26 05:26:35.616777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.987 qpair failed and we were unable to recover it. 00:30:33.987 [2024-11-26 05:26:35.626440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.987 [2024-11-26 05:26:35.626558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.987 [2024-11-26 05:26:35.626585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.987 [2024-11-26 05:26:35.626599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.987 [2024-11-26 05:26:35.626612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.987 [2024-11-26 05:26:35.626655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.987 qpair failed and we were unable to recover it. 00:30:33.987 [2024-11-26 05:26:35.636472] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.987 [2024-11-26 05:26:35.636571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.987 [2024-11-26 05:26:35.636597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.987 [2024-11-26 05:26:35.636612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.987 [2024-11-26 05:26:35.636626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.987 [2024-11-26 05:26:35.636663] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.987 qpair failed and we were unable to recover it. 00:30:33.987 [2024-11-26 05:26:35.646525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.987 [2024-11-26 05:26:35.646644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.987 [2024-11-26 05:26:35.646669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.987 [2024-11-26 05:26:35.646684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.987 [2024-11-26 05:26:35.646712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.987 [2024-11-26 05:26:35.646743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.987 qpair failed and we were unable to recover it. 00:30:33.987 [2024-11-26 05:26:35.656511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.987 [2024-11-26 05:26:35.656606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.987 [2024-11-26 05:26:35.656633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.987 [2024-11-26 05:26:35.656648] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.987 [2024-11-26 05:26:35.656661] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.987 [2024-11-26 05:26:35.656701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.987 qpair failed and we were unable to recover it. 00:30:33.987 [2024-11-26 05:26:35.666568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.988 [2024-11-26 05:26:35.666671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.988 [2024-11-26 05:26:35.666705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.988 [2024-11-26 05:26:35.666722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.988 [2024-11-26 05:26:35.666735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.988 [2024-11-26 05:26:35.666766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.988 qpair failed and we were unable to recover it. 00:30:33.988 [2024-11-26 05:26:35.676578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.988 [2024-11-26 05:26:35.676683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.988 [2024-11-26 05:26:35.676719] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.988 [2024-11-26 05:26:35.676734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.988 [2024-11-26 05:26:35.676747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.988 [2024-11-26 05:26:35.676779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.988 qpair failed and we were unable to recover it. 00:30:33.988 [2024-11-26 05:26:35.686598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.988 [2024-11-26 05:26:35.686706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.988 [2024-11-26 05:26:35.686738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.988 [2024-11-26 05:26:35.686754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.988 [2024-11-26 05:26:35.686767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.988 [2024-11-26 05:26:35.686798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.988 qpair failed and we were unable to recover it. 00:30:33.988 [2024-11-26 05:26:35.696671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.988 [2024-11-26 05:26:35.696782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.988 [2024-11-26 05:26:35.696809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.988 [2024-11-26 05:26:35.696824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.988 [2024-11-26 05:26:35.696837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.988 [2024-11-26 05:26:35.696868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.988 qpair failed and we were unable to recover it. 00:30:33.988 [2024-11-26 05:26:35.706696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.988 [2024-11-26 05:26:35.706799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.988 [2024-11-26 05:26:35.706825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.988 [2024-11-26 05:26:35.706840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.988 [2024-11-26 05:26:35.706853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.988 [2024-11-26 05:26:35.706884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.988 qpair failed and we were unable to recover it. 00:30:33.988 [2024-11-26 05:26:35.716700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.988 [2024-11-26 05:26:35.716807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.988 [2024-11-26 05:26:35.716833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.988 [2024-11-26 05:26:35.716848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.988 [2024-11-26 05:26:35.716861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.988 [2024-11-26 05:26:35.716892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.988 qpair failed and we were unable to recover it. 00:30:33.988 [2024-11-26 05:26:35.726785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.988 [2024-11-26 05:26:35.726888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.988 [2024-11-26 05:26:35.726915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.988 [2024-11-26 05:26:35.726930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.988 [2024-11-26 05:26:35.726950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.988 [2024-11-26 05:26:35.726981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.988 qpair failed and we were unable to recover it. 00:30:33.988 [2024-11-26 05:26:35.736765] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.988 [2024-11-26 05:26:35.736892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.988 [2024-11-26 05:26:35.736919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.988 [2024-11-26 05:26:35.736934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.988 [2024-11-26 05:26:35.736946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.988 [2024-11-26 05:26:35.736991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.988 qpair failed and we were unable to recover it. 00:30:33.988 [2024-11-26 05:26:35.746813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.988 [2024-11-26 05:26:35.746918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.988 [2024-11-26 05:26:35.746944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.988 [2024-11-26 05:26:35.746959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.988 [2024-11-26 05:26:35.746972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:33.988 [2024-11-26 05:26:35.747003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.988 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-26 05:26:35.756834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.249 [2024-11-26 05:26:35.756942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.249 [2024-11-26 05:26:35.756969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.249 [2024-11-26 05:26:35.756984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.249 [2024-11-26 05:26:35.756997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.249 [2024-11-26 05:26:35.757028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-26 05:26:35.766859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.249 [2024-11-26 05:26:35.766994] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.249 [2024-11-26 05:26:35.767023] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.249 [2024-11-26 05:26:35.767038] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.249 [2024-11-26 05:26:35.767051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.249 [2024-11-26 05:26:35.767082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-26 05:26:35.776884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.249 [2024-11-26 05:26:35.776989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.249 [2024-11-26 05:26:35.777016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.249 [2024-11-26 05:26:35.777031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.249 [2024-11-26 05:26:35.777044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.249 [2024-11-26 05:26:35.777074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-26 05:26:35.786889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.249 [2024-11-26 05:26:35.786985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.249 [2024-11-26 05:26:35.787011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.249 [2024-11-26 05:26:35.787026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.249 [2024-11-26 05:26:35.787039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.249 [2024-11-26 05:26:35.787069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-26 05:26:35.796957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.249 [2024-11-26 05:26:35.797073] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.249 [2024-11-26 05:26:35.797100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.249 [2024-11-26 05:26:35.797114] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.249 [2024-11-26 05:26:35.797127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.249 [2024-11-26 05:26:35.797158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-26 05:26:35.806988] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.249 [2024-11-26 05:26:35.807093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.249 [2024-11-26 05:26:35.807120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.249 [2024-11-26 05:26:35.807134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.249 [2024-11-26 05:26:35.807147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.249 [2024-11-26 05:26:35.807178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-26 05:26:35.816968] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.249 [2024-11-26 05:26:35.817080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.249 [2024-11-26 05:26:35.817106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.249 [2024-11-26 05:26:35.817121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.249 [2024-11-26 05:26:35.817141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.249 [2024-11-26 05:26:35.817171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-26 05:26:35.827018] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.249 [2024-11-26 05:26:35.827125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.249 [2024-11-26 05:26:35.827152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.249 [2024-11-26 05:26:35.827166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.249 [2024-11-26 05:26:35.827180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.249 [2024-11-26 05:26:35.827211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-26 05:26:35.837063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.249 [2024-11-26 05:26:35.837164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.249 [2024-11-26 05:26:35.837190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.249 [2024-11-26 05:26:35.837205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.249 [2024-11-26 05:26:35.837217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.249 [2024-11-26 05:26:35.837248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-26 05:26:35.847066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.249 [2024-11-26 05:26:35.847168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.249 [2024-11-26 05:26:35.847194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.249 [2024-11-26 05:26:35.847209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.249 [2024-11-26 05:26:35.847221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.249 [2024-11-26 05:26:35.847252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-26 05:26:35.857141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.250 [2024-11-26 05:26:35.857244] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.250 [2024-11-26 05:26:35.857270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.250 [2024-11-26 05:26:35.857285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.250 [2024-11-26 05:26:35.857297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.250 [2024-11-26 05:26:35.857328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-26 05:26:35.867204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.250 [2024-11-26 05:26:35.867304] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.250 [2024-11-26 05:26:35.867330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.250 [2024-11-26 05:26:35.867345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.250 [2024-11-26 05:26:35.867357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.250 [2024-11-26 05:26:35.867388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-26 05:26:35.877189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.250 [2024-11-26 05:26:35.877293] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.250 [2024-11-26 05:26:35.877319] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.250 [2024-11-26 05:26:35.877333] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.250 [2024-11-26 05:26:35.877347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.250 [2024-11-26 05:26:35.877377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-26 05:26:35.887266] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.250 [2024-11-26 05:26:35.887372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.250 [2024-11-26 05:26:35.887397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.250 [2024-11-26 05:26:35.887412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.250 [2024-11-26 05:26:35.887424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.250 [2024-11-26 05:26:35.887455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-26 05:26:35.897229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.250 [2024-11-26 05:26:35.897323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.250 [2024-11-26 05:26:35.897350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.250 [2024-11-26 05:26:35.897364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.250 [2024-11-26 05:26:35.897377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.250 [2024-11-26 05:26:35.897407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-26 05:26:35.907262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.250 [2024-11-26 05:26:35.907369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.250 [2024-11-26 05:26:35.907394] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.250 [2024-11-26 05:26:35.907415] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.250 [2024-11-26 05:26:35.907430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.250 [2024-11-26 05:26:35.907460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-26 05:26:35.917294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.250 [2024-11-26 05:26:35.917428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.250 [2024-11-26 05:26:35.917454] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.250 [2024-11-26 05:26:35.917468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.250 [2024-11-26 05:26:35.917481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.250 [2024-11-26 05:26:35.917510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-26 05:26:35.927359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.250 [2024-11-26 05:26:35.927475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.250 [2024-11-26 05:26:35.927502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.250 [2024-11-26 05:26:35.927516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.250 [2024-11-26 05:26:35.927529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.250 [2024-11-26 05:26:35.927559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-26 05:26:35.937333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.250 [2024-11-26 05:26:35.937438] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.250 [2024-11-26 05:26:35.937464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.250 [2024-11-26 05:26:35.937479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.250 [2024-11-26 05:26:35.937491] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.250 [2024-11-26 05:26:35.937522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-26 05:26:35.947405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.250 [2024-11-26 05:26:35.947542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.250 [2024-11-26 05:26:35.947568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.250 [2024-11-26 05:26:35.947582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.250 [2024-11-26 05:26:35.947595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.250 [2024-11-26 05:26:35.947626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-26 05:26:35.957468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.250 [2024-11-26 05:26:35.957623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.250 [2024-11-26 05:26:35.957652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.250 [2024-11-26 05:26:35.957668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.250 [2024-11-26 05:26:35.957680] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.250 [2024-11-26 05:26:35.957720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-26 05:26:35.967465] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.250 [2024-11-26 05:26:35.967582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.250 [2024-11-26 05:26:35.967611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.250 [2024-11-26 05:26:35.967627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.250 [2024-11-26 05:26:35.967641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.250 [2024-11-26 05:26:35.967673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-26 05:26:35.977543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.250 [2024-11-26 05:26:35.977646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.250 [2024-11-26 05:26:35.977672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.250 [2024-11-26 05:26:35.977693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.251 [2024-11-26 05:26:35.977708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.251 [2024-11-26 05:26:35.977737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-26 05:26:35.987494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.251 [2024-11-26 05:26:35.987640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.251 [2024-11-26 05:26:35.987668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.251 [2024-11-26 05:26:35.987695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.251 [2024-11-26 05:26:35.987712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.251 [2024-11-26 05:26:35.987757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-26 05:26:35.997550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.251 [2024-11-26 05:26:35.997657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.251 [2024-11-26 05:26:35.997683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.251 [2024-11-26 05:26:35.997715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.251 [2024-11-26 05:26:35.997729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.251 [2024-11-26 05:26:35.997761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-26 05:26:36.007561] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.251 [2024-11-26 05:26:36.007668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.251 [2024-11-26 05:26:36.007702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.251 [2024-11-26 05:26:36.007718] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.251 [2024-11-26 05:26:36.007731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.251 [2024-11-26 05:26:36.007760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.510 [2024-11-26 05:26:36.017609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.510 [2024-11-26 05:26:36.017739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.510 [2024-11-26 05:26:36.017767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.510 [2024-11-26 05:26:36.017783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.510 [2024-11-26 05:26:36.017797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.510 [2024-11-26 05:26:36.017827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.510 qpair failed and we were unable to recover it. 00:30:34.510 [2024-11-26 05:26:36.027611] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.510 [2024-11-26 05:26:36.027716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.510 [2024-11-26 05:26:36.027743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.510 [2024-11-26 05:26:36.027758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.510 [2024-11-26 05:26:36.027772] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.510 [2024-11-26 05:26:36.027802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.510 qpair failed and we were unable to recover it. 00:30:34.510 [2024-11-26 05:26:36.037662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.510 [2024-11-26 05:26:36.037792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.510 [2024-11-26 05:26:36.037822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.510 [2024-11-26 05:26:36.037845] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.510 [2024-11-26 05:26:36.037861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.510 [2024-11-26 05:26:36.037894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.510 qpair failed and we were unable to recover it. 00:30:34.510 [2024-11-26 05:26:36.047738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.510 [2024-11-26 05:26:36.047890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.510 [2024-11-26 05:26:36.047917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.510 [2024-11-26 05:26:36.047931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.510 [2024-11-26 05:26:36.047945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.047990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.057726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.511 [2024-11-26 05:26:36.057836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.511 [2024-11-26 05:26:36.057862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.511 [2024-11-26 05:26:36.057876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.511 [2024-11-26 05:26:36.057890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.057920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.067768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.511 [2024-11-26 05:26:36.067911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.511 [2024-11-26 05:26:36.067936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.511 [2024-11-26 05:26:36.067951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.511 [2024-11-26 05:26:36.067965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.067995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.077790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.511 [2024-11-26 05:26:36.077898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.511 [2024-11-26 05:26:36.077925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.511 [2024-11-26 05:26:36.077939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.511 [2024-11-26 05:26:36.077953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.077984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.087771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.511 [2024-11-26 05:26:36.087880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.511 [2024-11-26 05:26:36.087911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.511 [2024-11-26 05:26:36.087927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.511 [2024-11-26 05:26:36.087941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.087972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.097813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.511 [2024-11-26 05:26:36.097910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.511 [2024-11-26 05:26:36.097937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.511 [2024-11-26 05:26:36.097952] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.511 [2024-11-26 05:26:36.097966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.097996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.107869] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.511 [2024-11-26 05:26:36.107977] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.511 [2024-11-26 05:26:36.108002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.511 [2024-11-26 05:26:36.108017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.511 [2024-11-26 05:26:36.108031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.108061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.117942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.511 [2024-11-26 05:26:36.118052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.511 [2024-11-26 05:26:36.118077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.511 [2024-11-26 05:26:36.118091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.511 [2024-11-26 05:26:36.118103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.118133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.127888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.511 [2024-11-26 05:26:36.127996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.511 [2024-11-26 05:26:36.128023] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.511 [2024-11-26 05:26:36.128037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.511 [2024-11-26 05:26:36.128051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.128088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.137979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.511 [2024-11-26 05:26:36.138100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.511 [2024-11-26 05:26:36.138130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.511 [2024-11-26 05:26:36.138145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.511 [2024-11-26 05:26:36.138174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.138214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.148079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.511 [2024-11-26 05:26:36.148193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.511 [2024-11-26 05:26:36.148221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.511 [2024-11-26 05:26:36.148239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.511 [2024-11-26 05:26:36.148253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.148284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.158035] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.511 [2024-11-26 05:26:36.158138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.511 [2024-11-26 05:26:36.158164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.511 [2024-11-26 05:26:36.158179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.511 [2024-11-26 05:26:36.158193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.158222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.168087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.511 [2024-11-26 05:26:36.168203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.511 [2024-11-26 05:26:36.168228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.511 [2024-11-26 05:26:36.168243] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.511 [2024-11-26 05:26:36.168257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.168287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.178154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.511 [2024-11-26 05:26:36.178268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.511 [2024-11-26 05:26:36.178300] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.511 [2024-11-26 05:26:36.178315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.511 [2024-11-26 05:26:36.178329] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.511 [2024-11-26 05:26:36.178373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.511 qpair failed and we were unable to recover it. 00:30:34.511 [2024-11-26 05:26:36.188089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.512 [2024-11-26 05:26:36.188221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.512 [2024-11-26 05:26:36.188246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.512 [2024-11-26 05:26:36.188260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.512 [2024-11-26 05:26:36.188273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.512 [2024-11-26 05:26:36.188304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.512 qpair failed and we were unable to recover it. 00:30:34.512 [2024-11-26 05:26:36.198112] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.512 [2024-11-26 05:26:36.198218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.512 [2024-11-26 05:26:36.198245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.512 [2024-11-26 05:26:36.198259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.512 [2024-11-26 05:26:36.198272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.512 [2024-11-26 05:26:36.198303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.512 qpair failed and we were unable to recover it. 00:30:34.512 [2024-11-26 05:26:36.208156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.512 [2024-11-26 05:26:36.208277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.512 [2024-11-26 05:26:36.208305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.512 [2024-11-26 05:26:36.208321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.512 [2024-11-26 05:26:36.208334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.512 [2024-11-26 05:26:36.208364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.512 qpair failed and we were unable to recover it. 00:30:34.512 [2024-11-26 05:26:36.218269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.512 [2024-11-26 05:26:36.218417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.512 [2024-11-26 05:26:36.218442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.512 [2024-11-26 05:26:36.218457] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.512 [2024-11-26 05:26:36.218470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.512 [2024-11-26 05:26:36.218506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.512 qpair failed and we were unable to recover it. 00:30:34.512 [2024-11-26 05:26:36.228221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.512 [2024-11-26 05:26:36.228352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.512 [2024-11-26 05:26:36.228377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.512 [2024-11-26 05:26:36.228392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.512 [2024-11-26 05:26:36.228406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.512 [2024-11-26 05:26:36.228435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.512 qpair failed and we were unable to recover it. 00:30:34.512 [2024-11-26 05:26:36.238280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.512 [2024-11-26 05:26:36.238390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.512 [2024-11-26 05:26:36.238416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.512 [2024-11-26 05:26:36.238431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.512 [2024-11-26 05:26:36.238444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.512 [2024-11-26 05:26:36.238486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.512 qpair failed and we were unable to recover it. 00:30:34.512 [2024-11-26 05:26:36.248248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.512 [2024-11-26 05:26:36.248360] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.512 [2024-11-26 05:26:36.248386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.512 [2024-11-26 05:26:36.248401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.512 [2024-11-26 05:26:36.248414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.512 [2024-11-26 05:26:36.248444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.512 qpair failed and we were unable to recover it. 00:30:34.512 [2024-11-26 05:26:36.258298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.512 [2024-11-26 05:26:36.258465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.512 [2024-11-26 05:26:36.258493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.512 [2024-11-26 05:26:36.258508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.512 [2024-11-26 05:26:36.258526] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.512 [2024-11-26 05:26:36.258572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.512 qpair failed and we were unable to recover it. 00:30:34.512 [2024-11-26 05:26:36.268363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.512 [2024-11-26 05:26:36.268488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.512 [2024-11-26 05:26:36.268515] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.512 [2024-11-26 05:26:36.268530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.512 [2024-11-26 05:26:36.268544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.512 [2024-11-26 05:26:36.268574] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.512 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.278415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.278522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.278549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.278564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.278577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.278611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.288378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.288488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.288514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.288529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.288543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.288585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.298400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.298508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.298534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.298549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.298563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.298592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.308463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.308586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.308612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.308627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.308646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.308679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.318537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.318658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.318694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.318712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.318725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.318756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.328485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.328594] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.328620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.328635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.328649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.328708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.338527] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.338646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.338683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.338707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.338721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.338751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.348565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.348678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.348713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.348728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.348742] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.348774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.358563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.358702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.358728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.358742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.358757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.358788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.368644] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.368804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.368830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.368846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.368859] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.368889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.378634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.378805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.378831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.378846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.378860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.378890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.388781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.388920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.388946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.388961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.388974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.389003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.398714] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.398828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.398857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.398891] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.398907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.398937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.408749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.408904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.408930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.408944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.408957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.409011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.418729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.418857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.418882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.418897] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.418909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.418939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.428793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.428917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.774 [2024-11-26 05:26:36.428943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.774 [2024-11-26 05:26:36.428958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.774 [2024-11-26 05:26:36.428971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.774 [2024-11-26 05:26:36.428999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.774 qpair failed and we were unable to recover it. 00:30:34.774 [2024-11-26 05:26:36.438937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.774 [2024-11-26 05:26:36.439046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.775 [2024-11-26 05:26:36.439071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.775 [2024-11-26 05:26:36.439085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.775 [2024-11-26 05:26:36.439097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.775 [2024-11-26 05:26:36.439126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.775 qpair failed and we were unable to recover it. 00:30:34.775 [2024-11-26 05:26:36.448893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.775 [2024-11-26 05:26:36.449000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.775 [2024-11-26 05:26:36.449025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.775 [2024-11-26 05:26:36.449039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.775 [2024-11-26 05:26:36.449052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.775 [2024-11-26 05:26:36.449081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.775 qpair failed and we were unable to recover it. 00:30:34.775 [2024-11-26 05:26:36.458859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.775 [2024-11-26 05:26:36.458952] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.775 [2024-11-26 05:26:36.458977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.775 [2024-11-26 05:26:36.458991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.775 [2024-11-26 05:26:36.459004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.775 [2024-11-26 05:26:36.459033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.775 qpair failed and we were unable to recover it. 00:30:34.775 [2024-11-26 05:26:36.468935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.775 [2024-11-26 05:26:36.469050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.775 [2024-11-26 05:26:36.469074] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.775 [2024-11-26 05:26:36.469089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.775 [2024-11-26 05:26:36.469106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.775 [2024-11-26 05:26:36.469137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.775 qpair failed and we were unable to recover it. 00:30:34.775 [2024-11-26 05:26:36.478975] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.775 [2024-11-26 05:26:36.479086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.775 [2024-11-26 05:26:36.479110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.775 [2024-11-26 05:26:36.479124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.775 [2024-11-26 05:26:36.479137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.775 [2024-11-26 05:26:36.479166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.775 qpair failed and we were unable to recover it. 00:30:34.775 [2024-11-26 05:26:36.488946] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.775 [2024-11-26 05:26:36.489048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.775 [2024-11-26 05:26:36.489073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.775 [2024-11-26 05:26:36.489093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.775 [2024-11-26 05:26:36.489107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.775 [2024-11-26 05:26:36.489138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.775 qpair failed and we were unable to recover it. 00:30:34.775 [2024-11-26 05:26:36.498994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.775 [2024-11-26 05:26:36.499120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.775 [2024-11-26 05:26:36.499147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.775 [2024-11-26 05:26:36.499161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.775 [2024-11-26 05:26:36.499174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.775 [2024-11-26 05:26:36.499203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.775 qpair failed and we were unable to recover it. 00:30:34.775 [2024-11-26 05:26:36.509009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.775 [2024-11-26 05:26:36.509132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.775 [2024-11-26 05:26:36.509159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.775 [2024-11-26 05:26:36.509173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.775 [2024-11-26 05:26:36.509186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.775 [2024-11-26 05:26:36.509215] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.775 qpair failed and we were unable to recover it. 00:30:34.775 [2024-11-26 05:26:36.519027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.775 [2024-11-26 05:26:36.519132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.775 [2024-11-26 05:26:36.519156] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.775 [2024-11-26 05:26:36.519170] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.775 [2024-11-26 05:26:36.519182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.775 [2024-11-26 05:26:36.519212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.775 qpair failed and we were unable to recover it. 00:30:34.775 [2024-11-26 05:26:36.529186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.775 [2024-11-26 05:26:36.529292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.775 [2024-11-26 05:26:36.529316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.775 [2024-11-26 05:26:36.529330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.775 [2024-11-26 05:26:36.529343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:34.775 [2024-11-26 05:26:36.529373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.775 qpair failed and we were unable to recover it. 00:30:35.036 [2024-11-26 05:26:36.539129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.036 [2024-11-26 05:26:36.539229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.036 [2024-11-26 05:26:36.539258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.036 [2024-11-26 05:26:36.539273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.036 [2024-11-26 05:26:36.539287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.036 [2024-11-26 05:26:36.539330] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.036 qpair failed and we were unable to recover it. 00:30:35.036 [2024-11-26 05:26:36.549149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.036 [2024-11-26 05:26:36.549304] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.036 [2024-11-26 05:26:36.549335] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.036 [2024-11-26 05:26:36.549351] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.036 [2024-11-26 05:26:36.549365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.036 [2024-11-26 05:26:36.549395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.036 qpair failed and we were unable to recover it. 00:30:35.036 [2024-11-26 05:26:36.559164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.036 [2024-11-26 05:26:36.559287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.036 [2024-11-26 05:26:36.559312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.036 [2024-11-26 05:26:36.559327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.036 [2024-11-26 05:26:36.559341] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.036 [2024-11-26 05:26:36.559371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.036 qpair failed and we were unable to recover it. 00:30:35.036 [2024-11-26 05:26:36.569161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.036 [2024-11-26 05:26:36.569260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.036 [2024-11-26 05:26:36.569284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.036 [2024-11-26 05:26:36.569298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.036 [2024-11-26 05:26:36.569311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.036 [2024-11-26 05:26:36.569342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.036 qpair failed and we were unable to recover it. 00:30:35.036 [2024-11-26 05:26:36.579222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.036 [2024-11-26 05:26:36.579321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.036 [2024-11-26 05:26:36.579351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.036 [2024-11-26 05:26:36.579367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.036 [2024-11-26 05:26:36.579380] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.036 [2024-11-26 05:26:36.579411] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.036 qpair failed and we were unable to recover it. 00:30:35.036 [2024-11-26 05:26:36.589286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.036 [2024-11-26 05:26:36.589380] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.036 [2024-11-26 05:26:36.589404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.036 [2024-11-26 05:26:36.589418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.036 [2024-11-26 05:26:36.589431] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.036 [2024-11-26 05:26:36.589461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.036 qpair failed and we were unable to recover it. 00:30:35.036 [2024-11-26 05:26:36.599265] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.036 [2024-11-26 05:26:36.599365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.036 [2024-11-26 05:26:36.599390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.036 [2024-11-26 05:26:36.599404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.036 [2024-11-26 05:26:36.599417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.599446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.037 [2024-11-26 05:26:36.609292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.037 [2024-11-26 05:26:36.609399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.037 [2024-11-26 05:26:36.609424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.037 [2024-11-26 05:26:36.609439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.037 [2024-11-26 05:26:36.609452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.609481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.037 [2024-11-26 05:26:36.619314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.037 [2024-11-26 05:26:36.619416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.037 [2024-11-26 05:26:36.619440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.037 [2024-11-26 05:26:36.619455] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.037 [2024-11-26 05:26:36.619467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.619503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.037 [2024-11-26 05:26:36.629351] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.037 [2024-11-26 05:26:36.629449] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.037 [2024-11-26 05:26:36.629473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.037 [2024-11-26 05:26:36.629488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.037 [2024-11-26 05:26:36.629500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.629530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.037 [2024-11-26 05:26:36.639403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.037 [2024-11-26 05:26:36.639555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.037 [2024-11-26 05:26:36.639582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.037 [2024-11-26 05:26:36.639597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.037 [2024-11-26 05:26:36.639610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.639639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.037 [2024-11-26 05:26:36.649416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.037 [2024-11-26 05:26:36.649560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.037 [2024-11-26 05:26:36.649588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.037 [2024-11-26 05:26:36.649603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.037 [2024-11-26 05:26:36.649616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.649645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.037 [2024-11-26 05:26:36.659502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.037 [2024-11-26 05:26:36.659602] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.037 [2024-11-26 05:26:36.659627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.037 [2024-11-26 05:26:36.659641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.037 [2024-11-26 05:26:36.659654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.659691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.037 [2024-11-26 05:26:36.669483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.037 [2024-11-26 05:26:36.669585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.037 [2024-11-26 05:26:36.669616] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.037 [2024-11-26 05:26:36.669631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.037 [2024-11-26 05:26:36.669644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.669675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.037 [2024-11-26 05:26:36.679496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.037 [2024-11-26 05:26:36.679623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.037 [2024-11-26 05:26:36.679648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.037 [2024-11-26 05:26:36.679663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.037 [2024-11-26 05:26:36.679676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.679714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.037 [2024-11-26 05:26:36.689525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.037 [2024-11-26 05:26:36.689649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.037 [2024-11-26 05:26:36.689678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.037 [2024-11-26 05:26:36.689701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.037 [2024-11-26 05:26:36.689715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.689746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.037 [2024-11-26 05:26:36.699549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.037 [2024-11-26 05:26:36.699648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.037 [2024-11-26 05:26:36.699673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.037 [2024-11-26 05:26:36.699695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.037 [2024-11-26 05:26:36.699711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.699741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.037 [2024-11-26 05:26:36.709676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.037 [2024-11-26 05:26:36.709829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.037 [2024-11-26 05:26:36.709855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.037 [2024-11-26 05:26:36.709871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.037 [2024-11-26 05:26:36.709884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.709920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.037 [2024-11-26 05:26:36.719622] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.037 [2024-11-26 05:26:36.719737] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.037 [2024-11-26 05:26:36.719761] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.037 [2024-11-26 05:26:36.719775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.037 [2024-11-26 05:26:36.719788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.719818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.037 [2024-11-26 05:26:36.729715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.037 [2024-11-26 05:26:36.729839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.037 [2024-11-26 05:26:36.729865] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.037 [2024-11-26 05:26:36.729880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.037 [2024-11-26 05:26:36.729897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.037 [2024-11-26 05:26:36.729930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.037 qpair failed and we were unable to recover it. 00:30:35.038 [2024-11-26 05:26:36.739712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.038 [2024-11-26 05:26:36.739828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.038 [2024-11-26 05:26:36.739863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.038 [2024-11-26 05:26:36.739879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.038 [2024-11-26 05:26:36.739894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.038 [2024-11-26 05:26:36.739924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.038 qpair failed and we were unable to recover it. 00:30:35.038 [2024-11-26 05:26:36.749789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.038 [2024-11-26 05:26:36.749900] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.038 [2024-11-26 05:26:36.749929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.038 [2024-11-26 05:26:36.749947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.038 [2024-11-26 05:26:36.749961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.038 [2024-11-26 05:26:36.749993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.038 qpair failed and we were unable to recover it. 00:30:35.038 [2024-11-26 05:26:36.759793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.038 [2024-11-26 05:26:36.759911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.038 [2024-11-26 05:26:36.759942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.038 [2024-11-26 05:26:36.759957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.038 [2024-11-26 05:26:36.759970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.038 [2024-11-26 05:26:36.760001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.038 qpair failed and we were unable to recover it. 00:30:35.038 [2024-11-26 05:26:36.769860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.038 [2024-11-26 05:26:36.769962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.038 [2024-11-26 05:26:36.769987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.038 [2024-11-26 05:26:36.770001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.038 [2024-11-26 05:26:36.770014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.038 [2024-11-26 05:26:36.770044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.038 qpair failed and we were unable to recover it. 00:30:35.038 [2024-11-26 05:26:36.779798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.038 [2024-11-26 05:26:36.779894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.038 [2024-11-26 05:26:36.779919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.038 [2024-11-26 05:26:36.779933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.038 [2024-11-26 05:26:36.779945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.038 [2024-11-26 05:26:36.779975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.038 qpair failed and we were unable to recover it. 00:30:35.038 [2024-11-26 05:26:36.789844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.038 [2024-11-26 05:26:36.789981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.038 [2024-11-26 05:26:36.790007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.038 [2024-11-26 05:26:36.790021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.038 [2024-11-26 05:26:36.790035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.038 [2024-11-26 05:26:36.790064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.038 qpair failed and we were unable to recover it. 00:30:35.300 [2024-11-26 05:26:36.799931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.300 [2024-11-26 05:26:36.800039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.300 [2024-11-26 05:26:36.800066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.300 [2024-11-26 05:26:36.800081] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.300 [2024-11-26 05:26:36.800103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.300 [2024-11-26 05:26:36.800154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.300 qpair failed and we were unable to recover it. 00:30:35.300 [2024-11-26 05:26:36.809916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.300 [2024-11-26 05:26:36.810042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.300 [2024-11-26 05:26:36.810069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.300 [2024-11-26 05:26:36.810085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.300 [2024-11-26 05:26:36.810098] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.300 [2024-11-26 05:26:36.810128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.300 qpair failed and we were unable to recover it. 00:30:35.300 [2024-11-26 05:26:36.819905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.300 [2024-11-26 05:26:36.820005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.300 [2024-11-26 05:26:36.820030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.300 [2024-11-26 05:26:36.820044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.300 [2024-11-26 05:26:36.820057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.300 [2024-11-26 05:26:36.820087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.300 qpair failed and we were unable to recover it. 00:30:35.300 [2024-11-26 05:26:36.829966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.300 [2024-11-26 05:26:36.830075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.300 [2024-11-26 05:26:36.830098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.300 [2024-11-26 05:26:36.830113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.300 [2024-11-26 05:26:36.830127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.300 [2024-11-26 05:26:36.830157] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.300 qpair failed and we were unable to recover it. 00:30:35.300 [2024-11-26 05:26:36.839991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.300 [2024-11-26 05:26:36.840099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.300 [2024-11-26 05:26:36.840123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.300 [2024-11-26 05:26:36.840136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.300 [2024-11-26 05:26:36.840149] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.300 [2024-11-26 05:26:36.840179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.300 qpair failed and we were unable to recover it. 00:30:35.300 [2024-11-26 05:26:36.850038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.300 [2024-11-26 05:26:36.850155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.300 [2024-11-26 05:26:36.850179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.300 [2024-11-26 05:26:36.850194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.850207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.850236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.301 [2024-11-26 05:26:36.860079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.301 [2024-11-26 05:26:36.860204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.301 [2024-11-26 05:26:36.860230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.301 [2024-11-26 05:26:36.860245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.860257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.860287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.301 [2024-11-26 05:26:36.870088] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.301 [2024-11-26 05:26:36.870202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.301 [2024-11-26 05:26:36.870227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.301 [2024-11-26 05:26:36.870241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.870255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.870285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.301 [2024-11-26 05:26:36.880098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.301 [2024-11-26 05:26:36.880203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.301 [2024-11-26 05:26:36.880227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.301 [2024-11-26 05:26:36.880241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.880254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.880284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.301 [2024-11-26 05:26:36.890177] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.301 [2024-11-26 05:26:36.890284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.301 [2024-11-26 05:26:36.890308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.301 [2024-11-26 05:26:36.890323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.890342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.890386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.301 [2024-11-26 05:26:36.900197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.301 [2024-11-26 05:26:36.900347] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.301 [2024-11-26 05:26:36.900374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.301 [2024-11-26 05:26:36.900389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.900403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.900449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.301 [2024-11-26 05:26:36.910185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.301 [2024-11-26 05:26:36.910283] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.301 [2024-11-26 05:26:36.910308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.301 [2024-11-26 05:26:36.910322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.910334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.910365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.301 [2024-11-26 05:26:36.920232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.301 [2024-11-26 05:26:36.920336] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.301 [2024-11-26 05:26:36.920361] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.301 [2024-11-26 05:26:36.920376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.920389] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.920418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.301 [2024-11-26 05:26:36.930269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.301 [2024-11-26 05:26:36.930371] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.301 [2024-11-26 05:26:36.930395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.301 [2024-11-26 05:26:36.930411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.930424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.930454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.301 [2024-11-26 05:26:36.940331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.301 [2024-11-26 05:26:36.940436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.301 [2024-11-26 05:26:36.940464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.301 [2024-11-26 05:26:36.940480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.940493] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.940524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.301 [2024-11-26 05:26:36.950345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.301 [2024-11-26 05:26:36.950461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.301 [2024-11-26 05:26:36.950501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.301 [2024-11-26 05:26:36.950516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.950530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.950560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.301 [2024-11-26 05:26:36.960378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.301 [2024-11-26 05:26:36.960485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.301 [2024-11-26 05:26:36.960510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.301 [2024-11-26 05:26:36.960525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.960538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.960568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.301 [2024-11-26 05:26:36.970397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.301 [2024-11-26 05:26:36.970501] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.301 [2024-11-26 05:26:36.970526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.301 [2024-11-26 05:26:36.970540] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.970553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.970584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.301 [2024-11-26 05:26:36.980412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.301 [2024-11-26 05:26:36.980518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.301 [2024-11-26 05:26:36.980543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.301 [2024-11-26 05:26:36.980563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.301 [2024-11-26 05:26:36.980576] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.301 [2024-11-26 05:26:36.980605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.301 qpair failed and we were unable to recover it. 00:30:35.302 [2024-11-26 05:26:36.990457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.302 [2024-11-26 05:26:36.990559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.302 [2024-11-26 05:26:36.990583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.302 [2024-11-26 05:26:36.990597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.302 [2024-11-26 05:26:36.990610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.302 [2024-11-26 05:26:36.990639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.302 qpair failed and we were unable to recover it. 00:30:35.302 [2024-11-26 05:26:37.000500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.302 [2024-11-26 05:26:37.000607] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.302 [2024-11-26 05:26:37.000634] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.302 [2024-11-26 05:26:37.000649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.302 [2024-11-26 05:26:37.000661] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.302 [2024-11-26 05:26:37.000698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.302 qpair failed and we were unable to recover it. 00:30:35.302 [2024-11-26 05:26:37.010518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.302 [2024-11-26 05:26:37.010627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.302 [2024-11-26 05:26:37.010655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.302 [2024-11-26 05:26:37.010670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.302 [2024-11-26 05:26:37.010684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.302 [2024-11-26 05:26:37.010723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.302 qpair failed and we were unable to recover it. 00:30:35.302 [2024-11-26 05:26:37.020580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.302 [2024-11-26 05:26:37.020682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.302 [2024-11-26 05:26:37.020713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.302 [2024-11-26 05:26:37.020738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.302 [2024-11-26 05:26:37.020750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.302 [2024-11-26 05:26:37.020779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.302 qpair failed and we were unable to recover it. 00:30:35.302 [2024-11-26 05:26:37.030600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.302 [2024-11-26 05:26:37.030704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.302 [2024-11-26 05:26:37.030733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.302 [2024-11-26 05:26:37.030747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.302 [2024-11-26 05:26:37.030761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.302 [2024-11-26 05:26:37.030791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.302 qpair failed and we were unable to recover it. 00:30:35.302 [2024-11-26 05:26:37.040614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.302 [2024-11-26 05:26:37.040736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.302 [2024-11-26 05:26:37.040763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.302 [2024-11-26 05:26:37.040778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.302 [2024-11-26 05:26:37.040795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.302 [2024-11-26 05:26:37.040827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.302 qpair failed and we were unable to recover it. 00:30:35.302 [2024-11-26 05:26:37.050619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.302 [2024-11-26 05:26:37.050719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.302 [2024-11-26 05:26:37.050744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.302 [2024-11-26 05:26:37.050759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.302 [2024-11-26 05:26:37.050772] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.302 [2024-11-26 05:26:37.050801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.302 qpair failed and we were unable to recover it. 00:30:35.302 [2024-11-26 05:26:37.060650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.302 [2024-11-26 05:26:37.060755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.302 [2024-11-26 05:26:37.060781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.302 [2024-11-26 05:26:37.060796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.302 [2024-11-26 05:26:37.060809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.302 [2024-11-26 05:26:37.060844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.302 qpair failed and we were unable to recover it. 00:30:35.563 [2024-11-26 05:26:37.070702] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.563 [2024-11-26 05:26:37.070809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.070840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.564 [2024-11-26 05:26:37.070856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.564 [2024-11-26 05:26:37.070870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.564 [2024-11-26 05:26:37.070901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.564 qpair failed and we were unable to recover it. 00:30:35.564 [2024-11-26 05:26:37.080733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.564 [2024-11-26 05:26:37.080836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.080861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.564 [2024-11-26 05:26:37.080876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.564 [2024-11-26 05:26:37.080889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.564 [2024-11-26 05:26:37.080919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.564 qpair failed and we were unable to recover it. 00:30:35.564 [2024-11-26 05:26:37.090789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.564 [2024-11-26 05:26:37.090899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.090925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.564 [2024-11-26 05:26:37.090939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.564 [2024-11-26 05:26:37.090952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.564 [2024-11-26 05:26:37.090983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.564 qpair failed and we were unable to recover it. 00:30:35.564 [2024-11-26 05:26:37.100829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.564 [2024-11-26 05:26:37.100934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.100959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.564 [2024-11-26 05:26:37.100973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.564 [2024-11-26 05:26:37.100987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.564 [2024-11-26 05:26:37.101018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.564 qpair failed and we were unable to recover it. 00:30:35.564 [2024-11-26 05:26:37.110787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.564 [2024-11-26 05:26:37.110884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.110908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.564 [2024-11-26 05:26:37.110922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.564 [2024-11-26 05:26:37.110936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.564 [2024-11-26 05:26:37.110966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.564 qpair failed and we were unable to recover it. 00:30:35.564 [2024-11-26 05:26:37.120853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.564 [2024-11-26 05:26:37.120962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.120990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.564 [2024-11-26 05:26:37.121005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.564 [2024-11-26 05:26:37.121017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.564 [2024-11-26 05:26:37.121047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.564 qpair failed and we were unable to recover it. 00:30:35.564 [2024-11-26 05:26:37.130876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.564 [2024-11-26 05:26:37.130988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.131015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.564 [2024-11-26 05:26:37.131030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.564 [2024-11-26 05:26:37.131044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.564 [2024-11-26 05:26:37.131073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.564 qpair failed and we were unable to recover it. 00:30:35.564 [2024-11-26 05:26:37.140891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.564 [2024-11-26 05:26:37.141006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.141032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.564 [2024-11-26 05:26:37.141047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.564 [2024-11-26 05:26:37.141060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.564 [2024-11-26 05:26:37.141089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.564 qpair failed and we were unable to recover it. 00:30:35.564 [2024-11-26 05:26:37.150904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.564 [2024-11-26 05:26:37.151024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.151050] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.564 [2024-11-26 05:26:37.151065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.564 [2024-11-26 05:26:37.151079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.564 [2024-11-26 05:26:37.151109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.564 qpair failed and we were unable to recover it. 00:30:35.564 [2024-11-26 05:26:37.160982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.564 [2024-11-26 05:26:37.161098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.161129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.564 [2024-11-26 05:26:37.161144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.564 [2024-11-26 05:26:37.161157] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.564 [2024-11-26 05:26:37.161187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.564 qpair failed and we were unable to recover it. 00:30:35.564 [2024-11-26 05:26:37.171066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.564 [2024-11-26 05:26:37.171168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.171203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.564 [2024-11-26 05:26:37.171218] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.564 [2024-11-26 05:26:37.171230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.564 [2024-11-26 05:26:37.171260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.564 qpair failed and we were unable to recover it. 00:30:35.564 [2024-11-26 05:26:37.180999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.564 [2024-11-26 05:26:37.181110] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.181137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.564 [2024-11-26 05:26:37.181152] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.564 [2024-11-26 05:26:37.181165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.564 [2024-11-26 05:26:37.181195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.564 qpair failed and we were unable to recover it. 00:30:35.564 [2024-11-26 05:26:37.191041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.564 [2024-11-26 05:26:37.191138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.191164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.564 [2024-11-26 05:26:37.191179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.564 [2024-11-26 05:26:37.191192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.564 [2024-11-26 05:26:37.191222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.564 qpair failed and we were unable to recover it. 00:30:35.564 [2024-11-26 05:26:37.201111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.564 [2024-11-26 05:26:37.201257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.564 [2024-11-26 05:26:37.201285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.565 [2024-11-26 05:26:37.201300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.565 [2024-11-26 05:26:37.201313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.565 [2024-11-26 05:26:37.201364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.565 qpair failed and we were unable to recover it. 00:30:35.565 [2024-11-26 05:26:37.211128] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.565 [2024-11-26 05:26:37.211238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.565 [2024-11-26 05:26:37.211265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.565 [2024-11-26 05:26:37.211280] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.565 [2024-11-26 05:26:37.211293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.565 [2024-11-26 05:26:37.211322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.565 qpair failed and we were unable to recover it. 00:30:35.565 [2024-11-26 05:26:37.221131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.565 [2024-11-26 05:26:37.221253] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.565 [2024-11-26 05:26:37.221280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.565 [2024-11-26 05:26:37.221294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.565 [2024-11-26 05:26:37.221307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.565 [2024-11-26 05:26:37.221337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.565 qpair failed and we were unable to recover it. 00:30:35.565 [2024-11-26 05:26:37.231182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.565 [2024-11-26 05:26:37.231283] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.565 [2024-11-26 05:26:37.231309] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.565 [2024-11-26 05:26:37.231324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.565 [2024-11-26 05:26:37.231337] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.565 [2024-11-26 05:26:37.231366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.565 qpair failed and we were unable to recover it. 00:30:35.565 [2024-11-26 05:26:37.241194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.565 [2024-11-26 05:26:37.241306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.565 [2024-11-26 05:26:37.241331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.565 [2024-11-26 05:26:37.241346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.565 [2024-11-26 05:26:37.241359] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.565 [2024-11-26 05:26:37.241388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.565 qpair failed and we were unable to recover it. 00:30:35.565 [2024-11-26 05:26:37.251215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.565 [2024-11-26 05:26:37.251313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.565 [2024-11-26 05:26:37.251346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.565 [2024-11-26 05:26:37.251361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.565 [2024-11-26 05:26:37.251374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.565 [2024-11-26 05:26:37.251406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.565 qpair failed and we were unable to recover it. 00:30:35.565 [2024-11-26 05:26:37.261268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.565 [2024-11-26 05:26:37.261381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.565 [2024-11-26 05:26:37.261407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.565 [2024-11-26 05:26:37.261422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.565 [2024-11-26 05:26:37.261434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.565 [2024-11-26 05:26:37.261464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.565 qpair failed and we were unable to recover it. 00:30:35.565 [2024-11-26 05:26:37.271271] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.565 [2024-11-26 05:26:37.271375] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.565 [2024-11-26 05:26:37.271402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.565 [2024-11-26 05:26:37.271416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.565 [2024-11-26 05:26:37.271429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.565 [2024-11-26 05:26:37.271459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.565 qpair failed and we were unable to recover it. 00:30:35.565 [2024-11-26 05:26:37.281308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.565 [2024-11-26 05:26:37.281408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.565 [2024-11-26 05:26:37.281433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.565 [2024-11-26 05:26:37.281447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.565 [2024-11-26 05:26:37.281472] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.565 [2024-11-26 05:26:37.281501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.565 qpair failed and we were unable to recover it. 00:30:35.565 [2024-11-26 05:26:37.291358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.565 [2024-11-26 05:26:37.291475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.565 [2024-11-26 05:26:37.291499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.565 [2024-11-26 05:26:37.291514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.565 [2024-11-26 05:26:37.291533] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.565 [2024-11-26 05:26:37.291564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.565 qpair failed and we were unable to recover it. 00:30:35.565 [2024-11-26 05:26:37.301360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.565 [2024-11-26 05:26:37.301467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.565 [2024-11-26 05:26:37.301492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.565 [2024-11-26 05:26:37.301506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.565 [2024-11-26 05:26:37.301519] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.565 [2024-11-26 05:26:37.301549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.565 qpair failed and we were unable to recover it. 00:30:35.565 [2024-11-26 05:26:37.311398] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.565 [2024-11-26 05:26:37.311514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.565 [2024-11-26 05:26:37.311538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.565 [2024-11-26 05:26:37.311553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.565 [2024-11-26 05:26:37.311566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.565 [2024-11-26 05:26:37.311596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.565 qpair failed and we were unable to recover it. 00:30:35.565 [2024-11-26 05:26:37.321449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.565 [2024-11-26 05:26:37.321565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.565 [2024-11-26 05:26:37.321592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.565 [2024-11-26 05:26:37.321619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.565 [2024-11-26 05:26:37.321632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.565 [2024-11-26 05:26:37.321665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.565 qpair failed and we were unable to recover it. 00:30:35.826 [2024-11-26 05:26:37.331466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.826 [2024-11-26 05:26:37.331576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.826 [2024-11-26 05:26:37.331601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.826 [2024-11-26 05:26:37.331616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.826 [2024-11-26 05:26:37.331630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.826 [2024-11-26 05:26:37.331660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.826 qpair failed and we were unable to recover it. 00:30:35.826 [2024-11-26 05:26:37.341468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.826 [2024-11-26 05:26:37.341575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.826 [2024-11-26 05:26:37.341600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.826 [2024-11-26 05:26:37.341615] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.826 [2024-11-26 05:26:37.341628] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.826 [2024-11-26 05:26:37.341658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.826 qpair failed and we were unable to recover it. 00:30:35.826 [2024-11-26 05:26:37.351497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.826 [2024-11-26 05:26:37.351598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.826 [2024-11-26 05:26:37.351623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.826 [2024-11-26 05:26:37.351638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.826 [2024-11-26 05:26:37.351651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.826 [2024-11-26 05:26:37.351681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.826 qpair failed and we were unable to recover it. 00:30:35.826 [2024-11-26 05:26:37.361539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.826 [2024-11-26 05:26:37.361644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.826 [2024-11-26 05:26:37.361668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.826 [2024-11-26 05:26:37.361683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.826 [2024-11-26 05:26:37.361707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.826 [2024-11-26 05:26:37.361738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.826 qpair failed and we were unable to recover it. 00:30:35.826 [2024-11-26 05:26:37.371580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.826 [2024-11-26 05:26:37.371703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.826 [2024-11-26 05:26:37.371728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.826 [2024-11-26 05:26:37.371743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.826 [2024-11-26 05:26:37.371756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.826 [2024-11-26 05:26:37.371786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.826 qpair failed and we were unable to recover it. 00:30:35.826 [2024-11-26 05:26:37.381600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.826 [2024-11-26 05:26:37.381729] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.826 [2024-11-26 05:26:37.381754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.826 [2024-11-26 05:26:37.381768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.826 [2024-11-26 05:26:37.381787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.826 [2024-11-26 05:26:37.381819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.826 qpair failed and we were unable to recover it. 00:30:35.826 [2024-11-26 05:26:37.391600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.826 [2024-11-26 05:26:37.391715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.826 [2024-11-26 05:26:37.391740] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.826 [2024-11-26 05:26:37.391755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.826 [2024-11-26 05:26:37.391768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.826 [2024-11-26 05:26:37.391798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.826 qpair failed and we were unable to recover it. 00:30:35.826 [2024-11-26 05:26:37.401742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.826 [2024-11-26 05:26:37.401847] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.826 [2024-11-26 05:26:37.401874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.826 [2024-11-26 05:26:37.401889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.826 [2024-11-26 05:26:37.401902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.826 [2024-11-26 05:26:37.401932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.826 qpair failed and we were unable to recover it. 00:30:35.826 [2024-11-26 05:26:37.411651] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.826 [2024-11-26 05:26:37.411776] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.826 [2024-11-26 05:26:37.411803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.826 [2024-11-26 05:26:37.411818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.826 [2024-11-26 05:26:37.411830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.826 [2024-11-26 05:26:37.411862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.826 qpair failed and we were unable to recover it. 00:30:35.826 [2024-11-26 05:26:37.421697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.826 [2024-11-26 05:26:37.421797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.826 [2024-11-26 05:26:37.421822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.826 [2024-11-26 05:26:37.421837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.826 [2024-11-26 05:26:37.421850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.826 [2024-11-26 05:26:37.421881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.826 qpair failed and we were unable to recover it. 00:30:35.826 [2024-11-26 05:26:37.431726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.826 [2024-11-26 05:26:37.431828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.826 [2024-11-26 05:26:37.431854] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.826 [2024-11-26 05:26:37.431869] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.826 [2024-11-26 05:26:37.431883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.826 [2024-11-26 05:26:37.431914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.826 qpair failed and we were unable to recover it. 00:30:35.826 [2024-11-26 05:26:37.441844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.826 [2024-11-26 05:26:37.441995] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.826 [2024-11-26 05:26:37.442021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.826 [2024-11-26 05:26:37.442035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.826 [2024-11-26 05:26:37.442049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.826 [2024-11-26 05:26:37.442080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.826 qpair failed and we were unable to recover it. 00:30:35.826 [2024-11-26 05:26:37.451807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.826 [2024-11-26 05:26:37.451914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.826 [2024-11-26 05:26:37.451941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.451956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.451970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.452004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.827 qpair failed and we were unable to recover it. 00:30:35.827 [2024-11-26 05:26:37.461828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.827 [2024-11-26 05:26:37.461936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.827 [2024-11-26 05:26:37.461961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.461979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.461991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.462021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.827 qpair failed and we were unable to recover it. 00:30:35.827 [2024-11-26 05:26:37.471863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.827 [2024-11-26 05:26:37.471986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.827 [2024-11-26 05:26:37.472012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.472033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.472048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.472077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.827 qpair failed and we were unable to recover it. 00:30:35.827 [2024-11-26 05:26:37.481888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.827 [2024-11-26 05:26:37.482006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.827 [2024-11-26 05:26:37.482033] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.482047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.482061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.482091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.827 qpair failed and we were unable to recover it. 00:30:35.827 [2024-11-26 05:26:37.491900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.827 [2024-11-26 05:26:37.492008] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.827 [2024-11-26 05:26:37.492034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.492050] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.492064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.492093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.827 qpair failed and we were unable to recover it. 00:30:35.827 [2024-11-26 05:26:37.501927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.827 [2024-11-26 05:26:37.502037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.827 [2024-11-26 05:26:37.502063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.502078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.502092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.502121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.827 qpair failed and we were unable to recover it. 00:30:35.827 [2024-11-26 05:26:37.511991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.827 [2024-11-26 05:26:37.512101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.827 [2024-11-26 05:26:37.512127] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.512141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.512156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.512185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.827 qpair failed and we were unable to recover it. 00:30:35.827 [2024-11-26 05:26:37.522017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.827 [2024-11-26 05:26:37.522133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.827 [2024-11-26 05:26:37.522158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.522173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.522187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.522216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.827 qpair failed and we were unable to recover it. 00:30:35.827 [2024-11-26 05:26:37.532006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.827 [2024-11-26 05:26:37.532110] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.827 [2024-11-26 05:26:37.532137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.532151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.532165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.532195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.827 qpair failed and we were unable to recover it. 00:30:35.827 [2024-11-26 05:26:37.542046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.827 [2024-11-26 05:26:37.542150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.827 [2024-11-26 05:26:37.542176] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.542191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.542205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.542234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.827 qpair failed and we were unable to recover it. 00:30:35.827 [2024-11-26 05:26:37.552091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.827 [2024-11-26 05:26:37.552200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.827 [2024-11-26 05:26:37.552226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.552241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.552254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.552285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.827 qpair failed and we were unable to recover it. 00:30:35.827 [2024-11-26 05:26:37.562159] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.827 [2024-11-26 05:26:37.562301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.827 [2024-11-26 05:26:37.562327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.562348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.562377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.562420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.827 qpair failed and we were unable to recover it. 00:30:35.827 [2024-11-26 05:26:37.572127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.827 [2024-11-26 05:26:37.572233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.827 [2024-11-26 05:26:37.572260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.572274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.572288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.572317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.827 qpair failed and we were unable to recover it. 00:30:35.827 [2024-11-26 05:26:37.582206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.827 [2024-11-26 05:26:37.582368] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.827 [2024-11-26 05:26:37.582394] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.827 [2024-11-26 05:26:37.582422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.827 [2024-11-26 05:26:37.582437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:35.827 [2024-11-26 05:26:37.582466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.828 qpair failed and we were unable to recover it. 00:30:36.087 [2024-11-26 05:26:37.592222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.087 [2024-11-26 05:26:37.592349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.087 [2024-11-26 05:26:37.592377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.087 [2024-11-26 05:26:37.592392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.087 [2024-11-26 05:26:37.592406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.087 [2024-11-26 05:26:37.592436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.087 qpair failed and we were unable to recover it. 00:30:36.087 [2024-11-26 05:26:37.602256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.087 [2024-11-26 05:26:37.602368] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.087 [2024-11-26 05:26:37.602395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.087 [2024-11-26 05:26:37.602410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.087 [2024-11-26 05:26:37.602424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.087 [2024-11-26 05:26:37.602480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.087 qpair failed and we were unable to recover it. 00:30:36.087 [2024-11-26 05:26:37.612263] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.087 [2024-11-26 05:26:37.612373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.087 [2024-11-26 05:26:37.612399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.087 [2024-11-26 05:26:37.612413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.087 [2024-11-26 05:26:37.612427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.087 [2024-11-26 05:26:37.612458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.087 qpair failed and we were unable to recover it. 00:30:36.087 [2024-11-26 05:26:37.622293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.087 [2024-11-26 05:26:37.622401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.087 [2024-11-26 05:26:37.622426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.087 [2024-11-26 05:26:37.622440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.087 [2024-11-26 05:26:37.622454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.087 [2024-11-26 05:26:37.622484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.087 qpair failed and we were unable to recover it. 00:30:36.087 [2024-11-26 05:26:37.632305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.087 [2024-11-26 05:26:37.632411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.087 [2024-11-26 05:26:37.632437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.087 [2024-11-26 05:26:37.632451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.087 [2024-11-26 05:26:37.632465] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.087 [2024-11-26 05:26:37.632494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.087 qpair failed and we were unable to recover it. 00:30:36.087 [2024-11-26 05:26:37.642358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.087 [2024-11-26 05:26:37.642490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.087 [2024-11-26 05:26:37.642516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.087 [2024-11-26 05:26:37.642530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.087 [2024-11-26 05:26:37.642545] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.087 [2024-11-26 05:26:37.642589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.087 qpair failed and we were unable to recover it. 00:30:36.087 [2024-11-26 05:26:37.652385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.087 [2024-11-26 05:26:37.652499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.087 [2024-11-26 05:26:37.652530] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.087 [2024-11-26 05:26:37.652546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.087 [2024-11-26 05:26:37.652559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.087 [2024-11-26 05:26:37.652602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.087 qpair failed and we were unable to recover it. 00:30:36.087 [2024-11-26 05:26:37.662391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.087 [2024-11-26 05:26:37.662517] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.087 [2024-11-26 05:26:37.662543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.087 [2024-11-26 05:26:37.662558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.087 [2024-11-26 05:26:37.662571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.087 [2024-11-26 05:26:37.662601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.087 qpair failed and we were unable to recover it. 00:30:36.087 [2024-11-26 05:26:37.672555] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.087 [2024-11-26 05:26:37.672661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.087 [2024-11-26 05:26:37.672697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.087 [2024-11-26 05:26:37.672716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.087 [2024-11-26 05:26:37.672730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.087 [2024-11-26 05:26:37.672761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.087 qpair failed and we were unable to recover it. 00:30:36.087 [2024-11-26 05:26:37.682538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.087 [2024-11-26 05:26:37.682649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.682676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.682699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.088 [2024-11-26 05:26:37.682715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.088 [2024-11-26 05:26:37.682745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.088 qpair failed and we were unable to recover it. 00:30:36.088 [2024-11-26 05:26:37.692481] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.088 [2024-11-26 05:26:37.692594] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.692619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.692634] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.088 [2024-11-26 05:26:37.692648] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.088 [2024-11-26 05:26:37.692693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.088 qpair failed and we were unable to recover it. 00:30:36.088 [2024-11-26 05:26:37.702512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.088 [2024-11-26 05:26:37.702630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.702656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.702671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.088 [2024-11-26 05:26:37.702693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.088 [2024-11-26 05:26:37.702727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.088 qpair failed and we were unable to recover it. 00:30:36.088 [2024-11-26 05:26:37.712543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.088 [2024-11-26 05:26:37.712650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.712677] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.712701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.088 [2024-11-26 05:26:37.712717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.088 [2024-11-26 05:26:37.712747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.088 qpair failed and we were unable to recover it. 00:30:36.088 [2024-11-26 05:26:37.722562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.088 [2024-11-26 05:26:37.722665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.722698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.722715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.088 [2024-11-26 05:26:37.722729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.088 [2024-11-26 05:26:37.722758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.088 qpair failed and we were unable to recover it. 00:30:36.088 [2024-11-26 05:26:37.732606] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.088 [2024-11-26 05:26:37.732730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.732757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.732772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.088 [2024-11-26 05:26:37.732786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.088 [2024-11-26 05:26:37.732816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.088 qpair failed and we were unable to recover it. 00:30:36.088 [2024-11-26 05:26:37.742605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.088 [2024-11-26 05:26:37.742722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.742753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.742768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.088 [2024-11-26 05:26:37.742782] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.088 [2024-11-26 05:26:37.742812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.088 qpair failed and we were unable to recover it. 00:30:36.088 [2024-11-26 05:26:37.752649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.088 [2024-11-26 05:26:37.752759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.752786] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.752801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.088 [2024-11-26 05:26:37.752814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.088 [2024-11-26 05:26:37.752844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.088 qpair failed and we were unable to recover it. 00:30:36.088 [2024-11-26 05:26:37.762698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.088 [2024-11-26 05:26:37.762820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.762848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.762863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.088 [2024-11-26 05:26:37.762877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.088 [2024-11-26 05:26:37.762907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.088 qpair failed and we were unable to recover it. 00:30:36.088 [2024-11-26 05:26:37.772713] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.088 [2024-11-26 05:26:37.772842] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.772868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.772883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.088 [2024-11-26 05:26:37.772897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.088 [2024-11-26 05:26:37.772928] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.088 qpair failed and we were unable to recover it. 00:30:36.088 [2024-11-26 05:26:37.782810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.088 [2024-11-26 05:26:37.782922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.782949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.782963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.088 [2024-11-26 05:26:37.782977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.088 [2024-11-26 05:26:37.783013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.088 qpair failed and we were unable to recover it. 00:30:36.088 [2024-11-26 05:26:37.792768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.088 [2024-11-26 05:26:37.792876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.792903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.792918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.088 [2024-11-26 05:26:37.792931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.088 [2024-11-26 05:26:37.792961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.088 qpair failed and we were unable to recover it. 00:30:36.088 [2024-11-26 05:26:37.802806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.088 [2024-11-26 05:26:37.802915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.802941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.802956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.088 [2024-11-26 05:26:37.802970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.088 [2024-11-26 05:26:37.803001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.088 qpair failed and we were unable to recover it. 00:30:36.088 [2024-11-26 05:26:37.812840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.088 [2024-11-26 05:26:37.812967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.088 [2024-11-26 05:26:37.812994] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.088 [2024-11-26 05:26:37.813011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.089 [2024-11-26 05:26:37.813028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.089 [2024-11-26 05:26:37.813075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.089 qpair failed and we were unable to recover it. 00:30:36.089 [2024-11-26 05:26:37.822852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.089 [2024-11-26 05:26:37.822957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.089 [2024-11-26 05:26:37.822983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.089 [2024-11-26 05:26:37.822998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.089 [2024-11-26 05:26:37.823012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.089 [2024-11-26 05:26:37.823042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.089 qpair failed and we were unable to recover it. 00:30:36.089 [2024-11-26 05:26:37.832903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.089 [2024-11-26 05:26:37.833014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.089 [2024-11-26 05:26:37.833040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.089 [2024-11-26 05:26:37.833055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.089 [2024-11-26 05:26:37.833068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.089 [2024-11-26 05:26:37.833098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.089 qpair failed and we were unable to recover it. 00:30:36.089 [2024-11-26 05:26:37.842907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.089 [2024-11-26 05:26:37.843019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.089 [2024-11-26 05:26:37.843045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.089 [2024-11-26 05:26:37.843059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.089 [2024-11-26 05:26:37.843073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.089 [2024-11-26 05:26:37.843103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.089 qpair failed and we were unable to recover it. 00:30:36.348 [2024-11-26 05:26:37.852952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.348 [2024-11-26 05:26:37.853061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.348 [2024-11-26 05:26:37.853087] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.348 [2024-11-26 05:26:37.853103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.348 [2024-11-26 05:26:37.853117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.348 [2024-11-26 05:26:37.853147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.348 qpair failed and we were unable to recover it. 00:30:36.348 [2024-11-26 05:26:37.862964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.348 [2024-11-26 05:26:37.863076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.348 [2024-11-26 05:26:37.863102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.348 [2024-11-26 05:26:37.863117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.863130] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.349 [2024-11-26 05:26:37.863160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.349 qpair failed and we were unable to recover it. 00:30:36.349 [2024-11-26 05:26:37.873005] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.349 [2024-11-26 05:26:37.873120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.349 [2024-11-26 05:26:37.873147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.349 [2024-11-26 05:26:37.873162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.873186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.349 [2024-11-26 05:26:37.873218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.349 qpair failed and we were unable to recover it. 00:30:36.349 [2024-11-26 05:26:37.883029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.349 [2024-11-26 05:26:37.883140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.349 [2024-11-26 05:26:37.883166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.349 [2024-11-26 05:26:37.883181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.883195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.349 [2024-11-26 05:26:37.883225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.349 qpair failed and we were unable to recover it. 00:30:36.349 [2024-11-26 05:26:37.893048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.349 [2024-11-26 05:26:37.893164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.349 [2024-11-26 05:26:37.893191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.349 [2024-11-26 05:26:37.893205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.893219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.349 [2024-11-26 05:26:37.893248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.349 qpair failed and we were unable to recover it. 00:30:36.349 [2024-11-26 05:26:37.903110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.349 [2024-11-26 05:26:37.903222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.349 [2024-11-26 05:26:37.903248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.349 [2024-11-26 05:26:37.903263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.903276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.349 [2024-11-26 05:26:37.903305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.349 qpair failed and we were unable to recover it. 00:30:36.349 [2024-11-26 05:26:37.913090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.349 [2024-11-26 05:26:37.913197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.349 [2024-11-26 05:26:37.913223] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.349 [2024-11-26 05:26:37.913237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.913251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.349 [2024-11-26 05:26:37.913282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.349 qpair failed and we were unable to recover it. 00:30:36.349 [2024-11-26 05:26:37.923269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.349 [2024-11-26 05:26:37.923394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.349 [2024-11-26 05:26:37.923420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.349 [2024-11-26 05:26:37.923434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.923446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.349 [2024-11-26 05:26:37.923476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.349 qpair failed and we were unable to recover it. 00:30:36.349 [2024-11-26 05:26:37.933156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.349 [2024-11-26 05:26:37.933260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.349 [2024-11-26 05:26:37.933286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.349 [2024-11-26 05:26:37.933301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.933314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.349 [2024-11-26 05:26:37.933345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.349 qpair failed and we were unable to recover it. 00:30:36.349 [2024-11-26 05:26:37.943195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.349 [2024-11-26 05:26:37.943298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.349 [2024-11-26 05:26:37.943324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.349 [2024-11-26 05:26:37.943339] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.943352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.349 [2024-11-26 05:26:37.943381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.349 qpair failed and we were unable to recover it. 00:30:36.349 [2024-11-26 05:26:37.953308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.349 [2024-11-26 05:26:37.953442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.349 [2024-11-26 05:26:37.953468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.349 [2024-11-26 05:26:37.953482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.953496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.349 [2024-11-26 05:26:37.953526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.349 qpair failed and we were unable to recover it. 00:30:36.349 [2024-11-26 05:26:37.963257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.349 [2024-11-26 05:26:37.963377] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.349 [2024-11-26 05:26:37.963403] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.349 [2024-11-26 05:26:37.963424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.963439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.349 [2024-11-26 05:26:37.963469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.349 qpair failed and we were unable to recover it. 00:30:36.349 [2024-11-26 05:26:37.973264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.349 [2024-11-26 05:26:37.973370] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.349 [2024-11-26 05:26:37.973396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.349 [2024-11-26 05:26:37.973411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.973425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.349 [2024-11-26 05:26:37.973454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.349 qpair failed and we were unable to recover it. 00:30:36.349 [2024-11-26 05:26:37.983321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.349 [2024-11-26 05:26:37.983440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.349 [2024-11-26 05:26:37.983464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.349 [2024-11-26 05:26:37.983478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.983490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.349 [2024-11-26 05:26:37.983520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.349 qpair failed and we were unable to recover it. 00:30:36.349 [2024-11-26 05:26:37.993329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.349 [2024-11-26 05:26:37.993434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.349 [2024-11-26 05:26:37.993460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.349 [2024-11-26 05:26:37.993474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.349 [2024-11-26 05:26:37.993488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.350 [2024-11-26 05:26:37.993517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.350 qpair failed and we were unable to recover it. 00:30:36.350 [2024-11-26 05:26:38.003366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.350 [2024-11-26 05:26:38.003476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.350 [2024-11-26 05:26:38.003502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.350 [2024-11-26 05:26:38.003517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.350 [2024-11-26 05:26:38.003530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.350 [2024-11-26 05:26:38.003561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.350 qpair failed and we were unable to recover it. 00:30:36.350 [2024-11-26 05:26:38.013525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.350 [2024-11-26 05:26:38.013660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.350 [2024-11-26 05:26:38.013694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.350 [2024-11-26 05:26:38.013711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.350 [2024-11-26 05:26:38.013725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.350 [2024-11-26 05:26:38.013755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.350 qpair failed and we were unable to recover it. 00:30:36.350 [2024-11-26 05:26:38.023436] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.350 [2024-11-26 05:26:38.023539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.350 [2024-11-26 05:26:38.023565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.350 [2024-11-26 05:26:38.023579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.350 [2024-11-26 05:26:38.023593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.350 [2024-11-26 05:26:38.023623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.350 qpair failed and we were unable to recover it. 00:30:36.350 [2024-11-26 05:26:38.033470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.350 [2024-11-26 05:26:38.033569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.350 [2024-11-26 05:26:38.033595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.350 [2024-11-26 05:26:38.033610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.350 [2024-11-26 05:26:38.033624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.350 [2024-11-26 05:26:38.033654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.350 qpair failed and we were unable to recover it. 00:30:36.350 [2024-11-26 05:26:38.043506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.350 [2024-11-26 05:26:38.043616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.350 [2024-11-26 05:26:38.043642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.350 [2024-11-26 05:26:38.043657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.350 [2024-11-26 05:26:38.043676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.350 [2024-11-26 05:26:38.043713] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.350 qpair failed and we were unable to recover it. 00:30:36.350 [2024-11-26 05:26:38.053525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.350 [2024-11-26 05:26:38.053626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.350 [2024-11-26 05:26:38.053651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.350 [2024-11-26 05:26:38.053672] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.350 [2024-11-26 05:26:38.053695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.350 [2024-11-26 05:26:38.053739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.350 qpair failed and we were unable to recover it. 00:30:36.350 [2024-11-26 05:26:38.063550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.350 [2024-11-26 05:26:38.063663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.350 [2024-11-26 05:26:38.063696] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.350 [2024-11-26 05:26:38.063713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.350 [2024-11-26 05:26:38.063726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.350 [2024-11-26 05:26:38.063757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.350 qpair failed and we were unable to recover it. 00:30:36.350 [2024-11-26 05:26:38.073573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.350 [2024-11-26 05:26:38.073679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.350 [2024-11-26 05:26:38.073714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.350 [2024-11-26 05:26:38.073730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.350 [2024-11-26 05:26:38.073743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.350 [2024-11-26 05:26:38.073773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.350 qpair failed and we were unable to recover it. 00:30:36.350 [2024-11-26 05:26:38.083632] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.350 [2024-11-26 05:26:38.083790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.350 [2024-11-26 05:26:38.083816] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.350 [2024-11-26 05:26:38.083830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.350 [2024-11-26 05:26:38.083843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.350 [2024-11-26 05:26:38.083874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.350 qpair failed and we were unable to recover it. 00:30:36.350 [2024-11-26 05:26:38.093646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.350 [2024-11-26 05:26:38.093759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.350 [2024-11-26 05:26:38.093786] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.350 [2024-11-26 05:26:38.093801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.350 [2024-11-26 05:26:38.093815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.350 [2024-11-26 05:26:38.093845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.350 qpair failed and we were unable to recover it. 00:30:36.350 [2024-11-26 05:26:38.103700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.350 [2024-11-26 05:26:38.103822] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.350 [2024-11-26 05:26:38.103849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.350 [2024-11-26 05:26:38.103863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.350 [2024-11-26 05:26:38.103876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.350 [2024-11-26 05:26:38.103908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.350 qpair failed and we were unable to recover it. 00:30:36.610 [2024-11-26 05:26:38.113707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.610 [2024-11-26 05:26:38.113812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.610 [2024-11-26 05:26:38.113838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.610 [2024-11-26 05:26:38.113853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.610 [2024-11-26 05:26:38.113867] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.610 [2024-11-26 05:26:38.113897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.610 qpair failed and we were unable to recover it. 00:30:36.610 [2024-11-26 05:26:38.123783] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.610 [2024-11-26 05:26:38.123944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.610 [2024-11-26 05:26:38.123969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.610 [2024-11-26 05:26:38.123984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.610 [2024-11-26 05:26:38.123997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.610 [2024-11-26 05:26:38.124028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.610 qpair failed and we were unable to recover it. 00:30:36.610 [2024-11-26 05:26:38.133746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.610 [2024-11-26 05:26:38.133858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.610 [2024-11-26 05:26:38.133884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.610 [2024-11-26 05:26:38.133898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.610 [2024-11-26 05:26:38.133912] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.610 [2024-11-26 05:26:38.133942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.610 qpair failed and we were unable to recover it. 00:30:36.610 [2024-11-26 05:26:38.143798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.610 [2024-11-26 05:26:38.143902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.610 [2024-11-26 05:26:38.143933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.610 [2024-11-26 05:26:38.143948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.610 [2024-11-26 05:26:38.143962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.610 [2024-11-26 05:26:38.143991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.610 qpair failed and we were unable to recover it. 00:30:36.610 [2024-11-26 05:26:38.153805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.610 [2024-11-26 05:26:38.153911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.610 [2024-11-26 05:26:38.153936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.153950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.611 [2024-11-26 05:26:38.153964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.611 [2024-11-26 05:26:38.153995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.611 qpair failed and we were unable to recover it. 00:30:36.611 [2024-11-26 05:26:38.163870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.611 [2024-11-26 05:26:38.163980] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.611 [2024-11-26 05:26:38.164005] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.164020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.611 [2024-11-26 05:26:38.164034] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.611 [2024-11-26 05:26:38.164064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.611 qpair failed and we were unable to recover it. 00:30:36.611 [2024-11-26 05:26:38.173873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.611 [2024-11-26 05:26:38.173993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.611 [2024-11-26 05:26:38.174021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.174036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.611 [2024-11-26 05:26:38.174050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.611 [2024-11-26 05:26:38.174082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.611 qpair failed and we were unable to recover it. 00:30:36.611 [2024-11-26 05:26:38.183905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.611 [2024-11-26 05:26:38.184018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.611 [2024-11-26 05:26:38.184045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.184060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.611 [2024-11-26 05:26:38.184073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.611 [2024-11-26 05:26:38.184109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.611 qpair failed and we were unable to recover it. 00:30:36.611 [2024-11-26 05:26:38.193951] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.611 [2024-11-26 05:26:38.194069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.611 [2024-11-26 05:26:38.194095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.194110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.611 [2024-11-26 05:26:38.194124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.611 [2024-11-26 05:26:38.194154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.611 qpair failed and we were unable to recover it. 00:30:36.611 [2024-11-26 05:26:38.203969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.611 [2024-11-26 05:26:38.204075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.611 [2024-11-26 05:26:38.204100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.204115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.611 [2024-11-26 05:26:38.204128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.611 [2024-11-26 05:26:38.204158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.611 qpair failed and we were unable to recover it. 00:30:36.611 [2024-11-26 05:26:38.213974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.611 [2024-11-26 05:26:38.214072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.611 [2024-11-26 05:26:38.214098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.214113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.611 [2024-11-26 05:26:38.214127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.611 [2024-11-26 05:26:38.214157] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.611 qpair failed and we were unable to recover it. 00:30:36.611 [2024-11-26 05:26:38.224002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.611 [2024-11-26 05:26:38.224143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.611 [2024-11-26 05:26:38.224169] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.224184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.611 [2024-11-26 05:26:38.224197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.611 [2024-11-26 05:26:38.224228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.611 qpair failed and we were unable to recover it. 00:30:36.611 [2024-11-26 05:26:38.234038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.611 [2024-11-26 05:26:38.234146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.611 [2024-11-26 05:26:38.234177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.234192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.611 [2024-11-26 05:26:38.234206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.611 [2024-11-26 05:26:38.234236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.611 qpair failed and we were unable to recover it. 00:30:36.611 [2024-11-26 05:26:38.244134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.611 [2024-11-26 05:26:38.244251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.611 [2024-11-26 05:26:38.244275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.244289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.611 [2024-11-26 05:26:38.244302] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.611 [2024-11-26 05:26:38.244332] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.611 qpair failed and we were unable to recover it. 00:30:36.611 [2024-11-26 05:26:38.254096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.611 [2024-11-26 05:26:38.254192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.611 [2024-11-26 05:26:38.254217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.254232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.611 [2024-11-26 05:26:38.254244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.611 [2024-11-26 05:26:38.254273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.611 qpair failed and we were unable to recover it. 00:30:36.611 [2024-11-26 05:26:38.264160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.611 [2024-11-26 05:26:38.264261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.611 [2024-11-26 05:26:38.264286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.264301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.611 [2024-11-26 05:26:38.264314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.611 [2024-11-26 05:26:38.264344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.611 qpair failed and we were unable to recover it. 00:30:36.611 [2024-11-26 05:26:38.274147] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.611 [2024-11-26 05:26:38.274243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.611 [2024-11-26 05:26:38.274270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.274285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.611 [2024-11-26 05:26:38.274298] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.611 [2024-11-26 05:26:38.274335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.611 qpair failed and we were unable to recover it. 00:30:36.611 [2024-11-26 05:26:38.284219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.611 [2024-11-26 05:26:38.284350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.611 [2024-11-26 05:26:38.284377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.611 [2024-11-26 05:26:38.284392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.612 [2024-11-26 05:26:38.284405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.612 [2024-11-26 05:26:38.284449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.612 qpair failed and we were unable to recover it. 00:30:36.612 [2024-11-26 05:26:38.294187] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.612 [2024-11-26 05:26:38.294289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.612 [2024-11-26 05:26:38.294314] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.612 [2024-11-26 05:26:38.294327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.612 [2024-11-26 05:26:38.294340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.612 [2024-11-26 05:26:38.294370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.612 qpair failed and we were unable to recover it. 00:30:36.612 [2024-11-26 05:26:38.304237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.612 [2024-11-26 05:26:38.304341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.612 [2024-11-26 05:26:38.304368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.612 [2024-11-26 05:26:38.304383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.612 [2024-11-26 05:26:38.304395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.612 [2024-11-26 05:26:38.304425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.612 qpair failed and we were unable to recover it. 00:30:36.612 [2024-11-26 05:26:38.314259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.612 [2024-11-26 05:26:38.314372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.612 [2024-11-26 05:26:38.314399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.612 [2024-11-26 05:26:38.314414] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.612 [2024-11-26 05:26:38.314427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.612 [2024-11-26 05:26:38.314470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.612 qpair failed and we were unable to recover it. 00:30:36.612 [2024-11-26 05:26:38.324347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.612 [2024-11-26 05:26:38.324452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.612 [2024-11-26 05:26:38.324485] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.612 [2024-11-26 05:26:38.324500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.612 [2024-11-26 05:26:38.324513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.612 [2024-11-26 05:26:38.324543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.612 qpair failed and we were unable to recover it. 00:30:36.612 [2024-11-26 05:26:38.334406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.612 [2024-11-26 05:26:38.334515] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.612 [2024-11-26 05:26:38.334539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.612 [2024-11-26 05:26:38.334561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.612 [2024-11-26 05:26:38.334574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.612 [2024-11-26 05:26:38.334605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.612 qpair failed and we were unable to recover it. 00:30:36.612 [2024-11-26 05:26:38.344372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.612 [2024-11-26 05:26:38.344471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.612 [2024-11-26 05:26:38.344498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.612 [2024-11-26 05:26:38.344512] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.612 [2024-11-26 05:26:38.344525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.612 [2024-11-26 05:26:38.344555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.612 qpair failed and we were unable to recover it. 00:30:36.612 [2024-11-26 05:26:38.354364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.612 [2024-11-26 05:26:38.354497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.612 [2024-11-26 05:26:38.354523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.612 [2024-11-26 05:26:38.354538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.612 [2024-11-26 05:26:38.354551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.612 [2024-11-26 05:26:38.354586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.612 qpair failed and we were unable to recover it. 00:30:36.612 [2024-11-26 05:26:38.364411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.612 [2024-11-26 05:26:38.364516] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.612 [2024-11-26 05:26:38.364542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.612 [2024-11-26 05:26:38.364557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.612 [2024-11-26 05:26:38.364578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.612 [2024-11-26 05:26:38.364609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.612 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-26 05:26:38.374427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.872 [2024-11-26 05:26:38.374527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.872 [2024-11-26 05:26:38.374554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.872 [2024-11-26 05:26:38.374569] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.872 [2024-11-26 05:26:38.374582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.872 [2024-11-26 05:26:38.374612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-26 05:26:38.384484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.872 [2024-11-26 05:26:38.384598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.872 [2024-11-26 05:26:38.384625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.872 [2024-11-26 05:26:38.384641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.872 [2024-11-26 05:26:38.384653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.872 [2024-11-26 05:26:38.384683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-26 05:26:38.394516] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.872 [2024-11-26 05:26:38.394618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.872 [2024-11-26 05:26:38.394644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.872 [2024-11-26 05:26:38.394660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.872 [2024-11-26 05:26:38.394672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.872 [2024-11-26 05:26:38.394710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-26 05:26:38.404529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.872 [2024-11-26 05:26:38.404633] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.872 [2024-11-26 05:26:38.404659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.872 [2024-11-26 05:26:38.404674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.872 [2024-11-26 05:26:38.404695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.872 [2024-11-26 05:26:38.404728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-26 05:26:38.414550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.872 [2024-11-26 05:26:38.414665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.872 [2024-11-26 05:26:38.414703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.872 [2024-11-26 05:26:38.414719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.872 [2024-11-26 05:26:38.414731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.872 [2024-11-26 05:26:38.414762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-26 05:26:38.424579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.872 [2024-11-26 05:26:38.424695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.872 [2024-11-26 05:26:38.424721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.872 [2024-11-26 05:26:38.424736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.872 [2024-11-26 05:26:38.424748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.872 [2024-11-26 05:26:38.424779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-26 05:26:38.434637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.872 [2024-11-26 05:26:38.434778] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.872 [2024-11-26 05:26:38.434804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.872 [2024-11-26 05:26:38.434823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.872 [2024-11-26 05:26:38.434836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.872 [2024-11-26 05:26:38.434865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-26 05:26:38.444623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.872 [2024-11-26 05:26:38.444741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.872 [2024-11-26 05:26:38.444764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.444779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.444792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.444826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-26 05:26:38.454777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.873 [2024-11-26 05:26:38.454909] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.873 [2024-11-26 05:26:38.454934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.454949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.454968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.454998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-26 05:26:38.464733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.873 [2024-11-26 05:26:38.464833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.873 [2024-11-26 05:26:38.464857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.464870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.464883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.464913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-26 05:26:38.474707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.873 [2024-11-26 05:26:38.474847] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.873 [2024-11-26 05:26:38.474874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.474889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.474902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.474932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-26 05:26:38.484753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.873 [2024-11-26 05:26:38.484858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.873 [2024-11-26 05:26:38.484882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.484896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.484909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.484939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-26 05:26:38.494789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.873 [2024-11-26 05:26:38.494889] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.873 [2024-11-26 05:26:38.494913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.494928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.494940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.494970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-26 05:26:38.504811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.873 [2024-11-26 05:26:38.504915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.873 [2024-11-26 05:26:38.504942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.504957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.504971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.505001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-26 05:26:38.514838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.873 [2024-11-26 05:26:38.514987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.873 [2024-11-26 05:26:38.515014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.515029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.515042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.515072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-26 05:26:38.524960] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.873 [2024-11-26 05:26:38.525068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.873 [2024-11-26 05:26:38.525093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.525108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.525121] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.525151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-26 05:26:38.534994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.873 [2024-11-26 05:26:38.535101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.873 [2024-11-26 05:26:38.535126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.535140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.535154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.535184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-26 05:26:38.544969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.873 [2024-11-26 05:26:38.545071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.873 [2024-11-26 05:26:38.545098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.545118] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.545133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.545163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-26 05:26:38.554962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.873 [2024-11-26 05:26:38.555083] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.873 [2024-11-26 05:26:38.555110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.555125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.555139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.555170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-26 05:26:38.565002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.873 [2024-11-26 05:26:38.565108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.873 [2024-11-26 05:26:38.565134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.565149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.565163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.565193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-26 05:26:38.575001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.873 [2024-11-26 05:26:38.575097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.873 [2024-11-26 05:26:38.575124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.873 [2024-11-26 05:26:38.575140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.873 [2024-11-26 05:26:38.575153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.873 [2024-11-26 05:26:38.575184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-26 05:26:38.585043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.874 [2024-11-26 05:26:38.585142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.874 [2024-11-26 05:26:38.585167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.874 [2024-11-26 05:26:38.585181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.874 [2024-11-26 05:26:38.585195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.874 [2024-11-26 05:26:38.585225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-26 05:26:38.595055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.874 [2024-11-26 05:26:38.595154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.874 [2024-11-26 05:26:38.595181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.874 [2024-11-26 05:26:38.595196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.874 [2024-11-26 05:26:38.595209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.874 [2024-11-26 05:26:38.595239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-26 05:26:38.605171] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.874 [2024-11-26 05:26:38.605276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.874 [2024-11-26 05:26:38.605301] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.874 [2024-11-26 05:26:38.605315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.874 [2024-11-26 05:26:38.605327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.874 [2024-11-26 05:26:38.605357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-26 05:26:38.615150] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.874 [2024-11-26 05:26:38.615256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.874 [2024-11-26 05:26:38.615282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.874 [2024-11-26 05:26:38.615297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.874 [2024-11-26 05:26:38.615310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.874 [2024-11-26 05:26:38.615341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-26 05:26:38.625151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.874 [2024-11-26 05:26:38.625252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.874 [2024-11-26 05:26:38.625278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.874 [2024-11-26 05:26:38.625293] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.874 [2024-11-26 05:26:38.625306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.874 [2024-11-26 05:26:38.625336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-26 05:26:38.635185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:36.874 [2024-11-26 05:26:38.635289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:36.874 [2024-11-26 05:26:38.635324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:36.874 [2024-11-26 05:26:38.635341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:36.874 [2024-11-26 05:26:38.635354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:36.874 [2024-11-26 05:26:38.635384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.158 qpair failed and we were unable to recover it. 00:30:37.158 [2024-11-26 05:26:38.645250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.158 [2024-11-26 05:26:38.645366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.158 [2024-11-26 05:26:38.645394] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.158 [2024-11-26 05:26:38.645410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.158 [2024-11-26 05:26:38.645428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.158 [2024-11-26 05:26:38.645461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.158 qpair failed and we were unable to recover it. 00:30:37.158 [2024-11-26 05:26:38.655266] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.158 [2024-11-26 05:26:38.655391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.158 [2024-11-26 05:26:38.655419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.158 [2024-11-26 05:26:38.655434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.158 [2024-11-26 05:26:38.655446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.158 [2024-11-26 05:26:38.655478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.158 qpair failed and we were unable to recover it. 00:30:37.158 [2024-11-26 05:26:38.665333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.158 [2024-11-26 05:26:38.665442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.158 [2024-11-26 05:26:38.665467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.158 [2024-11-26 05:26:38.665481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.158 [2024-11-26 05:26:38.665495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.158 [2024-11-26 05:26:38.665525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.158 qpair failed and we were unable to recover it. 00:30:37.158 [2024-11-26 05:26:38.675322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.158 [2024-11-26 05:26:38.675428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.158 [2024-11-26 05:26:38.675453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.158 [2024-11-26 05:26:38.675467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.158 [2024-11-26 05:26:38.675481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.158 [2024-11-26 05:26:38.675511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.158 qpair failed and we were unable to recover it. 00:30:37.158 [2024-11-26 05:26:38.685349] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.158 [2024-11-26 05:26:38.685454] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.158 [2024-11-26 05:26:38.685479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.158 [2024-11-26 05:26:38.685493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.158 [2024-11-26 05:26:38.685506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.158 [2024-11-26 05:26:38.685536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.158 qpair failed and we were unable to recover it. 00:30:37.158 [2024-11-26 05:26:38.695368] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.158 [2024-11-26 05:26:38.695470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.158 [2024-11-26 05:26:38.695495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.695509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.695522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.159 [2024-11-26 05:26:38.695551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.159 qpair failed and we were unable to recover it. 00:30:37.159 [2024-11-26 05:26:38.705415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.159 [2024-11-26 05:26:38.705522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.159 [2024-11-26 05:26:38.705547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.705561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.705575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.159 [2024-11-26 05:26:38.705605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.159 qpair failed and we were unable to recover it. 00:30:37.159 [2024-11-26 05:26:38.715426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.159 [2024-11-26 05:26:38.715533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.159 [2024-11-26 05:26:38.715557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.715572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.715585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.159 [2024-11-26 05:26:38.715615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.159 qpair failed and we were unable to recover it. 00:30:37.159 [2024-11-26 05:26:38.725493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.159 [2024-11-26 05:26:38.725601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.159 [2024-11-26 05:26:38.725631] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.725647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.725660] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.159 [2024-11-26 05:26:38.725697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.159 qpair failed and we were unable to recover it. 00:30:37.159 [2024-11-26 05:26:38.735516] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.159 [2024-11-26 05:26:38.735629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.159 [2024-11-26 05:26:38.735653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.735668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.735681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.159 [2024-11-26 05:26:38.735739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.159 qpair failed and we were unable to recover it. 00:30:37.159 [2024-11-26 05:26:38.745509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.159 [2024-11-26 05:26:38.745622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.159 [2024-11-26 05:26:38.745646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.745660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.745673] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.159 [2024-11-26 05:26:38.745711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.159 qpair failed and we were unable to recover it. 00:30:37.159 [2024-11-26 05:26:38.755505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.159 [2024-11-26 05:26:38.755617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.159 [2024-11-26 05:26:38.755641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.755656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.755669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.159 [2024-11-26 05:26:38.755706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.159 qpair failed and we were unable to recover it. 00:30:37.159 [2024-11-26 05:26:38.765560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.159 [2024-11-26 05:26:38.765660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.159 [2024-11-26 05:26:38.765692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.765709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.765722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.159 [2024-11-26 05:26:38.765758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.159 qpair failed and we were unable to recover it. 00:30:37.159 [2024-11-26 05:26:38.775573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.159 [2024-11-26 05:26:38.775709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.159 [2024-11-26 05:26:38.775733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.775749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.775762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.159 [2024-11-26 05:26:38.775792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.159 qpair failed and we were unable to recover it. 00:30:37.159 [2024-11-26 05:26:38.785607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.159 [2024-11-26 05:26:38.785721] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.159 [2024-11-26 05:26:38.785746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.785761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.785774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.159 [2024-11-26 05:26:38.785805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.159 qpair failed and we were unable to recover it. 00:30:37.159 [2024-11-26 05:26:38.795631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.159 [2024-11-26 05:26:38.795743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.159 [2024-11-26 05:26:38.795777] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.795802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.795819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.159 [2024-11-26 05:26:38.795851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.159 qpair failed and we were unable to recover it. 00:30:37.159 [2024-11-26 05:26:38.805696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.159 [2024-11-26 05:26:38.805843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.159 [2024-11-26 05:26:38.805870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.805885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.805897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.159 [2024-11-26 05:26:38.805927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.159 qpair failed and we were unable to recover it. 00:30:37.159 [2024-11-26 05:26:38.815719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.159 [2024-11-26 05:26:38.815836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.159 [2024-11-26 05:26:38.815868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.815884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.815896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.159 [2024-11-26 05:26:38.815927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.159 qpair failed and we were unable to recover it. 00:30:37.159 [2024-11-26 05:26:38.825736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.159 [2024-11-26 05:26:38.825852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.159 [2024-11-26 05:26:38.825877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.159 [2024-11-26 05:26:38.825893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.159 [2024-11-26 05:26:38.825905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.160 [2024-11-26 05:26:38.825936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.160 qpair failed and we were unable to recover it. 00:30:37.160 [2024-11-26 05:26:38.835827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.160 [2024-11-26 05:26:38.835974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.160 [2024-11-26 05:26:38.836001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.160 [2024-11-26 05:26:38.836015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.160 [2024-11-26 05:26:38.836029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.160 [2024-11-26 05:26:38.836058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.160 qpair failed and we were unable to recover it. 00:30:37.160 [2024-11-26 05:26:38.845839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.160 [2024-11-26 05:26:38.845948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.160 [2024-11-26 05:26:38.845973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.160 [2024-11-26 05:26:38.845987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.160 [2024-11-26 05:26:38.846000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.160 [2024-11-26 05:26:38.846030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.160 qpair failed and we were unable to recover it. 00:30:37.160 [2024-11-26 05:26:38.855839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.160 [2024-11-26 05:26:38.855962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.160 [2024-11-26 05:26:38.855987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.160 [2024-11-26 05:26:38.856001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.160 [2024-11-26 05:26:38.856020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.160 [2024-11-26 05:26:38.856051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.160 qpair failed and we were unable to recover it. 00:30:37.160 [2024-11-26 05:26:38.865869] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.160 [2024-11-26 05:26:38.865986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.160 [2024-11-26 05:26:38.866012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.160 [2024-11-26 05:26:38.866027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.160 [2024-11-26 05:26:38.866044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.160 [2024-11-26 05:26:38.866076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.160 qpair failed and we were unable to recover it. 00:30:37.160 [2024-11-26 05:26:38.875889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.160 [2024-11-26 05:26:38.875987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.160 [2024-11-26 05:26:38.876012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.160 [2024-11-26 05:26:38.876027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.160 [2024-11-26 05:26:38.876039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.160 [2024-11-26 05:26:38.876069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.160 qpair failed and we were unable to recover it. 00:30:37.160 [2024-11-26 05:26:38.885937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.160 [2024-11-26 05:26:38.886048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.160 [2024-11-26 05:26:38.886072] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.160 [2024-11-26 05:26:38.886086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.160 [2024-11-26 05:26:38.886099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.160 [2024-11-26 05:26:38.886129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.160 qpair failed and we were unable to recover it. 00:30:37.160 [2024-11-26 05:26:38.895942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.160 [2024-11-26 05:26:38.896066] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.160 [2024-11-26 05:26:38.896094] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.160 [2024-11-26 05:26:38.896109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.160 [2024-11-26 05:26:38.896122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.160 [2024-11-26 05:26:38.896152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.160 qpair failed and we were unable to recover it. 00:30:37.160 [2024-11-26 05:26:38.905994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.160 [2024-11-26 05:26:38.906149] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.160 [2024-11-26 05:26:38.906177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.160 [2024-11-26 05:26:38.906192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.160 [2024-11-26 05:26:38.906205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.160 [2024-11-26 05:26:38.906235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.160 qpair failed and we were unable to recover it. 00:30:37.428 [2024-11-26 05:26:38.916036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.428 [2024-11-26 05:26:38.916181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.428 [2024-11-26 05:26:38.916213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.428 [2024-11-26 05:26:38.916230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.428 [2024-11-26 05:26:38.916243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.428 [2024-11-26 05:26:38.916276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.428 qpair failed and we were unable to recover it. 00:30:37.428 [2024-11-26 05:26:38.926009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.428 [2024-11-26 05:26:38.926116] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.428 [2024-11-26 05:26:38.926141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.428 [2024-11-26 05:26:38.926156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.428 [2024-11-26 05:26:38.926169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.428 [2024-11-26 05:26:38.926199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.428 qpair failed and we were unable to recover it. 00:30:37.428 [2024-11-26 05:26:38.936037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.428 [2024-11-26 05:26:38.936137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.428 [2024-11-26 05:26:38.936162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.428 [2024-11-26 05:26:38.936177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.428 [2024-11-26 05:26:38.936190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.428 [2024-11-26 05:26:38.936220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.428 qpair failed and we were unable to recover it. 00:30:37.428 [2024-11-26 05:26:38.946073] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.428 [2024-11-26 05:26:38.946190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.428 [2024-11-26 05:26:38.946217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.428 [2024-11-26 05:26:38.946233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.428 [2024-11-26 05:26:38.946253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.428 [2024-11-26 05:26:38.946285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.428 qpair failed and we were unable to recover it. 00:30:37.428 [2024-11-26 05:26:38.956138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.428 [2024-11-26 05:26:38.956238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.428 [2024-11-26 05:26:38.956264] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.428 [2024-11-26 05:26:38.956278] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.428 [2024-11-26 05:26:38.956291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.428 [2024-11-26 05:26:38.956321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.428 qpair failed and we were unable to recover it. 00:30:37.428 [2024-11-26 05:26:38.966127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.428 [2024-11-26 05:26:38.966230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.428 [2024-11-26 05:26:38.966255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.428 [2024-11-26 05:26:38.966269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.428 [2024-11-26 05:26:38.966283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.428 [2024-11-26 05:26:38.966312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.428 qpair failed and we were unable to recover it. 00:30:37.428 [2024-11-26 05:26:38.976189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.428 [2024-11-26 05:26:38.976292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.428 [2024-11-26 05:26:38.976317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.428 [2024-11-26 05:26:38.976330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.428 [2024-11-26 05:26:38.976343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.428 [2024-11-26 05:26:38.976374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.428 qpair failed and we were unable to recover it. 00:30:37.428 [2024-11-26 05:26:38.986187] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.428 [2024-11-26 05:26:38.986290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.428 [2024-11-26 05:26:38.986315] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.428 [2024-11-26 05:26:38.986329] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.428 [2024-11-26 05:26:38.986342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.428 [2024-11-26 05:26:38.986371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.428 qpair failed and we were unable to recover it. 00:30:37.428 [2024-11-26 05:26:38.996214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.428 [2024-11-26 05:26:38.996314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.428 [2024-11-26 05:26:38.996339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.428 [2024-11-26 05:26:38.996354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.428 [2024-11-26 05:26:38.996367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.428 [2024-11-26 05:26:38.996397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.428 qpair failed and we were unable to recover it. 00:30:37.428 [2024-11-26 05:26:39.006264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.428 [2024-11-26 05:26:39.006369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.428 [2024-11-26 05:26:39.006393] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.428 [2024-11-26 05:26:39.006408] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.428 [2024-11-26 05:26:39.006421] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.428 [2024-11-26 05:26:39.006451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.428 qpair failed and we were unable to recover it. 00:30:37.428 [2024-11-26 05:26:39.016326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.428 [2024-11-26 05:26:39.016440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.428 [2024-11-26 05:26:39.016466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.428 [2024-11-26 05:26:39.016480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.428 [2024-11-26 05:26:39.016493] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.428 [2024-11-26 05:26:39.016522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.428 qpair failed and we were unable to recover it. 00:30:37.428 [2024-11-26 05:26:39.026309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.428 [2024-11-26 05:26:39.026410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.428 [2024-11-26 05:26:39.026436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.428 [2024-11-26 05:26:39.026451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.428 [2024-11-26 05:26:39.026463] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.428 [2024-11-26 05:26:39.026493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.428 qpair failed and we were unable to recover it. 00:30:37.428 [2024-11-26 05:26:39.036323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.428 [2024-11-26 05:26:39.036425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.428 [2024-11-26 05:26:39.036449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.429 [2024-11-26 05:26:39.036470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.429 [2024-11-26 05:26:39.036484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.429 [2024-11-26 05:26:39.036514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.429 qpair failed and we were unable to recover it. 00:30:37.429 [2024-11-26 05:26:39.046364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.429 [2024-11-26 05:26:39.046468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.429 [2024-11-26 05:26:39.046492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.429 [2024-11-26 05:26:39.046506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.429 [2024-11-26 05:26:39.046520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.429 [2024-11-26 05:26:39.046550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.429 qpair failed and we were unable to recover it. 00:30:37.429 [2024-11-26 05:26:39.056392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.429 [2024-11-26 05:26:39.056541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.429 [2024-11-26 05:26:39.056568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.429 [2024-11-26 05:26:39.056583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.429 [2024-11-26 05:26:39.056596] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.429 [2024-11-26 05:26:39.056641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.429 qpair failed and we were unable to recover it. 00:30:37.429 [2024-11-26 05:26:39.066445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.429 [2024-11-26 05:26:39.066548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.429 [2024-11-26 05:26:39.066573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.429 [2024-11-26 05:26:39.066587] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.429 [2024-11-26 05:26:39.066600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.429 [2024-11-26 05:26:39.066643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.429 qpair failed and we were unable to recover it. 00:30:37.429 [2024-11-26 05:26:39.076458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.429 [2024-11-26 05:26:39.076556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.429 [2024-11-26 05:26:39.076581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.429 [2024-11-26 05:26:39.076595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.429 [2024-11-26 05:26:39.076609] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.429 [2024-11-26 05:26:39.076639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.429 qpair failed and we were unable to recover it. 00:30:37.429 [2024-11-26 05:26:39.086524] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.429 [2024-11-26 05:26:39.086628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.429 [2024-11-26 05:26:39.086653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.429 [2024-11-26 05:26:39.086668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.429 [2024-11-26 05:26:39.086680] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.429 [2024-11-26 05:26:39.086719] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.429 qpair failed and we were unable to recover it. 00:30:37.429 [2024-11-26 05:26:39.096535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.429 [2024-11-26 05:26:39.096659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.429 [2024-11-26 05:26:39.096683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.429 [2024-11-26 05:26:39.096707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.429 [2024-11-26 05:26:39.096720] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.429 [2024-11-26 05:26:39.096750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.429 qpair failed and we were unable to recover it. 00:30:37.429 [2024-11-26 05:26:39.106545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.429 [2024-11-26 05:26:39.106643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.429 [2024-11-26 05:26:39.106668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.429 [2024-11-26 05:26:39.106683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.429 [2024-11-26 05:26:39.106708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.429 [2024-11-26 05:26:39.106739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.429 qpair failed and we were unable to recover it. 00:30:37.429 [2024-11-26 05:26:39.116603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.429 [2024-11-26 05:26:39.116733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.429 [2024-11-26 05:26:39.116758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.429 [2024-11-26 05:26:39.116772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.429 [2024-11-26 05:26:39.116785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f596c000b90 00:30:37.429 [2024-11-26 05:26:39.116815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:37.429 qpair failed and we were unable to recover it. 00:30:37.429 [2024-11-26 05:26:39.116985] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:37.429 A controller has encountered a failure and is being reset. 00:30:37.429 [2024-11-26 05:26:39.117054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1410980 (9): Bad file descriptor 00:30:37.687 Controller properly reset. 00:30:37.687 Initializing NVMe Controllers 00:30:37.687 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:37.687 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:37.687 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:37.687 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:37.687 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:37.687 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:37.687 Initialization complete. Launching workers. 00:30:37.687 Starting thread on core 1 00:30:37.687 Starting thread on core 2 00:30:37.687 Starting thread on core 3 00:30:37.687 Starting thread on core 0 00:30:37.687 05:26:39 -- host/target_disconnect.sh@59 -- # sync 00:30:37.687 00:30:37.687 real 0m11.510s 00:30:37.687 user 0m21.488s 00:30:37.687 sys 0m5.262s 00:30:37.687 05:26:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:37.687 05:26:39 -- common/autotest_common.sh@10 -- # set +x 00:30:37.687 ************************************ 00:30:37.687 END TEST nvmf_target_disconnect_tc2 00:30:37.687 ************************************ 00:30:37.687 05:26:39 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:37.687 05:26:39 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:37.687 05:26:39 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:37.687 05:26:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:37.687 05:26:39 -- nvmf/common.sh@116 -- # sync 00:30:37.687 05:26:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:37.687 05:26:39 -- nvmf/common.sh@119 -- # set +e 00:30:37.687 05:26:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:37.687 05:26:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:37.687 rmmod nvme_tcp 00:30:37.687 rmmod nvme_fabrics 00:30:37.687 rmmod nvme_keyring 00:30:37.687 05:26:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:37.687 05:26:39 -- nvmf/common.sh@123 -- # set -e 00:30:37.687 05:26:39 -- nvmf/common.sh@124 -- # return 0 00:30:37.687 05:26:39 -- nvmf/common.sh@477 -- # '[' -n 3429798 ']' 00:30:37.687 05:26:39 -- nvmf/common.sh@478 -- # killprocess 3429798 00:30:37.687 05:26:39 -- common/autotest_common.sh@936 -- # '[' -z 3429798 ']' 00:30:37.687 05:26:39 -- common/autotest_common.sh@940 -- # kill -0 3429798 00:30:37.687 05:26:39 -- common/autotest_common.sh@941 -- # uname 00:30:37.687 05:26:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:37.687 05:26:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3429798 00:30:37.687 05:26:39 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:37.687 05:26:39 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:37.687 05:26:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3429798' 00:30:37.687 killing process with pid 3429798 00:30:37.687 05:26:39 -- common/autotest_common.sh@955 -- # kill 3429798 00:30:37.687 05:26:39 -- common/autotest_common.sh@960 -- # wait 3429798 00:30:37.945 05:26:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:37.945 05:26:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:37.945 05:26:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:37.945 05:26:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:37.945 05:26:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:37.945 05:26:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:37.945 05:26:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:37.945 05:26:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:40.486 05:26:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:40.486 00:30:40.486 real 0m16.298s 00:30:40.486 user 0m47.830s 00:30:40.486 sys 0m7.233s 00:30:40.486 05:26:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:40.486 05:26:41 -- common/autotest_common.sh@10 -- # set +x 00:30:40.486 ************************************ 00:30:40.486 END TEST nvmf_target_disconnect 00:30:40.486 ************************************ 00:30:40.486 05:26:41 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:40.486 05:26:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:40.486 05:26:41 -- common/autotest_common.sh@10 -- # set +x 00:30:40.486 05:26:41 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:40.486 00:30:40.486 real 22m54.763s 00:30:40.486 user 66m18.844s 00:30:40.486 sys 5m37.076s 00:30:40.486 05:26:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:40.486 05:26:41 -- common/autotest_common.sh@10 -- # set +x 00:30:40.486 ************************************ 00:30:40.486 END TEST nvmf_tcp 00:30:40.486 ************************************ 00:30:40.486 05:26:41 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:30:40.486 05:26:41 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:40.486 05:26:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:40.486 05:26:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:40.486 05:26:41 -- common/autotest_common.sh@10 -- # set +x 00:30:40.486 ************************************ 00:30:40.486 START TEST spdkcli_nvmf_tcp 00:30:40.486 ************************************ 00:30:40.486 05:26:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:40.486 * Looking for test storage... 00:30:40.486 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:40.486 05:26:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:40.486 05:26:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:40.486 05:26:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:40.486 05:26:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:40.486 05:26:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:40.486 05:26:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:40.486 05:26:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:40.486 05:26:41 -- scripts/common.sh@335 -- # IFS=.-: 00:30:40.486 05:26:41 -- scripts/common.sh@335 -- # read -ra ver1 00:30:40.486 05:26:41 -- scripts/common.sh@336 -- # IFS=.-: 00:30:40.486 05:26:41 -- scripts/common.sh@336 -- # read -ra ver2 00:30:40.486 05:26:41 -- scripts/common.sh@337 -- # local 'op=<' 00:30:40.486 05:26:41 -- scripts/common.sh@339 -- # ver1_l=2 00:30:40.486 05:26:41 -- scripts/common.sh@340 -- # ver2_l=1 00:30:40.486 05:26:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:40.486 05:26:41 -- scripts/common.sh@343 -- # case "$op" in 00:30:40.486 05:26:41 -- scripts/common.sh@344 -- # : 1 00:30:40.486 05:26:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:40.486 05:26:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:40.486 05:26:41 -- scripts/common.sh@364 -- # decimal 1 00:30:40.486 05:26:41 -- scripts/common.sh@352 -- # local d=1 00:30:40.486 05:26:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:40.486 05:26:41 -- scripts/common.sh@354 -- # echo 1 00:30:40.486 05:26:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:40.486 05:26:41 -- scripts/common.sh@365 -- # decimal 2 00:30:40.486 05:26:41 -- scripts/common.sh@352 -- # local d=2 00:30:40.486 05:26:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:40.486 05:26:41 -- scripts/common.sh@354 -- # echo 2 00:30:40.486 05:26:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:40.486 05:26:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:40.486 05:26:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:40.486 05:26:41 -- scripts/common.sh@367 -- # return 0 00:30:40.486 05:26:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:40.486 05:26:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:40.486 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:40.486 --rc genhtml_branch_coverage=1 00:30:40.486 --rc genhtml_function_coverage=1 00:30:40.486 --rc genhtml_legend=1 00:30:40.486 --rc geninfo_all_blocks=1 00:30:40.486 --rc geninfo_unexecuted_blocks=1 00:30:40.486 00:30:40.486 ' 00:30:40.486 05:26:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:40.486 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:40.486 --rc genhtml_branch_coverage=1 00:30:40.486 --rc genhtml_function_coverage=1 00:30:40.486 --rc genhtml_legend=1 00:30:40.486 --rc geninfo_all_blocks=1 00:30:40.486 --rc geninfo_unexecuted_blocks=1 00:30:40.486 00:30:40.486 ' 00:30:40.486 05:26:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:40.486 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:40.486 --rc genhtml_branch_coverage=1 00:30:40.486 --rc genhtml_function_coverage=1 00:30:40.486 --rc genhtml_legend=1 00:30:40.486 --rc geninfo_all_blocks=1 00:30:40.486 --rc geninfo_unexecuted_blocks=1 00:30:40.486 00:30:40.486 ' 00:30:40.486 05:26:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:40.486 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:40.487 --rc genhtml_branch_coverage=1 00:30:40.487 --rc genhtml_function_coverage=1 00:30:40.487 --rc genhtml_legend=1 00:30:40.487 --rc geninfo_all_blocks=1 00:30:40.487 --rc geninfo_unexecuted_blocks=1 00:30:40.487 00:30:40.487 ' 00:30:40.487 05:26:41 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:40.487 05:26:41 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:40.487 05:26:41 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:40.487 05:26:41 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:40.487 05:26:41 -- nvmf/common.sh@7 -- # uname -s 00:30:40.487 05:26:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:40.487 05:26:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:40.487 05:26:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:40.487 05:26:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:40.487 05:26:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:40.487 05:26:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:40.487 05:26:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:40.487 05:26:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:40.487 05:26:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:40.487 05:26:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:40.487 05:26:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:40.487 05:26:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:40.487 05:26:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:40.487 05:26:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:40.487 05:26:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:40.487 05:26:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:40.487 05:26:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:40.487 05:26:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:40.487 05:26:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:40.487 05:26:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:40.487 05:26:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:40.487 05:26:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:40.487 05:26:41 -- paths/export.sh@5 -- # export PATH 00:30:40.487 05:26:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:40.487 05:26:41 -- nvmf/common.sh@46 -- # : 0 00:30:40.487 05:26:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:40.487 05:26:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:40.487 05:26:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:40.487 05:26:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:40.487 05:26:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:40.487 05:26:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:40.487 05:26:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:40.487 05:26:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:40.487 05:26:41 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:40.487 05:26:41 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:40.487 05:26:41 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:40.487 05:26:41 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:40.487 05:26:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:40.487 05:26:41 -- common/autotest_common.sh@10 -- # set +x 00:30:40.487 05:26:41 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:40.487 05:26:41 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3431026 00:30:40.487 05:26:41 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:40.487 05:26:41 -- spdkcli/common.sh@34 -- # waitforlisten 3431026 00:30:40.487 05:26:41 -- common/autotest_common.sh@829 -- # '[' -z 3431026 ']' 00:30:40.487 05:26:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:40.487 05:26:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:40.487 05:26:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:40.487 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:40.487 05:26:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:40.487 05:26:41 -- common/autotest_common.sh@10 -- # set +x 00:30:40.487 [2024-11-26 05:26:41.924046] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:40.487 [2024-11-26 05:26:41.924145] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3431026 ] 00:30:40.487 EAL: No free 2048 kB hugepages reported on node 1 00:30:40.487 [2024-11-26 05:26:41.982826] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:40.487 [2024-11-26 05:26:42.070260] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:40.487 [2024-11-26 05:26:42.073707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:40.487 [2024-11-26 05:26:42.073719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:41.424 05:26:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:41.424 05:26:42 -- common/autotest_common.sh@862 -- # return 0 00:30:41.424 05:26:42 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:41.424 05:26:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:41.424 05:26:42 -- common/autotest_common.sh@10 -- # set +x 00:30:41.424 05:26:42 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:41.424 05:26:42 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:41.424 05:26:42 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:41.424 05:26:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:41.424 05:26:42 -- common/autotest_common.sh@10 -- # set +x 00:30:41.424 05:26:42 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:41.424 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:41.424 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:41.424 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:41.424 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:41.424 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:41.424 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:41.424 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:41.424 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:41.424 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:41.424 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:41.424 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:41.424 ' 00:30:41.682 [2024-11-26 05:26:43.393511] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:44.215 [2024-11-26 05:26:45.562188] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:45.151 [2024-11-26 05:26:46.802855] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:47.689 [2024-11-26 05:26:49.093958] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:49.591 [2024-11-26 05:26:51.096766] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:30:50.969 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:50.969 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:50.969 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:50.969 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:50.969 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:50.969 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:50.969 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:50.969 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:50.969 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:50.969 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:50.969 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:50.970 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:50.970 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:50.970 05:26:52 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:50.970 05:26:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:50.970 05:26:52 -- common/autotest_common.sh@10 -- # set +x 00:30:51.227 05:26:52 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:51.227 05:26:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:51.227 05:26:52 -- common/autotest_common.sh@10 -- # set +x 00:30:51.227 05:26:52 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:51.227 05:26:52 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:51.485 05:26:53 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:51.485 05:26:53 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:51.485 05:26:53 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:51.485 05:26:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:51.485 05:26:53 -- common/autotest_common.sh@10 -- # set +x 00:30:51.485 05:26:53 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:51.485 05:26:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:51.485 05:26:53 -- common/autotest_common.sh@10 -- # set +x 00:30:51.485 05:26:53 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:51.485 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:51.485 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:51.485 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:51.485 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:30:51.485 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:30:51.485 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:51.485 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:51.485 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:51.485 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:51.485 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:51.485 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:51.485 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:51.485 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:51.485 ' 00:30:56.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:30:56.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:30:56.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:56.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:30:56.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:30:56.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:30:56.753 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:30:56.753 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:56.753 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:30:56.753 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:30:56.753 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:30:56.753 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:30:56.753 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:30:56.753 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:30:57.012 05:26:58 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:30:57.012 05:26:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:57.012 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:30:57.012 05:26:58 -- spdkcli/nvmf.sh@90 -- # killprocess 3431026 00:30:57.012 05:26:58 -- common/autotest_common.sh@936 -- # '[' -z 3431026 ']' 00:30:57.012 05:26:58 -- common/autotest_common.sh@940 -- # kill -0 3431026 00:30:57.012 05:26:58 -- common/autotest_common.sh@941 -- # uname 00:30:57.012 05:26:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:57.012 05:26:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3431026 00:30:57.012 05:26:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:57.012 05:26:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:57.012 05:26:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3431026' 00:30:57.012 killing process with pid 3431026 00:30:57.012 05:26:58 -- common/autotest_common.sh@955 -- # kill 3431026 00:30:57.012 [2024-11-26 05:26:58.583137] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:57.012 05:26:58 -- common/autotest_common.sh@960 -- # wait 3431026 00:30:57.270 05:26:58 -- spdkcli/nvmf.sh@1 -- # cleanup 00:30:57.270 05:26:58 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:30:57.270 05:26:58 -- spdkcli/common.sh@13 -- # '[' -n 3431026 ']' 00:30:57.270 05:26:58 -- spdkcli/common.sh@14 -- # killprocess 3431026 00:30:57.270 05:26:58 -- common/autotest_common.sh@936 -- # '[' -z 3431026 ']' 00:30:57.270 05:26:58 -- common/autotest_common.sh@940 -- # kill -0 3431026 00:30:57.270 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3431026) - No such process 00:30:57.270 05:26:58 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3431026 is not found' 00:30:57.270 Process with pid 3431026 is not found 00:30:57.270 05:26:58 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:30:57.270 05:26:58 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:30:57.270 05:26:58 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:30:57.270 00:30:57.270 real 0m17.057s 00:30:57.270 user 0m36.496s 00:30:57.270 sys 0m0.776s 00:30:57.270 05:26:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:57.270 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:30:57.270 ************************************ 00:30:57.270 END TEST spdkcli_nvmf_tcp 00:30:57.270 ************************************ 00:30:57.270 05:26:58 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:57.270 05:26:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:57.270 05:26:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:57.270 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:30:57.270 ************************************ 00:30:57.270 START TEST nvmf_identify_passthru 00:30:57.270 ************************************ 00:30:57.270 05:26:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:57.270 * Looking for test storage... 00:30:57.270 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:57.270 05:26:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:57.270 05:26:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:57.270 05:26:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:57.270 05:26:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:57.270 05:26:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:57.270 05:26:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:57.270 05:26:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:57.270 05:26:58 -- scripts/common.sh@335 -- # IFS=.-: 00:30:57.270 05:26:58 -- scripts/common.sh@335 -- # read -ra ver1 00:30:57.270 05:26:58 -- scripts/common.sh@336 -- # IFS=.-: 00:30:57.270 05:26:58 -- scripts/common.sh@336 -- # read -ra ver2 00:30:57.270 05:26:58 -- scripts/common.sh@337 -- # local 'op=<' 00:30:57.270 05:26:58 -- scripts/common.sh@339 -- # ver1_l=2 00:30:57.271 05:26:58 -- scripts/common.sh@340 -- # ver2_l=1 00:30:57.271 05:26:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:57.271 05:26:58 -- scripts/common.sh@343 -- # case "$op" in 00:30:57.271 05:26:58 -- scripts/common.sh@344 -- # : 1 00:30:57.271 05:26:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:57.271 05:26:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:57.271 05:26:58 -- scripts/common.sh@364 -- # decimal 1 00:30:57.271 05:26:58 -- scripts/common.sh@352 -- # local d=1 00:30:57.271 05:26:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:57.271 05:26:58 -- scripts/common.sh@354 -- # echo 1 00:30:57.271 05:26:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:57.271 05:26:58 -- scripts/common.sh@365 -- # decimal 2 00:30:57.271 05:26:58 -- scripts/common.sh@352 -- # local d=2 00:30:57.271 05:26:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:57.271 05:26:58 -- scripts/common.sh@354 -- # echo 2 00:30:57.271 05:26:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:57.271 05:26:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:57.271 05:26:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:57.271 05:26:58 -- scripts/common.sh@367 -- # return 0 00:30:57.271 05:26:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:57.271 05:26:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:57.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:57.271 --rc genhtml_branch_coverage=1 00:30:57.271 --rc genhtml_function_coverage=1 00:30:57.271 --rc genhtml_legend=1 00:30:57.271 --rc geninfo_all_blocks=1 00:30:57.271 --rc geninfo_unexecuted_blocks=1 00:30:57.271 00:30:57.271 ' 00:30:57.271 05:26:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:57.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:57.271 --rc genhtml_branch_coverage=1 00:30:57.271 --rc genhtml_function_coverage=1 00:30:57.271 --rc genhtml_legend=1 00:30:57.271 --rc geninfo_all_blocks=1 00:30:57.271 --rc geninfo_unexecuted_blocks=1 00:30:57.271 00:30:57.271 ' 00:30:57.271 05:26:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:57.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:57.271 --rc genhtml_branch_coverage=1 00:30:57.271 --rc genhtml_function_coverage=1 00:30:57.271 --rc genhtml_legend=1 00:30:57.271 --rc geninfo_all_blocks=1 00:30:57.271 --rc geninfo_unexecuted_blocks=1 00:30:57.271 00:30:57.271 ' 00:30:57.271 05:26:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:57.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:57.271 --rc genhtml_branch_coverage=1 00:30:57.271 --rc genhtml_function_coverage=1 00:30:57.271 --rc genhtml_legend=1 00:30:57.271 --rc geninfo_all_blocks=1 00:30:57.271 --rc geninfo_unexecuted_blocks=1 00:30:57.271 00:30:57.271 ' 00:30:57.271 05:26:58 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:57.271 05:26:58 -- nvmf/common.sh@7 -- # uname -s 00:30:57.271 05:26:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:57.271 05:26:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:57.271 05:26:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:57.271 05:26:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:57.271 05:26:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:57.271 05:26:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:57.271 05:26:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:57.271 05:26:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:57.271 05:26:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:57.271 05:26:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:57.271 05:26:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:57.271 05:26:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:57.271 05:26:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:57.271 05:26:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:57.271 05:26:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:57.271 05:26:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:57.271 05:26:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:57.271 05:26:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:57.271 05:26:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:57.271 05:26:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:57.271 05:26:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:57.271 05:26:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:57.271 05:26:58 -- paths/export.sh@5 -- # export PATH 00:30:57.271 05:26:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:57.271 05:26:58 -- nvmf/common.sh@46 -- # : 0 00:30:57.271 05:26:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:57.271 05:26:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:57.271 05:26:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:57.271 05:26:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:57.271 05:26:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:57.271 05:26:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:57.271 05:26:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:57.271 05:26:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:57.271 05:26:58 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:57.271 05:26:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:57.271 05:26:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:57.271 05:26:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:57.271 05:26:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:57.271 05:26:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:57.271 05:26:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:57.271 05:26:58 -- paths/export.sh@5 -- # export PATH 00:30:57.271 05:26:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:57.271 05:26:58 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:30:57.271 05:26:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:57.271 05:26:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:57.271 05:26:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:57.271 05:26:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:57.271 05:26:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:57.271 05:26:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:57.271 05:26:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:57.271 05:26:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:57.271 05:26:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:57.271 05:26:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:57.271 05:26:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:57.271 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:30:59.803 05:27:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:59.803 05:27:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:59.803 05:27:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:59.803 05:27:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:59.803 05:27:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:59.803 05:27:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:59.803 05:27:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:59.803 05:27:00 -- nvmf/common.sh@294 -- # net_devs=() 00:30:59.803 05:27:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:59.803 05:27:00 -- nvmf/common.sh@295 -- # e810=() 00:30:59.803 05:27:00 -- nvmf/common.sh@295 -- # local -ga e810 00:30:59.803 05:27:00 -- nvmf/common.sh@296 -- # x722=() 00:30:59.803 05:27:00 -- nvmf/common.sh@296 -- # local -ga x722 00:30:59.803 05:27:00 -- nvmf/common.sh@297 -- # mlx=() 00:30:59.803 05:27:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:59.803 05:27:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:59.803 05:27:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:59.803 05:27:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:59.803 05:27:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:59.803 05:27:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:59.803 05:27:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:59.803 05:27:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:59.803 05:27:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:59.803 05:27:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:59.803 05:27:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:59.803 05:27:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:59.803 05:27:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:59.803 05:27:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:59.803 05:27:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:59.803 05:27:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:59.803 05:27:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:59.803 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:59.803 05:27:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:59.803 05:27:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:59.803 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:59.803 05:27:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:59.803 05:27:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:59.803 05:27:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:59.803 05:27:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:59.803 05:27:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:59.803 05:27:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:59.803 05:27:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:59.803 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:59.803 05:27:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:59.803 05:27:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:59.804 05:27:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:59.804 05:27:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:59.804 05:27:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:59.804 05:27:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:59.804 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:59.804 05:27:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:59.804 05:27:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:59.804 05:27:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:59.804 05:27:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:59.804 05:27:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:59.804 05:27:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:59.804 05:27:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:59.804 05:27:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:59.804 05:27:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:59.804 05:27:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:59.804 05:27:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:59.804 05:27:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:59.804 05:27:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:59.804 05:27:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:59.804 05:27:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:59.804 05:27:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:59.804 05:27:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:59.804 05:27:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:59.804 05:27:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:59.804 05:27:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:59.804 05:27:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:59.804 05:27:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:59.804 05:27:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:59.804 05:27:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:59.804 05:27:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:59.804 05:27:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:59.804 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:59.804 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:30:59.804 00:30:59.804 --- 10.0.0.2 ping statistics --- 00:30:59.804 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:59.804 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:30:59.804 05:27:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:59.804 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:59.804 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.182 ms 00:30:59.804 00:30:59.804 --- 10.0.0.1 ping statistics --- 00:30:59.804 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:59.804 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:30:59.804 05:27:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:59.804 05:27:01 -- nvmf/common.sh@410 -- # return 0 00:30:59.804 05:27:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:59.804 05:27:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:59.804 05:27:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:59.804 05:27:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:59.804 05:27:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:59.804 05:27:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:59.804 05:27:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:59.804 05:27:01 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:30:59.804 05:27:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:59.804 05:27:01 -- common/autotest_common.sh@10 -- # set +x 00:30:59.804 05:27:01 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:30:59.804 05:27:01 -- common/autotest_common.sh@1519 -- # bdfs=() 00:30:59.804 05:27:01 -- common/autotest_common.sh@1519 -- # local bdfs 00:30:59.804 05:27:01 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:30:59.804 05:27:01 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:30:59.804 05:27:01 -- common/autotest_common.sh@1508 -- # bdfs=() 00:30:59.804 05:27:01 -- common/autotest_common.sh@1508 -- # local bdfs 00:30:59.804 05:27:01 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:30:59.804 05:27:01 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:30:59.804 05:27:01 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:30:59.804 05:27:01 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:30:59.804 05:27:01 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:30:59.804 05:27:01 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:30:59.804 05:27:01 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:30:59.804 05:27:01 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:30:59.804 05:27:01 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:59.804 05:27:01 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:30:59.804 05:27:01 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:30:59.804 EAL: No free 2048 kB hugepages reported on node 1 00:31:03.999 05:27:05 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:31:03.999 05:27:05 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:03.999 05:27:05 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:31:03.999 05:27:05 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:31:03.999 EAL: No free 2048 kB hugepages reported on node 1 00:31:08.194 05:27:09 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:31:08.194 05:27:09 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:31:08.194 05:27:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:08.194 05:27:09 -- common/autotest_common.sh@10 -- # set +x 00:31:08.194 05:27:09 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:31:08.194 05:27:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:08.194 05:27:09 -- common/autotest_common.sh@10 -- # set +x 00:31:08.194 05:27:09 -- target/identify_passthru.sh@31 -- # nvmfpid=3436384 00:31:08.194 05:27:09 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:31:08.194 05:27:09 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:08.194 05:27:09 -- target/identify_passthru.sh@35 -- # waitforlisten 3436384 00:31:08.194 05:27:09 -- common/autotest_common.sh@829 -- # '[' -z 3436384 ']' 00:31:08.194 05:27:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:08.194 05:27:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:08.194 05:27:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:08.194 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:08.194 05:27:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:08.194 05:27:09 -- common/autotest_common.sh@10 -- # set +x 00:31:08.194 [2024-11-26 05:27:09.831942] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:08.195 [2024-11-26 05:27:09.832048] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:08.195 EAL: No free 2048 kB hugepages reported on node 1 00:31:08.195 [2024-11-26 05:27:09.896660] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:08.453 [2024-11-26 05:27:09.984173] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:08.453 [2024-11-26 05:27:09.984332] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:08.454 [2024-11-26 05:27:09.984349] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:08.454 [2024-11-26 05:27:09.984361] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:08.454 [2024-11-26 05:27:09.984424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:08.454 [2024-11-26 05:27:09.984484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:08.454 [2024-11-26 05:27:09.984549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:08.454 [2024-11-26 05:27:09.984551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:08.454 05:27:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:08.454 05:27:10 -- common/autotest_common.sh@862 -- # return 0 00:31:08.454 05:27:10 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:31:08.454 05:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:08.454 05:27:10 -- common/autotest_common.sh@10 -- # set +x 00:31:08.454 INFO: Log level set to 20 00:31:08.454 INFO: Requests: 00:31:08.454 { 00:31:08.454 "jsonrpc": "2.0", 00:31:08.454 "method": "nvmf_set_config", 00:31:08.454 "id": 1, 00:31:08.454 "params": { 00:31:08.454 "admin_cmd_passthru": { 00:31:08.454 "identify_ctrlr": true 00:31:08.454 } 00:31:08.454 } 00:31:08.454 } 00:31:08.454 00:31:08.454 INFO: response: 00:31:08.454 { 00:31:08.454 "jsonrpc": "2.0", 00:31:08.454 "id": 1, 00:31:08.454 "result": true 00:31:08.454 } 00:31:08.454 00:31:08.454 05:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:08.454 05:27:10 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:31:08.454 05:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:08.454 05:27:10 -- common/autotest_common.sh@10 -- # set +x 00:31:08.454 INFO: Setting log level to 20 00:31:08.454 INFO: Setting log level to 20 00:31:08.454 INFO: Log level set to 20 00:31:08.454 INFO: Log level set to 20 00:31:08.454 INFO: Requests: 00:31:08.454 { 00:31:08.454 "jsonrpc": "2.0", 00:31:08.454 "method": "framework_start_init", 00:31:08.454 "id": 1 00:31:08.454 } 00:31:08.454 00:31:08.454 INFO: Requests: 00:31:08.454 { 00:31:08.454 "jsonrpc": "2.0", 00:31:08.454 "method": "framework_start_init", 00:31:08.454 "id": 1 00:31:08.454 } 00:31:08.454 00:31:08.454 [2024-11-26 05:27:10.165926] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:08.454 INFO: response: 00:31:08.454 { 00:31:08.454 "jsonrpc": "2.0", 00:31:08.454 "id": 1, 00:31:08.454 "result": true 00:31:08.454 } 00:31:08.454 00:31:08.454 INFO: response: 00:31:08.454 { 00:31:08.454 "jsonrpc": "2.0", 00:31:08.454 "id": 1, 00:31:08.454 "result": true 00:31:08.454 } 00:31:08.454 00:31:08.454 05:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:08.454 05:27:10 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:08.454 05:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:08.454 05:27:10 -- common/autotest_common.sh@10 -- # set +x 00:31:08.454 INFO: Setting log level to 40 00:31:08.454 INFO: Setting log level to 40 00:31:08.454 INFO: Setting log level to 40 00:31:08.454 [2024-11-26 05:27:10.175865] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:08.454 05:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:08.454 05:27:10 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:08.454 05:27:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:08.454 05:27:10 -- common/autotest_common.sh@10 -- # set +x 00:31:08.454 05:27:10 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:31:08.454 05:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:08.454 05:27:10 -- common/autotest_common.sh@10 -- # set +x 00:31:11.739 Nvme0n1 00:31:11.739 05:27:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.739 05:27:13 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:11.739 05:27:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.739 05:27:13 -- common/autotest_common.sh@10 -- # set +x 00:31:11.739 05:27:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.739 05:27:13 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:11.739 05:27:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.739 05:27:13 -- common/autotest_common.sh@10 -- # set +x 00:31:11.739 05:27:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.739 05:27:13 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:11.739 05:27:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.739 05:27:13 -- common/autotest_common.sh@10 -- # set +x 00:31:11.739 [2024-11-26 05:27:13.060121] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:11.739 05:27:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.739 05:27:13 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:11.739 05:27:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.739 05:27:13 -- common/autotest_common.sh@10 -- # set +x 00:31:11.739 [2024-11-26 05:27:13.067734] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:11.739 [ 00:31:11.739 { 00:31:11.739 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:11.739 "subtype": "Discovery", 00:31:11.739 "listen_addresses": [], 00:31:11.739 "allow_any_host": true, 00:31:11.739 "hosts": [] 00:31:11.739 }, 00:31:11.739 { 00:31:11.739 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:11.739 "subtype": "NVMe", 00:31:11.739 "listen_addresses": [ 00:31:11.739 { 00:31:11.739 "transport": "TCP", 00:31:11.739 "trtype": "TCP", 00:31:11.739 "adrfam": "IPv4", 00:31:11.739 "traddr": "10.0.0.2", 00:31:11.739 "trsvcid": "4420" 00:31:11.739 } 00:31:11.739 ], 00:31:11.739 "allow_any_host": true, 00:31:11.739 "hosts": [], 00:31:11.739 "serial_number": "SPDK00000000000001", 00:31:11.739 "model_number": "SPDK bdev Controller", 00:31:11.739 "max_namespaces": 1, 00:31:11.739 "min_cntlid": 1, 00:31:11.739 "max_cntlid": 65519, 00:31:11.739 "namespaces": [ 00:31:11.739 { 00:31:11.739 "nsid": 1, 00:31:11.739 "bdev_name": "Nvme0n1", 00:31:11.739 "name": "Nvme0n1", 00:31:11.739 "nguid": "F4FCFED24F204C6D9F3E8BB3DF996CCE", 00:31:11.739 "uuid": "f4fcfed2-4f20-4c6d-9f3e-8bb3df996cce" 00:31:11.739 } 00:31:11.739 ] 00:31:11.739 } 00:31:11.739 ] 00:31:11.739 05:27:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.739 05:27:13 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:11.739 05:27:13 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:11.739 05:27:13 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:11.739 EAL: No free 2048 kB hugepages reported on node 1 00:31:11.739 05:27:13 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:11.739 05:27:13 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:11.739 05:27:13 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:11.739 05:27:13 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:11.739 EAL: No free 2048 kB hugepages reported on node 1 00:31:11.739 05:27:13 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:11.739 05:27:13 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:11.739 05:27:13 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:11.739 05:27:13 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:11.739 05:27:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.739 05:27:13 -- common/autotest_common.sh@10 -- # set +x 00:31:11.739 05:27:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.739 05:27:13 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:11.739 05:27:13 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:11.739 05:27:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:11.739 05:27:13 -- nvmf/common.sh@116 -- # sync 00:31:11.739 05:27:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:11.739 05:27:13 -- nvmf/common.sh@119 -- # set +e 00:31:11.739 05:27:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:11.739 05:27:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:11.739 rmmod nvme_tcp 00:31:11.739 rmmod nvme_fabrics 00:31:11.739 rmmod nvme_keyring 00:31:11.739 05:27:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:11.739 05:27:13 -- nvmf/common.sh@123 -- # set -e 00:31:11.739 05:27:13 -- nvmf/common.sh@124 -- # return 0 00:31:11.739 05:27:13 -- nvmf/common.sh@477 -- # '[' -n 3436384 ']' 00:31:11.739 05:27:13 -- nvmf/common.sh@478 -- # killprocess 3436384 00:31:11.739 05:27:13 -- common/autotest_common.sh@936 -- # '[' -z 3436384 ']' 00:31:11.739 05:27:13 -- common/autotest_common.sh@940 -- # kill -0 3436384 00:31:11.739 05:27:13 -- common/autotest_common.sh@941 -- # uname 00:31:11.739 05:27:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:11.739 05:27:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3436384 00:31:12.000 05:27:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:12.000 05:27:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:12.000 05:27:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3436384' 00:31:12.000 killing process with pid 3436384 00:31:12.000 05:27:13 -- common/autotest_common.sh@955 -- # kill 3436384 00:31:12.000 [2024-11-26 05:27:13.539129] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:12.000 05:27:13 -- common/autotest_common.sh@960 -- # wait 3436384 00:31:13.375 05:27:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:13.375 05:27:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:13.375 05:27:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:13.375 05:27:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:13.375 05:27:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:13.375 05:27:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:13.375 05:27:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:13.375 05:27:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:15.912 05:27:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:15.912 00:31:15.913 real 0m18.354s 00:31:15.913 user 0m27.052s 00:31:15.913 sys 0m2.391s 00:31:15.913 05:27:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:15.913 05:27:17 -- common/autotest_common.sh@10 -- # set +x 00:31:15.913 ************************************ 00:31:15.913 END TEST nvmf_identify_passthru 00:31:15.913 ************************************ 00:31:15.913 05:27:17 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:15.913 05:27:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:15.913 05:27:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:15.913 05:27:17 -- common/autotest_common.sh@10 -- # set +x 00:31:15.913 ************************************ 00:31:15.913 START TEST nvmf_dif 00:31:15.913 ************************************ 00:31:15.913 05:27:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:15.913 * Looking for test storage... 00:31:15.913 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:15.913 05:27:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:15.913 05:27:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:15.913 05:27:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:15.913 05:27:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:15.913 05:27:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:15.913 05:27:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:15.913 05:27:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:15.913 05:27:17 -- scripts/common.sh@335 -- # IFS=.-: 00:31:15.913 05:27:17 -- scripts/common.sh@335 -- # read -ra ver1 00:31:15.913 05:27:17 -- scripts/common.sh@336 -- # IFS=.-: 00:31:15.913 05:27:17 -- scripts/common.sh@336 -- # read -ra ver2 00:31:15.913 05:27:17 -- scripts/common.sh@337 -- # local 'op=<' 00:31:15.913 05:27:17 -- scripts/common.sh@339 -- # ver1_l=2 00:31:15.913 05:27:17 -- scripts/common.sh@340 -- # ver2_l=1 00:31:15.913 05:27:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:15.913 05:27:17 -- scripts/common.sh@343 -- # case "$op" in 00:31:15.913 05:27:17 -- scripts/common.sh@344 -- # : 1 00:31:15.913 05:27:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:15.913 05:27:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:15.913 05:27:17 -- scripts/common.sh@364 -- # decimal 1 00:31:15.913 05:27:17 -- scripts/common.sh@352 -- # local d=1 00:31:15.913 05:27:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:15.913 05:27:17 -- scripts/common.sh@354 -- # echo 1 00:31:15.913 05:27:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:15.913 05:27:17 -- scripts/common.sh@365 -- # decimal 2 00:31:15.913 05:27:17 -- scripts/common.sh@352 -- # local d=2 00:31:15.913 05:27:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:15.913 05:27:17 -- scripts/common.sh@354 -- # echo 2 00:31:15.913 05:27:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:15.913 05:27:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:15.913 05:27:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:15.913 05:27:17 -- scripts/common.sh@367 -- # return 0 00:31:15.913 05:27:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:15.913 05:27:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:15.913 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:15.913 --rc genhtml_branch_coverage=1 00:31:15.913 --rc genhtml_function_coverage=1 00:31:15.913 --rc genhtml_legend=1 00:31:15.913 --rc geninfo_all_blocks=1 00:31:15.913 --rc geninfo_unexecuted_blocks=1 00:31:15.913 00:31:15.913 ' 00:31:15.913 05:27:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:15.913 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:15.913 --rc genhtml_branch_coverage=1 00:31:15.913 --rc genhtml_function_coverage=1 00:31:15.913 --rc genhtml_legend=1 00:31:15.913 --rc geninfo_all_blocks=1 00:31:15.913 --rc geninfo_unexecuted_blocks=1 00:31:15.913 00:31:15.913 ' 00:31:15.913 05:27:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:15.913 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:15.913 --rc genhtml_branch_coverage=1 00:31:15.913 --rc genhtml_function_coverage=1 00:31:15.913 --rc genhtml_legend=1 00:31:15.913 --rc geninfo_all_blocks=1 00:31:15.913 --rc geninfo_unexecuted_blocks=1 00:31:15.913 00:31:15.913 ' 00:31:15.913 05:27:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:15.913 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:15.913 --rc genhtml_branch_coverage=1 00:31:15.913 --rc genhtml_function_coverage=1 00:31:15.913 --rc genhtml_legend=1 00:31:15.913 --rc geninfo_all_blocks=1 00:31:15.913 --rc geninfo_unexecuted_blocks=1 00:31:15.913 00:31:15.913 ' 00:31:15.913 05:27:17 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:15.913 05:27:17 -- nvmf/common.sh@7 -- # uname -s 00:31:15.913 05:27:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:15.913 05:27:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:15.913 05:27:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:15.913 05:27:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:15.913 05:27:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:15.913 05:27:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:15.913 05:27:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:15.913 05:27:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:15.913 05:27:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:15.913 05:27:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:15.913 05:27:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:15.913 05:27:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:15.913 05:27:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:15.913 05:27:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:15.913 05:27:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:15.913 05:27:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:15.913 05:27:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:15.913 05:27:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:15.913 05:27:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:15.913 05:27:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:15.913 05:27:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:15.913 05:27:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:15.913 05:27:17 -- paths/export.sh@5 -- # export PATH 00:31:15.913 05:27:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:15.913 05:27:17 -- nvmf/common.sh@46 -- # : 0 00:31:15.913 05:27:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:15.913 05:27:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:15.913 05:27:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:15.913 05:27:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:15.913 05:27:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:15.913 05:27:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:15.913 05:27:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:15.913 05:27:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:15.913 05:27:17 -- target/dif.sh@15 -- # NULL_META=16 00:31:15.913 05:27:17 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:15.913 05:27:17 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:15.913 05:27:17 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:15.913 05:27:17 -- target/dif.sh@135 -- # nvmftestinit 00:31:15.913 05:27:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:15.913 05:27:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:15.913 05:27:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:15.913 05:27:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:15.913 05:27:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:15.913 05:27:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:15.913 05:27:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:15.913 05:27:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:15.913 05:27:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:15.913 05:27:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:15.913 05:27:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:15.913 05:27:17 -- common/autotest_common.sh@10 -- # set +x 00:31:17.813 05:27:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:17.813 05:27:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:17.813 05:27:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:17.813 05:27:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:17.813 05:27:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:17.813 05:27:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:17.813 05:27:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:17.813 05:27:19 -- nvmf/common.sh@294 -- # net_devs=() 00:31:17.813 05:27:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:17.813 05:27:19 -- nvmf/common.sh@295 -- # e810=() 00:31:17.813 05:27:19 -- nvmf/common.sh@295 -- # local -ga e810 00:31:17.813 05:27:19 -- nvmf/common.sh@296 -- # x722=() 00:31:17.813 05:27:19 -- nvmf/common.sh@296 -- # local -ga x722 00:31:17.813 05:27:19 -- nvmf/common.sh@297 -- # mlx=() 00:31:17.813 05:27:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:17.813 05:27:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:17.813 05:27:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:17.813 05:27:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:17.813 05:27:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:17.813 05:27:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:17.813 05:27:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:17.813 05:27:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:17.813 05:27:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:17.813 05:27:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:17.813 05:27:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:17.813 05:27:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:17.813 05:27:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:17.813 05:27:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:17.813 05:27:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:17.813 05:27:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:17.813 05:27:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:17.813 05:27:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:17.814 05:27:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:17.814 05:27:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:17.814 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:17.814 05:27:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:17.814 05:27:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:17.814 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:17.814 05:27:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:17.814 05:27:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:17.814 05:27:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:17.814 05:27:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:17.814 05:27:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:17.814 05:27:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:17.814 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:17.814 05:27:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:17.814 05:27:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:17.814 05:27:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:17.814 05:27:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:17.814 05:27:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:17.814 05:27:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:17.814 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:17.814 05:27:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:17.814 05:27:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:17.814 05:27:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:17.814 05:27:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:17.814 05:27:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:17.814 05:27:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:17.814 05:27:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:17.814 05:27:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:17.814 05:27:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:17.814 05:27:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:17.814 05:27:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:17.814 05:27:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:17.814 05:27:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:17.814 05:27:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:17.814 05:27:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:17.814 05:27:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:17.814 05:27:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:17.814 05:27:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:17.814 05:27:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:17.814 05:27:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:17.814 05:27:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:17.814 05:27:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:17.814 05:27:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:17.814 05:27:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:17.814 05:27:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:17.814 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:17.814 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:31:17.814 00:31:17.814 --- 10.0.0.2 ping statistics --- 00:31:17.814 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:17.814 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:31:17.814 05:27:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:17.814 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:17.814 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.179 ms 00:31:17.814 00:31:17.814 --- 10.0.0.1 ping statistics --- 00:31:17.814 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:17.814 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:31:17.814 05:27:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:17.814 05:27:19 -- nvmf/common.sh@410 -- # return 0 00:31:17.814 05:27:19 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:17.814 05:27:19 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:18.751 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:18.751 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:18.751 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:18.751 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:18.751 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:18.751 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:18.751 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:18.751 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:18.751 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:18.751 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:18.751 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:18.751 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:18.751 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:18.751 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:18.751 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:18.751 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:18.752 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:19.012 05:27:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:19.012 05:27:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:19.012 05:27:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:19.012 05:27:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:19.012 05:27:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:19.012 05:27:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:19.012 05:27:20 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:19.012 05:27:20 -- target/dif.sh@137 -- # nvmfappstart 00:31:19.012 05:27:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:19.012 05:27:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:19.012 05:27:20 -- common/autotest_common.sh@10 -- # set +x 00:31:19.012 05:27:20 -- nvmf/common.sh@469 -- # nvmfpid=3439709 00:31:19.012 05:27:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:19.012 05:27:20 -- nvmf/common.sh@470 -- # waitforlisten 3439709 00:31:19.012 05:27:20 -- common/autotest_common.sh@829 -- # '[' -z 3439709 ']' 00:31:19.012 05:27:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:19.012 05:27:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:19.012 05:27:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:19.012 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:19.012 05:27:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:19.012 05:27:20 -- common/autotest_common.sh@10 -- # set +x 00:31:19.012 [2024-11-26 05:27:20.716651] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:19.012 [2024-11-26 05:27:20.716740] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:19.012 EAL: No free 2048 kB hugepages reported on node 1 00:31:19.273 [2024-11-26 05:27:20.784566] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:19.273 [2024-11-26 05:27:20.877758] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:19.273 [2024-11-26 05:27:20.877925] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:19.273 [2024-11-26 05:27:20.877944] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:19.273 [2024-11-26 05:27:20.877956] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:19.273 [2024-11-26 05:27:20.878001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:20.211 05:27:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:20.211 05:27:21 -- common/autotest_common.sh@862 -- # return 0 00:31:20.211 05:27:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:20.211 05:27:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:20.211 05:27:21 -- common/autotest_common.sh@10 -- # set +x 00:31:20.211 05:27:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:20.211 05:27:21 -- target/dif.sh@139 -- # create_transport 00:31:20.211 05:27:21 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:20.211 05:27:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.211 05:27:21 -- common/autotest_common.sh@10 -- # set +x 00:31:20.211 [2024-11-26 05:27:21.801569] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:20.211 05:27:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.211 05:27:21 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:20.211 05:27:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:20.211 05:27:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:20.211 05:27:21 -- common/autotest_common.sh@10 -- # set +x 00:31:20.211 ************************************ 00:31:20.211 START TEST fio_dif_1_default 00:31:20.211 ************************************ 00:31:20.211 05:27:21 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:20.211 05:27:21 -- target/dif.sh@86 -- # create_subsystems 0 00:31:20.211 05:27:21 -- target/dif.sh@28 -- # local sub 00:31:20.211 05:27:21 -- target/dif.sh@30 -- # for sub in "$@" 00:31:20.211 05:27:21 -- target/dif.sh@31 -- # create_subsystem 0 00:31:20.211 05:27:21 -- target/dif.sh@18 -- # local sub_id=0 00:31:20.211 05:27:21 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:20.211 05:27:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.211 05:27:21 -- common/autotest_common.sh@10 -- # set +x 00:31:20.211 bdev_null0 00:31:20.211 05:27:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.211 05:27:21 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:20.211 05:27:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.211 05:27:21 -- common/autotest_common.sh@10 -- # set +x 00:31:20.211 05:27:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.211 05:27:21 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:20.211 05:27:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.211 05:27:21 -- common/autotest_common.sh@10 -- # set +x 00:31:20.211 05:27:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.211 05:27:21 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:20.211 05:27:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.211 05:27:21 -- common/autotest_common.sh@10 -- # set +x 00:31:20.211 [2024-11-26 05:27:21.841909] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:20.211 05:27:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.211 05:27:21 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:20.211 05:27:21 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:20.211 05:27:21 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:20.211 05:27:21 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:20.211 05:27:21 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:20.211 05:27:21 -- nvmf/common.sh@520 -- # config=() 00:31:20.211 05:27:21 -- target/dif.sh@82 -- # gen_fio_conf 00:31:20.211 05:27:21 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:20.211 05:27:21 -- nvmf/common.sh@520 -- # local subsystem config 00:31:20.212 05:27:21 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:20.212 05:27:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:20.212 05:27:21 -- target/dif.sh@54 -- # local file 00:31:20.212 05:27:21 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:20.212 05:27:21 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:20.212 05:27:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:20.212 { 00:31:20.212 "params": { 00:31:20.212 "name": "Nvme$subsystem", 00:31:20.212 "trtype": "$TEST_TRANSPORT", 00:31:20.212 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:20.212 "adrfam": "ipv4", 00:31:20.212 "trsvcid": "$NVMF_PORT", 00:31:20.212 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:20.212 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:20.212 "hdgst": ${hdgst:-false}, 00:31:20.212 "ddgst": ${ddgst:-false} 00:31:20.212 }, 00:31:20.212 "method": "bdev_nvme_attach_controller" 00:31:20.212 } 00:31:20.212 EOF 00:31:20.212 )") 00:31:20.212 05:27:21 -- target/dif.sh@56 -- # cat 00:31:20.212 05:27:21 -- common/autotest_common.sh@1330 -- # shift 00:31:20.212 05:27:21 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:20.212 05:27:21 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:20.212 05:27:21 -- nvmf/common.sh@542 -- # cat 00:31:20.212 05:27:21 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:20.212 05:27:21 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:20.212 05:27:21 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:20.212 05:27:21 -- target/dif.sh@72 -- # (( file <= files )) 00:31:20.212 05:27:21 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:20.212 05:27:21 -- nvmf/common.sh@544 -- # jq . 00:31:20.212 05:27:21 -- nvmf/common.sh@545 -- # IFS=, 00:31:20.212 05:27:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:20.212 "params": { 00:31:20.212 "name": "Nvme0", 00:31:20.212 "trtype": "tcp", 00:31:20.212 "traddr": "10.0.0.2", 00:31:20.212 "adrfam": "ipv4", 00:31:20.212 "trsvcid": "4420", 00:31:20.212 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:20.212 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:20.212 "hdgst": false, 00:31:20.212 "ddgst": false 00:31:20.212 }, 00:31:20.212 "method": "bdev_nvme_attach_controller" 00:31:20.212 }' 00:31:20.212 05:27:21 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:20.212 05:27:21 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:20.212 05:27:21 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:20.212 05:27:21 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:20.212 05:27:21 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:20.212 05:27:21 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:20.212 05:27:21 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:20.212 05:27:21 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:20.212 05:27:21 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:20.212 05:27:21 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:20.472 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:20.472 fio-3.35 00:31:20.472 Starting 1 thread 00:31:20.472 EAL: No free 2048 kB hugepages reported on node 1 00:31:21.038 [2024-11-26 05:27:22.604565] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:21.038 [2024-11-26 05:27:22.604649] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:31.021 00:31:31.021 filename0: (groupid=0, jobs=1): err= 0: pid=3440029: Tue Nov 26 05:27:32 2024 00:31:31.021 read: IOPS=190, BW=760KiB/s (778kB/s)(7632KiB/10039msec) 00:31:31.021 slat (nsec): min=6587, max=53582, avg=8546.44, stdev=3386.20 00:31:31.021 clat (usec): min=623, max=42209, avg=21019.02, stdev=20244.30 00:31:31.021 lat (usec): min=629, max=42219, avg=21027.56, stdev=20244.50 00:31:31.021 clat percentiles (usec): 00:31:31.021 | 1.00th=[ 644], 5.00th=[ 660], 10.00th=[ 676], 20.00th=[ 742], 00:31:31.021 | 30.00th=[ 758], 40.00th=[ 775], 50.00th=[41157], 60.00th=[41157], 00:31:31.021 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:31.021 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:31:31.021 | 99.99th=[42206] 00:31:31.021 bw ( KiB/s): min= 704, max= 768, per=100.00%, avg=761.60, stdev=19.70, samples=20 00:31:31.021 iops : min= 176, max= 192, avg=190.40, stdev= 4.92, samples=20 00:31:31.021 lat (usec) : 750=23.85%, 1000=26.05% 00:31:31.021 lat (msec) : 50=50.10% 00:31:31.021 cpu : usr=91.75%, sys=7.96%, ctx=20, majf=0, minf=212 00:31:31.021 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:31.021 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:31.021 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:31.021 issued rwts: total=1908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:31.021 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:31.021 00:31:31.021 Run status group 0 (all jobs): 00:31:31.021 READ: bw=760KiB/s (778kB/s), 760KiB/s-760KiB/s (778kB/s-778kB/s), io=7632KiB (7815kB), run=10039-10039msec 00:31:31.281 05:27:32 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:31.281 05:27:32 -- target/dif.sh@43 -- # local sub 00:31:31.281 05:27:32 -- target/dif.sh@45 -- # for sub in "$@" 00:31:31.281 05:27:32 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:31.281 05:27:32 -- target/dif.sh@36 -- # local sub_id=0 00:31:31.281 05:27:32 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:31.281 05:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.281 05:27:32 -- common/autotest_common.sh@10 -- # set +x 00:31:31.281 05:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.281 05:27:32 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:31.281 05:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.281 05:27:32 -- common/autotest_common.sh@10 -- # set +x 00:31:31.281 05:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.281 00:31:31.281 real 0m11.171s 00:31:31.281 user 0m10.376s 00:31:31.281 sys 0m1.062s 00:31:31.281 05:27:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:31.281 05:27:32 -- common/autotest_common.sh@10 -- # set +x 00:31:31.281 ************************************ 00:31:31.281 END TEST fio_dif_1_default 00:31:31.281 ************************************ 00:31:31.281 05:27:33 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:31.281 05:27:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:31.281 05:27:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:31.281 05:27:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.281 ************************************ 00:31:31.281 START TEST fio_dif_1_multi_subsystems 00:31:31.281 ************************************ 00:31:31.281 05:27:33 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:31.281 05:27:33 -- target/dif.sh@92 -- # local files=1 00:31:31.281 05:27:33 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:31.281 05:27:33 -- target/dif.sh@28 -- # local sub 00:31:31.281 05:27:33 -- target/dif.sh@30 -- # for sub in "$@" 00:31:31.281 05:27:33 -- target/dif.sh@31 -- # create_subsystem 0 00:31:31.281 05:27:33 -- target/dif.sh@18 -- # local sub_id=0 00:31:31.281 05:27:33 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:31.281 05:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.281 05:27:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.281 bdev_null0 00:31:31.281 05:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.281 05:27:33 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:31.281 05:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.281 05:27:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.281 05:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.281 05:27:33 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:31.281 05:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.281 05:27:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.281 05:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.281 05:27:33 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:31.281 05:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.281 05:27:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.541 [2024-11-26 05:27:33.046511] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:31.541 05:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.541 05:27:33 -- target/dif.sh@30 -- # for sub in "$@" 00:31:31.541 05:27:33 -- target/dif.sh@31 -- # create_subsystem 1 00:31:31.541 05:27:33 -- target/dif.sh@18 -- # local sub_id=1 00:31:31.541 05:27:33 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:31.541 05:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.541 05:27:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.541 bdev_null1 00:31:31.541 05:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.541 05:27:33 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:31.541 05:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.541 05:27:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.541 05:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.541 05:27:33 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:31.541 05:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.541 05:27:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.541 05:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.541 05:27:33 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:31.541 05:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.541 05:27:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.541 05:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.541 05:27:33 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:31.541 05:27:33 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:31.541 05:27:33 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:31.541 05:27:33 -- nvmf/common.sh@520 -- # config=() 00:31:31.541 05:27:33 -- nvmf/common.sh@520 -- # local subsystem config 00:31:31.541 05:27:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:31.541 05:27:33 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:31.541 05:27:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:31.541 { 00:31:31.541 "params": { 00:31:31.541 "name": "Nvme$subsystem", 00:31:31.541 "trtype": "$TEST_TRANSPORT", 00:31:31.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:31.541 "adrfam": "ipv4", 00:31:31.541 "trsvcid": "$NVMF_PORT", 00:31:31.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:31.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:31.541 "hdgst": ${hdgst:-false}, 00:31:31.541 "ddgst": ${ddgst:-false} 00:31:31.541 }, 00:31:31.541 "method": "bdev_nvme_attach_controller" 00:31:31.541 } 00:31:31.541 EOF 00:31:31.541 )") 00:31:31.541 05:27:33 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:31.541 05:27:33 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:31.541 05:27:33 -- target/dif.sh@82 -- # gen_fio_conf 00:31:31.541 05:27:33 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:31.541 05:27:33 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:31.541 05:27:33 -- target/dif.sh@54 -- # local file 00:31:31.541 05:27:33 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:31.541 05:27:33 -- target/dif.sh@56 -- # cat 00:31:31.541 05:27:33 -- common/autotest_common.sh@1330 -- # shift 00:31:31.541 05:27:33 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:31.541 05:27:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:31.541 05:27:33 -- nvmf/common.sh@542 -- # cat 00:31:31.541 05:27:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:31.541 05:27:33 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:31.541 05:27:33 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:31.541 05:27:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:31.541 05:27:33 -- target/dif.sh@72 -- # (( file <= files )) 00:31:31.541 05:27:33 -- target/dif.sh@73 -- # cat 00:31:31.541 05:27:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:31.541 05:27:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:31.541 { 00:31:31.541 "params": { 00:31:31.541 "name": "Nvme$subsystem", 00:31:31.541 "trtype": "$TEST_TRANSPORT", 00:31:31.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:31.541 "adrfam": "ipv4", 00:31:31.542 "trsvcid": "$NVMF_PORT", 00:31:31.542 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:31.542 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:31.542 "hdgst": ${hdgst:-false}, 00:31:31.542 "ddgst": ${ddgst:-false} 00:31:31.542 }, 00:31:31.542 "method": "bdev_nvme_attach_controller" 00:31:31.542 } 00:31:31.542 EOF 00:31:31.542 )") 00:31:31.542 05:27:33 -- nvmf/common.sh@542 -- # cat 00:31:31.542 05:27:33 -- target/dif.sh@72 -- # (( file++ )) 00:31:31.542 05:27:33 -- target/dif.sh@72 -- # (( file <= files )) 00:31:31.542 05:27:33 -- nvmf/common.sh@544 -- # jq . 00:31:31.542 05:27:33 -- nvmf/common.sh@545 -- # IFS=, 00:31:31.542 05:27:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:31.542 "params": { 00:31:31.542 "name": "Nvme0", 00:31:31.542 "trtype": "tcp", 00:31:31.542 "traddr": "10.0.0.2", 00:31:31.542 "adrfam": "ipv4", 00:31:31.542 "trsvcid": "4420", 00:31:31.542 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:31.542 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:31.542 "hdgst": false, 00:31:31.542 "ddgst": false 00:31:31.542 }, 00:31:31.542 "method": "bdev_nvme_attach_controller" 00:31:31.542 },{ 00:31:31.542 "params": { 00:31:31.542 "name": "Nvme1", 00:31:31.542 "trtype": "tcp", 00:31:31.542 "traddr": "10.0.0.2", 00:31:31.542 "adrfam": "ipv4", 00:31:31.542 "trsvcid": "4420", 00:31:31.542 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:31.542 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:31.542 "hdgst": false, 00:31:31.542 "ddgst": false 00:31:31.542 }, 00:31:31.542 "method": "bdev_nvme_attach_controller" 00:31:31.542 }' 00:31:31.542 05:27:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:31.542 05:27:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:31.542 05:27:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:31.542 05:27:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:31.542 05:27:33 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:31.542 05:27:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:31.542 05:27:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:31.542 05:27:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:31.542 05:27:33 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:31.542 05:27:33 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:31.800 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:31.800 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:31.800 fio-3.35 00:31:31.800 Starting 2 threads 00:31:31.800 EAL: No free 2048 kB hugepages reported on node 1 00:31:32.368 [2024-11-26 05:27:34.065255] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:32.368 [2024-11-26 05:27:34.065324] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:44.578 00:31:44.578 filename0: (groupid=0, jobs=1): err= 0: pid=3441518: Tue Nov 26 05:27:44 2024 00:31:44.578 read: IOPS=189, BW=759KiB/s (777kB/s)(7616KiB/10039msec) 00:31:44.578 slat (nsec): min=7027, max=26838, avg=9421.24, stdev=2190.54 00:31:44.578 clat (usec): min=584, max=43895, avg=21061.18, stdev=20319.42 00:31:44.578 lat (usec): min=592, max=43906, avg=21070.61, stdev=20319.24 00:31:44.578 clat percentiles (usec): 00:31:44.578 | 1.00th=[ 611], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 644], 00:31:44.578 | 30.00th=[ 652], 40.00th=[ 668], 50.00th=[40633], 60.00th=[41157], 00:31:44.578 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:44.578 | 99.00th=[41157], 99.50th=[41157], 99.90th=[43779], 99.95th=[43779], 00:31:44.578 | 99.99th=[43779] 00:31:44.578 bw ( KiB/s): min= 672, max= 768, per=66.23%, avg=760.00, stdev=25.16, samples=20 00:31:44.578 iops : min= 168, max= 192, avg=190.00, stdev= 6.29, samples=20 00:31:44.578 lat (usec) : 750=47.48%, 1000=2.31% 00:31:44.578 lat (msec) : 50=50.21% 00:31:44.578 cpu : usr=95.19%, sys=4.53%, ctx=14, majf=0, minf=225 00:31:44.578 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:44.578 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.578 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.578 issued rwts: total=1904,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:44.578 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:44.578 filename1: (groupid=0, jobs=1): err= 0: pid=3441519: Tue Nov 26 05:27:44 2024 00:31:44.578 read: IOPS=97, BW=389KiB/s (399kB/s)(3904KiB/10029msec) 00:31:44.578 slat (nsec): min=6934, max=43910, avg=9685.69, stdev=2635.74 00:31:44.578 clat (usec): min=40711, max=43925, avg=41072.18, stdev=348.20 00:31:44.578 lat (usec): min=40720, max=43939, avg=41081.86, stdev=348.28 00:31:44.578 clat percentiles (usec): 00:31:44.578 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:44.578 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:44.578 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:31:44.578 | 99.00th=[42206], 99.50th=[42730], 99.90th=[43779], 99.95th=[43779], 00:31:44.578 | 99.99th=[43779] 00:31:44.578 bw ( KiB/s): min= 384, max= 416, per=33.81%, avg=388.80, stdev=11.72, samples=20 00:31:44.578 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:31:44.578 lat (msec) : 50=100.00% 00:31:44.578 cpu : usr=95.33%, sys=4.38%, ctx=14, majf=0, minf=74 00:31:44.578 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:44.578 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.578 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.578 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:44.578 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:44.578 00:31:44.578 Run status group 0 (all jobs): 00:31:44.578 READ: bw=1148KiB/s (1175kB/s), 389KiB/s-759KiB/s (399kB/s-777kB/s), io=11.2MiB (11.8MB), run=10029-10039msec 00:31:44.578 05:27:44 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:44.578 05:27:44 -- target/dif.sh@43 -- # local sub 00:31:44.578 05:27:44 -- target/dif.sh@45 -- # for sub in "$@" 00:31:44.578 05:27:44 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:44.578 05:27:44 -- target/dif.sh@36 -- # local sub_id=0 00:31:44.578 05:27:44 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:44.578 05:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.578 05:27:44 -- common/autotest_common.sh@10 -- # set +x 00:31:44.578 05:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.578 05:27:44 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:44.578 05:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.578 05:27:44 -- common/autotest_common.sh@10 -- # set +x 00:31:44.578 05:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.578 05:27:44 -- target/dif.sh@45 -- # for sub in "$@" 00:31:44.578 05:27:44 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:44.578 05:27:44 -- target/dif.sh@36 -- # local sub_id=1 00:31:44.578 05:27:44 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:44.578 05:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.578 05:27:44 -- common/autotest_common.sh@10 -- # set +x 00:31:44.578 05:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.578 05:27:44 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:44.578 05:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.578 05:27:44 -- common/autotest_common.sh@10 -- # set +x 00:31:44.578 05:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.578 00:31:44.578 real 0m11.446s 00:31:44.578 user 0m20.632s 00:31:44.578 sys 0m1.182s 00:31:44.578 05:27:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:44.578 05:27:44 -- common/autotest_common.sh@10 -- # set +x 00:31:44.578 ************************************ 00:31:44.578 END TEST fio_dif_1_multi_subsystems 00:31:44.578 ************************************ 00:31:44.578 05:27:44 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:44.578 05:27:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:44.578 05:27:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:44.578 05:27:44 -- common/autotest_common.sh@10 -- # set +x 00:31:44.578 ************************************ 00:31:44.578 START TEST fio_dif_rand_params 00:31:44.578 ************************************ 00:31:44.578 05:27:44 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:31:44.578 05:27:44 -- target/dif.sh@100 -- # local NULL_DIF 00:31:44.578 05:27:44 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:44.578 05:27:44 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:44.578 05:27:44 -- target/dif.sh@103 -- # bs=128k 00:31:44.578 05:27:44 -- target/dif.sh@103 -- # numjobs=3 00:31:44.578 05:27:44 -- target/dif.sh@103 -- # iodepth=3 00:31:44.578 05:27:44 -- target/dif.sh@103 -- # runtime=5 00:31:44.578 05:27:44 -- target/dif.sh@105 -- # create_subsystems 0 00:31:44.578 05:27:44 -- target/dif.sh@28 -- # local sub 00:31:44.578 05:27:44 -- target/dif.sh@30 -- # for sub in "$@" 00:31:44.578 05:27:44 -- target/dif.sh@31 -- # create_subsystem 0 00:31:44.578 05:27:44 -- target/dif.sh@18 -- # local sub_id=0 00:31:44.578 05:27:44 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:44.578 05:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.578 05:27:44 -- common/autotest_common.sh@10 -- # set +x 00:31:44.578 bdev_null0 00:31:44.578 05:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.578 05:27:44 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:44.578 05:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.578 05:27:44 -- common/autotest_common.sh@10 -- # set +x 00:31:44.578 05:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.578 05:27:44 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:44.578 05:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.578 05:27:44 -- common/autotest_common.sh@10 -- # set +x 00:31:44.578 05:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.578 05:27:44 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:44.578 05:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.578 05:27:44 -- common/autotest_common.sh@10 -- # set +x 00:31:44.578 [2024-11-26 05:27:44.515454] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:44.578 05:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.578 05:27:44 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:44.578 05:27:44 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:44.578 05:27:44 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:44.578 05:27:44 -- nvmf/common.sh@520 -- # config=() 00:31:44.578 05:27:44 -- nvmf/common.sh@520 -- # local subsystem config 00:31:44.578 05:27:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:44.578 05:27:44 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.578 05:27:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:44.578 { 00:31:44.578 "params": { 00:31:44.578 "name": "Nvme$subsystem", 00:31:44.578 "trtype": "$TEST_TRANSPORT", 00:31:44.578 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:44.578 "adrfam": "ipv4", 00:31:44.578 "trsvcid": "$NVMF_PORT", 00:31:44.578 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:44.579 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:44.579 "hdgst": ${hdgst:-false}, 00:31:44.579 "ddgst": ${ddgst:-false} 00:31:44.579 }, 00:31:44.579 "method": "bdev_nvme_attach_controller" 00:31:44.579 } 00:31:44.579 EOF 00:31:44.579 )") 00:31:44.579 05:27:44 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.579 05:27:44 -- target/dif.sh@82 -- # gen_fio_conf 00:31:44.579 05:27:44 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:44.579 05:27:44 -- target/dif.sh@54 -- # local file 00:31:44.579 05:27:44 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:44.579 05:27:44 -- target/dif.sh@56 -- # cat 00:31:44.579 05:27:44 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:44.579 05:27:44 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.579 05:27:44 -- common/autotest_common.sh@1330 -- # shift 00:31:44.579 05:27:44 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:44.579 05:27:44 -- nvmf/common.sh@542 -- # cat 00:31:44.579 05:27:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:44.579 05:27:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.579 05:27:44 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:44.579 05:27:44 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:44.579 05:27:44 -- target/dif.sh@72 -- # (( file <= files )) 00:31:44.579 05:27:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:44.579 05:27:44 -- nvmf/common.sh@544 -- # jq . 00:31:44.579 05:27:44 -- nvmf/common.sh@545 -- # IFS=, 00:31:44.579 05:27:44 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:44.579 "params": { 00:31:44.579 "name": "Nvme0", 00:31:44.579 "trtype": "tcp", 00:31:44.579 "traddr": "10.0.0.2", 00:31:44.579 "adrfam": "ipv4", 00:31:44.579 "trsvcid": "4420", 00:31:44.579 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:44.579 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:44.579 "hdgst": false, 00:31:44.579 "ddgst": false 00:31:44.579 }, 00:31:44.579 "method": "bdev_nvme_attach_controller" 00:31:44.579 }' 00:31:44.579 05:27:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:44.579 05:27:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:44.579 05:27:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:44.579 05:27:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.579 05:27:44 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:44.579 05:27:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:44.579 05:27:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:44.579 05:27:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:44.579 05:27:44 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:44.579 05:27:44 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.579 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:44.579 ... 00:31:44.579 fio-3.35 00:31:44.579 Starting 3 threads 00:31:44.579 EAL: No free 2048 kB hugepages reported on node 1 00:31:44.579 [2024-11-26 05:27:45.306735] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:44.579 [2024-11-26 05:27:45.306798] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:48.859 00:31:48.859 filename0: (groupid=0, jobs=1): err= 0: pid=3442956: Tue Nov 26 05:27:50 2024 00:31:48.859 read: IOPS=205, BW=25.6MiB/s (26.9MB/s)(129MiB/5046msec) 00:31:48.859 slat (nsec): min=4397, max=27028, avg=13174.86, stdev=1718.31 00:31:48.859 clat (usec): min=4759, max=90151, avg=14566.88, stdev=11653.21 00:31:48.859 lat (usec): min=4770, max=90164, avg=14580.06, stdev=11653.14 00:31:48.859 clat percentiles (usec): 00:31:48.859 | 1.00th=[ 5211], 5.00th=[ 7439], 10.00th=[ 8225], 20.00th=[ 9634], 00:31:48.859 | 30.00th=[10421], 40.00th=[11076], 50.00th=[11469], 60.00th=[11863], 00:31:48.859 | 70.00th=[12387], 80.00th=[13173], 90.00th=[15664], 95.00th=[50594], 00:31:48.859 | 99.00th=[53740], 99.50th=[54264], 99.90th=[57934], 99.95th=[89654], 00:31:48.859 | 99.99th=[89654] 00:31:48.859 bw ( KiB/s): min=20992, max=34048, per=30.28%, avg=26419.20, stdev=4291.85, samples=10 00:31:48.859 iops : min= 164, max= 266, avg=206.40, stdev=33.53, samples=10 00:31:48.859 lat (msec) : 10=23.38%, 20=67.83%, 50=2.71%, 100=6.09% 00:31:48.859 cpu : usr=93.32%, sys=6.18%, ctx=19, majf=0, minf=103 00:31:48.859 IO depths : 1=0.9%, 2=99.1%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:48.859 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:48.859 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:48.859 issued rwts: total=1035,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:48.859 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:48.859 filename0: (groupid=0, jobs=1): err= 0: pid=3442957: Tue Nov 26 05:27:50 2024 00:31:48.859 read: IOPS=243, BW=30.5MiB/s (31.9MB/s)(154MiB/5045msec) 00:31:48.859 slat (nsec): min=4352, max=29674, avg=13856.15, stdev=1862.67 00:31:48.859 clat (usec): min=4468, max=56411, avg=12262.35, stdev=7265.18 00:31:48.859 lat (usec): min=4480, max=56425, avg=12276.20, stdev=7265.19 00:31:48.859 clat percentiles (usec): 00:31:48.859 | 1.00th=[ 5145], 5.00th=[ 6390], 10.00th=[ 7570], 20.00th=[ 8356], 00:31:48.859 | 30.00th=[ 9241], 40.00th=[10552], 50.00th=[11469], 60.00th=[12256], 00:31:48.859 | 70.00th=[12911], 80.00th=[13829], 90.00th=[15008], 95.00th=[16188], 00:31:48.859 | 99.00th=[51643], 99.50th=[52691], 99.90th=[55313], 99.95th=[56361], 00:31:48.859 | 99.99th=[56361] 00:31:48.859 bw ( KiB/s): min=25138, max=36608, per=36.00%, avg=31416.20, stdev=3789.88, samples=10 00:31:48.859 iops : min= 196, max= 286, avg=245.40, stdev=29.68, samples=10 00:31:48.859 lat (msec) : 10=34.91%, 20=62.00%, 50=1.79%, 100=1.30% 00:31:48.859 cpu : usr=92.72%, sys=6.78%, ctx=8, majf=0, minf=113 00:31:48.859 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:48.859 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:48.859 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:48.859 issued rwts: total=1229,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:48.859 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:48.859 filename0: (groupid=0, jobs=1): err= 0: pid=3442958: Tue Nov 26 05:27:50 2024 00:31:48.859 read: IOPS=234, BW=29.4MiB/s (30.8MB/s)(147MiB/5005msec) 00:31:48.859 slat (nsec): min=4326, max=34131, avg=13338.77, stdev=1588.81 00:31:48.859 clat (usec): min=4703, max=56344, avg=12749.09, stdev=8730.99 00:31:48.859 lat (usec): min=4715, max=56358, avg=12762.43, stdev=8730.93 00:31:48.859 clat percentiles (usec): 00:31:48.859 | 1.00th=[ 5080], 5.00th=[ 5735], 10.00th=[ 7373], 20.00th=[ 8586], 00:31:48.859 | 30.00th=[ 9765], 40.00th=[10814], 50.00th=[11469], 60.00th=[12125], 00:31:48.859 | 70.00th=[12649], 80.00th=[13435], 90.00th=[14746], 95.00th=[17171], 00:31:48.859 | 99.00th=[53216], 99.50th=[54264], 99.90th=[55313], 99.95th=[56361], 00:31:48.859 | 99.99th=[56361] 00:31:48.859 bw ( KiB/s): min=20224, max=35072, per=34.42%, avg=30035.50, stdev=4711.03, samples=10 00:31:48.859 iops : min= 158, max= 274, avg=234.60, stdev=36.76, samples=10 00:31:48.859 lat (msec) : 10=32.06%, 20=63.27%, 50=1.87%, 100=2.81% 00:31:48.859 cpu : usr=93.29%, sys=6.18%, ctx=27, majf=0, minf=64 00:31:48.859 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:48.859 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:48.859 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:48.859 issued rwts: total=1176,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:48.859 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:48.859 00:31:48.859 Run status group 0 (all jobs): 00:31:48.859 READ: bw=85.2MiB/s (89.4MB/s), 25.6MiB/s-30.5MiB/s (26.9MB/s-31.9MB/s), io=430MiB (451MB), run=5005-5046msec 00:31:49.118 05:27:50 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:49.118 05:27:50 -- target/dif.sh@43 -- # local sub 00:31:49.118 05:27:50 -- target/dif.sh@45 -- # for sub in "$@" 00:31:49.118 05:27:50 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:49.118 05:27:50 -- target/dif.sh@36 -- # local sub_id=0 00:31:49.118 05:27:50 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:49.118 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.118 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.118 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.118 05:27:50 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:49.118 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.118 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.118 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.118 05:27:50 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:49.118 05:27:50 -- target/dif.sh@109 -- # bs=4k 00:31:49.118 05:27:50 -- target/dif.sh@109 -- # numjobs=8 00:31:49.118 05:27:50 -- target/dif.sh@109 -- # iodepth=16 00:31:49.118 05:27:50 -- target/dif.sh@109 -- # runtime= 00:31:49.118 05:27:50 -- target/dif.sh@109 -- # files=2 00:31:49.118 05:27:50 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:49.118 05:27:50 -- target/dif.sh@28 -- # local sub 00:31:49.118 05:27:50 -- target/dif.sh@30 -- # for sub in "$@" 00:31:49.118 05:27:50 -- target/dif.sh@31 -- # create_subsystem 0 00:31:49.118 05:27:50 -- target/dif.sh@18 -- # local sub_id=0 00:31:49.118 05:27:50 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:49.118 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.118 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.118 bdev_null0 00:31:49.118 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.118 05:27:50 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:49.118 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.118 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.118 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.118 05:27:50 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:49.118 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.118 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.118 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.118 05:27:50 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:49.118 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.118 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.118 [2024-11-26 05:27:50.693945] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:49.118 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.118 05:27:50 -- target/dif.sh@30 -- # for sub in "$@" 00:31:49.118 05:27:50 -- target/dif.sh@31 -- # create_subsystem 1 00:31:49.118 05:27:50 -- target/dif.sh@18 -- # local sub_id=1 00:31:49.118 05:27:50 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:49.118 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.118 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.119 bdev_null1 00:31:49.119 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.119 05:27:50 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:49.119 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.119 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.119 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.119 05:27:50 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:49.119 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.119 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.119 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.119 05:27:50 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:49.119 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.119 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.119 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.119 05:27:50 -- target/dif.sh@30 -- # for sub in "$@" 00:31:49.119 05:27:50 -- target/dif.sh@31 -- # create_subsystem 2 00:31:49.119 05:27:50 -- target/dif.sh@18 -- # local sub_id=2 00:31:49.119 05:27:50 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:49.119 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.119 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.119 bdev_null2 00:31:49.119 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.119 05:27:50 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:49.119 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.119 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.119 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.119 05:27:50 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:49.119 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.119 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.119 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.119 05:27:50 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:49.119 05:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.119 05:27:50 -- common/autotest_common.sh@10 -- # set +x 00:31:49.119 05:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.119 05:27:50 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:49.119 05:27:50 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:49.119 05:27:50 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:49.119 05:27:50 -- nvmf/common.sh@520 -- # config=() 00:31:49.119 05:27:50 -- nvmf/common.sh@520 -- # local subsystem config 00:31:49.119 05:27:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:49.119 05:27:50 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:49.119 05:27:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:49.119 { 00:31:49.119 "params": { 00:31:49.119 "name": "Nvme$subsystem", 00:31:49.119 "trtype": "$TEST_TRANSPORT", 00:31:49.119 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:49.119 "adrfam": "ipv4", 00:31:49.119 "trsvcid": "$NVMF_PORT", 00:31:49.119 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:49.119 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:49.119 "hdgst": ${hdgst:-false}, 00:31:49.119 "ddgst": ${ddgst:-false} 00:31:49.119 }, 00:31:49.119 "method": "bdev_nvme_attach_controller" 00:31:49.119 } 00:31:49.119 EOF 00:31:49.119 )") 00:31:49.119 05:27:50 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:49.119 05:27:50 -- target/dif.sh@82 -- # gen_fio_conf 00:31:49.119 05:27:50 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:49.119 05:27:50 -- target/dif.sh@54 -- # local file 00:31:49.119 05:27:50 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:49.119 05:27:50 -- target/dif.sh@56 -- # cat 00:31:49.119 05:27:50 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:49.119 05:27:50 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:49.119 05:27:50 -- common/autotest_common.sh@1330 -- # shift 00:31:49.119 05:27:50 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:49.119 05:27:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:49.119 05:27:50 -- nvmf/common.sh@542 -- # cat 00:31:49.119 05:27:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:49.119 05:27:50 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:49.119 05:27:50 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:49.119 05:27:50 -- target/dif.sh@72 -- # (( file <= files )) 00:31:49.119 05:27:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:49.119 05:27:50 -- target/dif.sh@73 -- # cat 00:31:49.119 05:27:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:49.119 05:27:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:49.119 { 00:31:49.119 "params": { 00:31:49.119 "name": "Nvme$subsystem", 00:31:49.119 "trtype": "$TEST_TRANSPORT", 00:31:49.119 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:49.119 "adrfam": "ipv4", 00:31:49.119 "trsvcid": "$NVMF_PORT", 00:31:49.119 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:49.119 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:49.119 "hdgst": ${hdgst:-false}, 00:31:49.119 "ddgst": ${ddgst:-false} 00:31:49.119 }, 00:31:49.119 "method": "bdev_nvme_attach_controller" 00:31:49.119 } 00:31:49.119 EOF 00:31:49.119 )") 00:31:49.119 05:27:50 -- nvmf/common.sh@542 -- # cat 00:31:49.119 05:27:50 -- target/dif.sh@72 -- # (( file++ )) 00:31:49.119 05:27:50 -- target/dif.sh@72 -- # (( file <= files )) 00:31:49.119 05:27:50 -- target/dif.sh@73 -- # cat 00:31:49.119 05:27:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:49.119 05:27:50 -- target/dif.sh@72 -- # (( file++ )) 00:31:49.119 05:27:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:49.119 { 00:31:49.119 "params": { 00:31:49.119 "name": "Nvme$subsystem", 00:31:49.119 "trtype": "$TEST_TRANSPORT", 00:31:49.119 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:49.119 "adrfam": "ipv4", 00:31:49.119 "trsvcid": "$NVMF_PORT", 00:31:49.119 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:49.119 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:49.119 "hdgst": ${hdgst:-false}, 00:31:49.119 "ddgst": ${ddgst:-false} 00:31:49.119 }, 00:31:49.119 "method": "bdev_nvme_attach_controller" 00:31:49.119 } 00:31:49.119 EOF 00:31:49.119 )") 00:31:49.119 05:27:50 -- target/dif.sh@72 -- # (( file <= files )) 00:31:49.119 05:27:50 -- nvmf/common.sh@542 -- # cat 00:31:49.119 05:27:50 -- nvmf/common.sh@544 -- # jq . 00:31:49.119 05:27:50 -- nvmf/common.sh@545 -- # IFS=, 00:31:49.119 05:27:50 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:49.119 "params": { 00:31:49.119 "name": "Nvme0", 00:31:49.119 "trtype": "tcp", 00:31:49.119 "traddr": "10.0.0.2", 00:31:49.119 "adrfam": "ipv4", 00:31:49.119 "trsvcid": "4420", 00:31:49.119 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:49.119 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:49.119 "hdgst": false, 00:31:49.119 "ddgst": false 00:31:49.119 }, 00:31:49.119 "method": "bdev_nvme_attach_controller" 00:31:49.119 },{ 00:31:49.119 "params": { 00:31:49.119 "name": "Nvme1", 00:31:49.119 "trtype": "tcp", 00:31:49.119 "traddr": "10.0.0.2", 00:31:49.119 "adrfam": "ipv4", 00:31:49.119 "trsvcid": "4420", 00:31:49.119 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:49.119 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:49.119 "hdgst": false, 00:31:49.119 "ddgst": false 00:31:49.119 }, 00:31:49.119 "method": "bdev_nvme_attach_controller" 00:31:49.119 },{ 00:31:49.119 "params": { 00:31:49.119 "name": "Nvme2", 00:31:49.119 "trtype": "tcp", 00:31:49.119 "traddr": "10.0.0.2", 00:31:49.119 "adrfam": "ipv4", 00:31:49.119 "trsvcid": "4420", 00:31:49.119 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:49.119 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:49.119 "hdgst": false, 00:31:49.119 "ddgst": false 00:31:49.119 }, 00:31:49.119 "method": "bdev_nvme_attach_controller" 00:31:49.119 }' 00:31:49.119 05:27:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:49.119 05:27:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:49.119 05:27:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:49.119 05:27:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:49.119 05:27:50 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:49.119 05:27:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:49.119 05:27:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:49.119 05:27:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:49.119 05:27:50 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:49.119 05:27:50 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:49.378 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:49.378 ... 00:31:49.378 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:49.378 ... 00:31:49.378 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:49.378 ... 00:31:49.378 fio-3.35 00:31:49.378 Starting 24 threads 00:31:49.378 EAL: No free 2048 kB hugepages reported on node 1 00:31:50.317 [2024-11-26 05:27:51.783769] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:50.317 [2024-11-26 05:27:51.783864] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:00.349 00:32:00.349 filename0: (groupid=0, jobs=1): err= 0: pid=3443722: Tue Nov 26 05:28:02 2024 00:32:00.349 read: IOPS=49, BW=200KiB/s (205kB/s)(2032KiB/10161msec) 00:32:00.349 slat (usec): min=8, max=139, avg=41.88, stdev=42.38 00:32:00.349 clat (msec): min=134, max=557, avg=318.24, stdev=49.27 00:32:00.349 lat (msec): min=134, max=557, avg=318.29, stdev=49.29 00:32:00.349 clat percentiles (msec): 00:32:00.349 | 1.00th=[ 222], 5.00th=[ 239], 10.00th=[ 271], 20.00th=[ 284], 00:32:00.349 | 30.00th=[ 296], 40.00th=[ 305], 50.00th=[ 317], 60.00th=[ 326], 00:32:00.349 | 70.00th=[ 338], 80.00th=[ 342], 90.00th=[ 409], 95.00th=[ 409], 00:32:00.349 | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 558], 99.95th=[ 558], 00:32:00.349 | 99.99th=[ 558] 00:32:00.349 bw ( KiB/s): min= 128, max= 256, per=4.10%, avg=196.80, stdev=62.31, samples=20 00:32:00.349 iops : min= 32, max= 64, avg=49.20, stdev=15.58, samples=20 00:32:00.349 lat (msec) : 250=5.51%, 500=94.09%, 750=0.39% 00:32:00.349 cpu : usr=98.74%, sys=0.73%, ctx=16, majf=0, minf=84 00:32:00.349 IO depths : 1=2.8%, 2=8.1%, 4=22.0%, 8=57.3%, 16=9.8%, 32=0.0%, >=64=0.0% 00:32:00.350 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 complete : 0=0.0%, 4=93.2%, 8=1.3%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 issued rwts: total=508,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.350 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.350 filename0: (groupid=0, jobs=1): err= 0: pid=3443723: Tue Nov 26 05:28:02 2024 00:32:00.350 read: IOPS=50, BW=200KiB/s (205kB/s)(2032KiB/10156msec) 00:32:00.350 slat (nsec): min=4929, max=54526, avg=13475.23, stdev=7447.18 00:32:00.350 clat (msec): min=202, max=543, avg=318.91, stdev=55.32 00:32:00.350 lat (msec): min=202, max=543, avg=318.93, stdev=55.33 00:32:00.350 clat percentiles (msec): 00:32:00.350 | 1.00th=[ 203], 5.00th=[ 224], 10.00th=[ 271], 20.00th=[ 284], 00:32:00.350 | 30.00th=[ 292], 40.00th=[ 300], 50.00th=[ 309], 60.00th=[ 326], 00:32:00.350 | 70.00th=[ 334], 80.00th=[ 342], 90.00th=[ 409], 95.00th=[ 418], 00:32:00.350 | 99.00th=[ 506], 99.50th=[ 523], 99.90th=[ 542], 99.95th=[ 542], 00:32:00.350 | 99.99th=[ 542] 00:32:00.350 bw ( KiB/s): min= 128, max= 256, per=4.10%, avg=196.80, stdev=53.97, samples=20 00:32:00.350 iops : min= 32, max= 64, avg=49.20, stdev=13.49, samples=20 00:32:00.350 lat (msec) : 250=7.87%, 500=90.94%, 750=1.18% 00:32:00.350 cpu : usr=98.90%, sys=0.72%, ctx=16, majf=0, minf=53 00:32:00.350 IO depths : 1=1.4%, 2=4.7%, 4=16.1%, 8=66.5%, 16=11.2%, 32=0.0%, >=64=0.0% 00:32:00.350 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 complete : 0=0.0%, 4=91.5%, 8=3.0%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 issued rwts: total=508,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.350 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.350 filename0: (groupid=0, jobs=1): err= 0: pid=3443724: Tue Nov 26 05:28:02 2024 00:32:00.350 read: IOPS=54, BW=217KiB/s (222kB/s)(2200KiB/10161msec) 00:32:00.350 slat (nsec): min=7974, max=52531, avg=12497.80, stdev=6298.18 00:32:00.350 clat (msec): min=196, max=441, avg=294.78, stdev=51.99 00:32:00.350 lat (msec): min=196, max=441, avg=294.79, stdev=51.99 00:32:00.350 clat percentiles (msec): 00:32:00.350 | 1.00th=[ 197], 5.00th=[ 205], 10.00th=[ 222], 20.00th=[ 251], 00:32:00.350 | 30.00th=[ 268], 40.00th=[ 275], 50.00th=[ 296], 60.00th=[ 313], 00:32:00.350 | 70.00th=[ 317], 80.00th=[ 334], 90.00th=[ 347], 95.00th=[ 414], 00:32:00.350 | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 443], 99.95th=[ 443], 00:32:00.350 | 99.99th=[ 443] 00:32:00.350 bw ( KiB/s): min= 128, max= 256, per=4.46%, avg=213.60, stdev=52.24, samples=20 00:32:00.350 iops : min= 32, max= 64, avg=53.40, stdev=13.06, samples=20 00:32:00.350 lat (msec) : 250=18.91%, 500=81.09% 00:32:00.350 cpu : usr=98.47%, sys=0.94%, ctx=48, majf=0, minf=56 00:32:00.350 IO depths : 1=2.5%, 2=7.6%, 4=21.5%, 8=58.4%, 16=10.0%, 32=0.0%, >=64=0.0% 00:32:00.350 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 complete : 0=0.0%, 4=93.1%, 8=1.3%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 issued rwts: total=550,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.350 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.350 filename0: (groupid=0, jobs=1): err= 0: pid=3443725: Tue Nov 26 05:28:02 2024 00:32:00.350 read: IOPS=39, BW=158KiB/s (162kB/s)(1600KiB/10124msec) 00:32:00.350 slat (usec): min=8, max=117, avg=27.05, stdev=24.37 00:32:00.350 clat (msec): min=195, max=616, avg=404.74, stdev=80.89 00:32:00.350 lat (msec): min=195, max=616, avg=404.77, stdev=80.88 00:32:00.350 clat percentiles (msec): 00:32:00.350 | 1.00th=[ 199], 5.00th=[ 275], 10.00th=[ 288], 20.00th=[ 334], 00:32:00.350 | 30.00th=[ 355], 40.00th=[ 397], 50.00th=[ 405], 60.00th=[ 430], 00:32:00.350 | 70.00th=[ 447], 80.00th=[ 481], 90.00th=[ 502], 95.00th=[ 542], 00:32:00.350 | 99.00th=[ 584], 99.50th=[ 600], 99.90th=[ 617], 99.95th=[ 617], 00:32:00.350 | 99.99th=[ 617] 00:32:00.350 bw ( KiB/s): min= 112, max= 256, per=3.20%, avg=153.60, stdev=49.08, samples=20 00:32:00.350 iops : min= 28, max= 64, avg=38.40, stdev=12.27, samples=20 00:32:00.350 lat (msec) : 250=1.00%, 500=88.00%, 750=11.00% 00:32:00.350 cpu : usr=98.47%, sys=0.87%, ctx=27, majf=0, minf=51 00:32:00.350 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.2%, 32=0.0%, >=64=0.0% 00:32:00.350 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.350 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.350 filename0: (groupid=0, jobs=1): err= 0: pid=3443726: Tue Nov 26 05:28:02 2024 00:32:00.350 read: IOPS=49, BW=198KiB/s (203kB/s)(2008KiB/10148msec) 00:32:00.350 slat (usec): min=8, max=156, avg=19.61, stdev=24.31 00:32:00.350 clat (msec): min=200, max=516, avg=322.75, stdev=61.97 00:32:00.350 lat (msec): min=200, max=516, avg=322.77, stdev=61.98 00:32:00.350 clat percentiles (msec): 00:32:00.350 | 1.00th=[ 203], 5.00th=[ 207], 10.00th=[ 259], 20.00th=[ 279], 00:32:00.350 | 30.00th=[ 292], 40.00th=[ 300], 50.00th=[ 313], 60.00th=[ 326], 00:32:00.350 | 70.00th=[ 338], 80.00th=[ 347], 90.00th=[ 409], 95.00th=[ 464], 00:32:00.350 | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 518], 99.95th=[ 518], 00:32:00.350 | 99.99th=[ 518] 00:32:00.350 bw ( KiB/s): min= 128, max= 256, per=4.06%, avg=194.40, stdev=61.04, samples=20 00:32:00.350 iops : min= 32, max= 64, avg=48.60, stdev=15.26, samples=20 00:32:00.350 lat (msec) : 250=5.18%, 500=94.42%, 750=0.40% 00:32:00.350 cpu : usr=98.79%, sys=0.76%, ctx=23, majf=0, minf=56 00:32:00.350 IO depths : 1=2.8%, 2=8.2%, 4=22.3%, 8=57.0%, 16=9.8%, 32=0.0%, >=64=0.0% 00:32:00.350 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 complete : 0=0.0%, 4=93.3%, 8=1.1%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 issued rwts: total=502,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.350 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.350 filename0: (groupid=0, jobs=1): err= 0: pid=3443727: Tue Nov 26 05:28:02 2024 00:32:00.350 read: IOPS=54, BW=220KiB/s (225kB/s)(2232KiB/10161msec) 00:32:00.350 slat (usec): min=7, max=115, avg=20.43, stdev=24.07 00:32:00.350 clat (msec): min=134, max=448, avg=290.83, stdev=51.40 00:32:00.350 lat (msec): min=134, max=449, avg=290.85, stdev=51.40 00:32:00.350 clat percentiles (msec): 00:32:00.350 | 1.00th=[ 161], 5.00th=[ 199], 10.00th=[ 222], 20.00th=[ 253], 00:32:00.350 | 30.00th=[ 275], 40.00th=[ 279], 50.00th=[ 292], 60.00th=[ 305], 00:32:00.350 | 70.00th=[ 313], 80.00th=[ 334], 90.00th=[ 342], 95.00th=[ 384], 00:32:00.350 | 99.00th=[ 418], 99.50th=[ 426], 99.90th=[ 451], 99.95th=[ 451], 00:32:00.350 | 99.99th=[ 451] 00:32:00.350 bw ( KiB/s): min= 128, max= 256, per=4.52%, avg=216.80, stdev=56.50, samples=20 00:32:00.350 iops : min= 32, max= 64, avg=54.20, stdev=14.13, samples=20 00:32:00.350 lat (msec) : 250=19.00%, 500=81.00% 00:32:00.350 cpu : usr=98.55%, sys=0.89%, ctx=29, majf=0, minf=64 00:32:00.350 IO depths : 1=0.9%, 2=7.2%, 4=25.1%, 8=55.4%, 16=11.5%, 32=0.0%, >=64=0.0% 00:32:00.350 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 issued rwts: total=558,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.350 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.350 filename0: (groupid=0, jobs=1): err= 0: pid=3443728: Tue Nov 26 05:28:02 2024 00:32:00.350 read: IOPS=59, BW=239KiB/s (245kB/s)(2432KiB/10171msec) 00:32:00.350 slat (usec): min=4, max=143, avg=24.13, stdev=28.19 00:32:00.350 clat (msec): min=6, max=397, avg=263.58, stdev=96.34 00:32:00.350 lat (msec): min=6, max=397, avg=263.61, stdev=96.35 00:32:00.350 clat percentiles (msec): 00:32:00.350 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 33], 20.00th=[ 245], 00:32:00.350 | 30.00th=[ 271], 40.00th=[ 279], 50.00th=[ 288], 60.00th=[ 300], 00:32:00.350 | 70.00th=[ 313], 80.00th=[ 326], 90.00th=[ 338], 95.00th=[ 347], 00:32:00.350 | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], 00:32:00.350 | 99.99th=[ 397] 00:32:00.350 bw ( KiB/s): min= 128, max= 768, per=5.07%, avg=242.40, stdev=134.30, samples=20 00:32:00.350 iops : min= 32, max= 192, avg=60.60, stdev=33.57, samples=20 00:32:00.350 lat (msec) : 10=7.89%, 50=2.63%, 250=10.53%, 500=78.95% 00:32:00.350 cpu : usr=98.75%, sys=0.79%, ctx=26, majf=0, minf=33 00:32:00.350 IO depths : 1=2.3%, 2=7.9%, 4=22.4%, 8=56.9%, 16=10.5%, 32=0.0%, >=64=0.0% 00:32:00.350 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 complete : 0=0.0%, 4=93.8%, 8=0.9%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.350 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.350 filename0: (groupid=0, jobs=1): err= 0: pid=3443729: Tue Nov 26 05:28:02 2024 00:32:00.350 read: IOPS=39, BW=158KiB/s (162kB/s)(1600KiB/10143msec) 00:32:00.350 slat (nsec): min=8263, max=90406, avg=19136.82, stdev=13954.26 00:32:00.350 clat (msec): min=185, max=653, avg=405.54, stdev=86.20 00:32:00.350 lat (msec): min=185, max=653, avg=405.56, stdev=86.20 00:32:00.350 clat percentiles (msec): 00:32:00.350 | 1.00th=[ 197], 5.00th=[ 275], 10.00th=[ 284], 20.00th=[ 317], 00:32:00.350 | 30.00th=[ 355], 40.00th=[ 397], 50.00th=[ 405], 60.00th=[ 430], 00:32:00.350 | 70.00th=[ 456], 80.00th=[ 485], 90.00th=[ 502], 95.00th=[ 535], 00:32:00.350 | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 651], 99.95th=[ 651], 00:32:00.350 | 99.99th=[ 651] 00:32:00.350 bw ( KiB/s): min= 112, max= 256, per=3.20%, avg=153.60, stdev=49.08, samples=20 00:32:00.350 iops : min= 28, max= 64, avg=38.40, stdev=12.27, samples=20 00:32:00.350 lat (msec) : 250=1.50%, 500=87.50%, 750=11.00% 00:32:00.350 cpu : usr=98.48%, sys=0.91%, ctx=26, majf=0, minf=61 00:32:00.350 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.2%, 32=0.0%, >=64=0.0% 00:32:00.350 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.350 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.350 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.350 filename1: (groupid=0, jobs=1): err= 0: pid=3443730: Tue Nov 26 05:28:02 2024 00:32:00.350 read: IOPS=46, BW=185KiB/s (190kB/s)(1880KiB/10149msec) 00:32:00.350 slat (usec): min=8, max=132, avg=20.97, stdev=21.08 00:32:00.350 clat (msec): min=205, max=667, avg=344.43, stdev=79.43 00:32:00.350 lat (msec): min=205, max=667, avg=344.45, stdev=79.43 00:32:00.350 clat percentiles (msec): 00:32:00.350 | 1.00th=[ 207], 5.00th=[ 264], 10.00th=[ 271], 20.00th=[ 284], 00:32:00.350 | 30.00th=[ 292], 40.00th=[ 300], 50.00th=[ 326], 60.00th=[ 330], 00:32:00.351 | 70.00th=[ 384], 80.00th=[ 418], 90.00th=[ 451], 95.00th=[ 493], 00:32:00.351 | 99.00th=[ 550], 99.50th=[ 651], 99.90th=[ 667], 99.95th=[ 667], 00:32:00.351 | 99.99th=[ 667] 00:32:00.351 bw ( KiB/s): min= 112, max= 256, per=3.79%, avg=181.60, stdev=60.60, samples=20 00:32:00.351 iops : min= 28, max= 64, avg=45.40, stdev=15.15, samples=20 00:32:00.351 lat (msec) : 250=1.28%, 500=94.89%, 750=3.83% 00:32:00.351 cpu : usr=98.48%, sys=0.92%, ctx=56, majf=0, minf=45 00:32:00.351 IO depths : 1=2.8%, 2=8.1%, 4=22.1%, 8=57.2%, 16=9.8%, 32=0.0%, >=64=0.0% 00:32:00.351 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 complete : 0=0.0%, 4=93.2%, 8=1.2%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 issued rwts: total=470,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.351 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.351 filename1: (groupid=0, jobs=1): err= 0: pid=3443731: Tue Nov 26 05:28:02 2024 00:32:00.351 read: IOPS=48, BW=194KiB/s (198kB/s)(1968KiB/10161msec) 00:32:00.351 slat (usec): min=7, max=127, avg=46.30, stdev=42.15 00:32:00.351 clat (msec): min=213, max=561, avg=329.05, stdev=61.58 00:32:00.351 lat (msec): min=213, max=562, avg=329.10, stdev=61.60 00:32:00.351 clat percentiles (msec): 00:32:00.351 | 1.00th=[ 213], 5.00th=[ 253], 10.00th=[ 255], 20.00th=[ 284], 00:32:00.351 | 30.00th=[ 300], 40.00th=[ 309], 50.00th=[ 326], 60.00th=[ 334], 00:32:00.351 | 70.00th=[ 342], 80.00th=[ 384], 90.00th=[ 418], 95.00th=[ 422], 00:32:00.351 | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 558], 99.95th=[ 558], 00:32:00.351 | 99.99th=[ 558] 00:32:00.351 bw ( KiB/s): min= 128, max= 256, per=3.98%, avg=190.40, stdev=59.62, samples=20 00:32:00.351 iops : min= 32, max= 64, avg=47.60, stdev=14.90, samples=20 00:32:00.351 lat (msec) : 250=4.47%, 500=95.12%, 750=0.41% 00:32:00.351 cpu : usr=98.61%, sys=0.95%, ctx=16, majf=0, minf=42 00:32:00.351 IO depths : 1=3.3%, 2=8.3%, 4=21.3%, 8=57.7%, 16=9.3%, 32=0.0%, >=64=0.0% 00:32:00.351 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 complete : 0=0.0%, 4=92.9%, 8=1.5%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 issued rwts: total=492,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.351 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.351 filename1: (groupid=0, jobs=1): err= 0: pid=3443732: Tue Nov 26 05:28:02 2024 00:32:00.351 read: IOPS=39, BW=158KiB/s (162kB/s)(1600KiB/10144msec) 00:32:00.351 slat (usec): min=8, max=139, avg=51.76, stdev=42.82 00:32:00.351 clat (msec): min=196, max=654, avg=405.26, stdev=79.33 00:32:00.351 lat (msec): min=196, max=654, avg=405.31, stdev=79.31 00:32:00.351 clat percentiles (msec): 00:32:00.351 | 1.00th=[ 201], 5.00th=[ 284], 10.00th=[ 300], 20.00th=[ 317], 00:32:00.351 | 30.00th=[ 359], 40.00th=[ 397], 50.00th=[ 405], 60.00th=[ 422], 00:32:00.351 | 70.00th=[ 456], 80.00th=[ 485], 90.00th=[ 498], 95.00th=[ 535], 00:32:00.351 | 99.00th=[ 592], 99.50th=[ 600], 99.90th=[ 659], 99.95th=[ 659], 00:32:00.351 | 99.99th=[ 659] 00:32:00.351 bw ( KiB/s): min= 128, max= 256, per=3.20%, avg=153.60, stdev=50.70, samples=20 00:32:00.351 iops : min= 32, max= 64, avg=38.40, stdev=12.68, samples=20 00:32:00.351 lat (msec) : 250=1.00%, 500=90.00%, 750=9.00% 00:32:00.351 cpu : usr=98.85%, sys=0.63%, ctx=20, majf=0, minf=47 00:32:00.351 IO depths : 1=5.0%, 2=11.2%, 4=25.0%, 8=51.2%, 16=7.5%, 32=0.0%, >=64=0.0% 00:32:00.351 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.351 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.351 filename1: (groupid=0, jobs=1): err= 0: pid=3443733: Tue Nov 26 05:28:02 2024 00:32:00.351 read: IOPS=40, BW=164KiB/s (168kB/s)(1664KiB/10148msec) 00:32:00.351 slat (usec): min=4, max=125, avg=76.50, stdev=36.71 00:32:00.351 clat (msec): min=184, max=672, avg=389.62, stdev=89.46 00:32:00.351 lat (msec): min=184, max=672, avg=389.70, stdev=89.46 00:32:00.351 clat percentiles (msec): 00:32:00.351 | 1.00th=[ 186], 5.00th=[ 268], 10.00th=[ 279], 20.00th=[ 326], 00:32:00.351 | 30.00th=[ 330], 40.00th=[ 384], 50.00th=[ 401], 60.00th=[ 409], 00:32:00.351 | 70.00th=[ 447], 80.00th=[ 477], 90.00th=[ 493], 95.00th=[ 542], 00:32:00.351 | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 676], 99.95th=[ 676], 00:32:00.351 | 99.99th=[ 676] 00:32:00.351 bw ( KiB/s): min= 112, max= 256, per=3.35%, avg=160.00, stdev=53.70, samples=20 00:32:00.351 iops : min= 28, max= 64, avg=40.00, stdev=13.42, samples=20 00:32:00.351 lat (msec) : 250=4.33%, 500=87.98%, 750=7.69% 00:32:00.351 cpu : usr=98.08%, sys=1.09%, ctx=68, majf=0, minf=35 00:32:00.351 IO depths : 1=4.8%, 2=11.1%, 4=25.0%, 8=51.4%, 16=7.7%, 32=0.0%, >=64=0.0% 00:32:00.351 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 issued rwts: total=416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.351 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.351 filename1: (groupid=0, jobs=1): err= 0: pid=3443734: Tue Nov 26 05:28:02 2024 00:32:00.351 read: IOPS=58, BW=233KiB/s (238kB/s)(2368KiB/10172msec) 00:32:00.351 slat (usec): min=4, max=130, avg=36.47, stdev=36.97 00:32:00.351 clat (msec): min=3, max=435, avg=270.64, stdev=113.87 00:32:00.351 lat (msec): min=3, max=435, avg=270.67, stdev=113.88 00:32:00.351 clat percentiles (msec): 00:32:00.351 | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 271], 00:32:00.351 | 30.00th=[ 279], 40.00th=[ 292], 50.00th=[ 305], 60.00th=[ 313], 00:32:00.351 | 70.00th=[ 330], 80.00th=[ 338], 90.00th=[ 359], 95.00th=[ 397], 00:32:00.351 | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 435], 99.95th=[ 435], 00:32:00.351 | 99.99th=[ 435] 00:32:00.351 bw ( KiB/s): min= 128, max= 896, per=4.92%, avg=236.00, stdev=165.78, samples=20 00:32:00.351 iops : min= 32, max= 224, avg=59.00, stdev=41.44, samples=20 00:32:00.351 lat (msec) : 4=2.70%, 10=8.11%, 50=2.70%, 250=5.41%, 500=81.08% 00:32:00.351 cpu : usr=98.63%, sys=0.95%, ctx=23, majf=0, minf=42 00:32:00.351 IO depths : 1=3.5%, 2=9.8%, 4=25.0%, 8=52.7%, 16=9.0%, 32=0.0%, >=64=0.0% 00:32:00.351 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.351 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.351 filename1: (groupid=0, jobs=1): err= 0: pid=3443735: Tue Nov 26 05:28:02 2024 00:32:00.351 read: IOPS=61, BW=245KiB/s (251kB/s)(2496KiB/10170msec) 00:32:00.351 slat (nsec): min=3827, max=98213, avg=13395.63, stdev=11203.64 00:32:00.351 clat (msec): min=21, max=363, avg=256.89, stdev=74.71 00:32:00.351 lat (msec): min=21, max=363, avg=256.90, stdev=74.70 00:32:00.351 clat percentiles (msec): 00:32:00.351 | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 165], 20.00th=[ 215], 00:32:00.351 | 30.00th=[ 241], 40.00th=[ 264], 50.00th=[ 275], 60.00th=[ 288], 00:32:00.351 | 70.00th=[ 300], 80.00th=[ 313], 90.00th=[ 334], 95.00th=[ 338], 00:32:00.351 | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 363], 99.95th=[ 363], 00:32:00.351 | 99.99th=[ 363] 00:32:00.351 bw ( KiB/s): min= 128, max= 513, per=5.19%, avg=248.85, stdev=83.62, samples=20 00:32:00.351 iops : min= 32, max= 128, avg=62.20, stdev=20.86, samples=20 00:32:00.351 lat (msec) : 50=5.13%, 250=28.21%, 500=66.67% 00:32:00.351 cpu : usr=99.03%, sys=0.58%, ctx=16, majf=0, minf=59 00:32:00.351 IO depths : 1=0.5%, 2=6.7%, 4=25.0%, 8=55.8%, 16=12.0%, 32=0.0%, >=64=0.0% 00:32:00.351 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.351 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.351 filename1: (groupid=0, jobs=1): err= 0: pid=3443736: Tue Nov 26 05:28:02 2024 00:32:00.351 read: IOPS=47, BW=188KiB/s (193kB/s)(1912KiB/10161msec) 00:32:00.351 slat (usec): min=7, max=122, avg=21.40, stdev=17.31 00:32:00.351 clat (msec): min=142, max=513, avg=338.98, stdev=82.70 00:32:00.351 lat (msec): min=142, max=513, avg=339.00, stdev=82.70 00:32:00.351 clat percentiles (msec): 00:32:00.351 | 1.00th=[ 142], 5.00th=[ 243], 10.00th=[ 266], 20.00th=[ 284], 00:32:00.351 | 30.00th=[ 296], 40.00th=[ 305], 50.00th=[ 317], 60.00th=[ 334], 00:32:00.351 | 70.00th=[ 359], 80.00th=[ 422], 90.00th=[ 477], 95.00th=[ 502], 00:32:00.351 | 99.00th=[ 506], 99.50th=[ 510], 99.90th=[ 514], 99.95th=[ 514], 00:32:00.351 | 99.99th=[ 514] 00:32:00.351 bw ( KiB/s): min= 112, max= 256, per=3.85%, avg=184.80, stdev=57.21, samples=20 00:32:00.351 iops : min= 28, max= 64, avg=46.20, stdev=14.30, samples=20 00:32:00.351 lat (msec) : 250=7.95%, 500=86.19%, 750=5.86% 00:32:00.351 cpu : usr=98.57%, sys=0.93%, ctx=19, majf=0, minf=47 00:32:00.351 IO depths : 1=2.9%, 2=6.7%, 4=17.2%, 8=63.4%, 16=9.8%, 32=0.0%, >=64=0.0% 00:32:00.351 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 complete : 0=0.0%, 4=91.6%, 8=3.0%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 issued rwts: total=478,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.351 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.351 filename1: (groupid=0, jobs=1): err= 0: pid=3443737: Tue Nov 26 05:28:02 2024 00:32:00.351 read: IOPS=53, BW=214KiB/s (220kB/s)(2176KiB/10149msec) 00:32:00.351 slat (usec): min=8, max=106, avg=18.67, stdev=19.10 00:32:00.351 clat (msec): min=138, max=413, avg=298.32, stdev=51.64 00:32:00.351 lat (msec): min=138, max=413, avg=298.34, stdev=51.64 00:32:00.351 clat percentiles (msec): 00:32:00.351 | 1.00th=[ 142], 5.00th=[ 186], 10.00th=[ 241], 20.00th=[ 271], 00:32:00.351 | 30.00th=[ 284], 40.00th=[ 292], 50.00th=[ 305], 60.00th=[ 313], 00:32:00.351 | 70.00th=[ 330], 80.00th=[ 338], 90.00th=[ 347], 95.00th=[ 359], 00:32:00.351 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], 00:32:00.351 | 99.99th=[ 414] 00:32:00.351 bw ( KiB/s): min= 128, max= 256, per=4.42%, avg=211.20, stdev=61.11, samples=20 00:32:00.351 iops : min= 32, max= 64, avg=52.80, stdev=15.28, samples=20 00:32:00.351 lat (msec) : 250=12.87%, 500=87.13% 00:32:00.351 cpu : usr=98.80%, sys=0.78%, ctx=22, majf=0, minf=52 00:32:00.351 IO depths : 1=5.1%, 2=11.2%, 4=24.4%, 8=51.8%, 16=7.4%, 32=0.0%, >=64=0.0% 00:32:00.351 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 complete : 0=0.0%, 4=94.0%, 8=0.2%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.351 issued rwts: total=544,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.351 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.351 filename2: (groupid=0, jobs=1): err= 0: pid=3443738: Tue Nov 26 05:28:02 2024 00:32:00.352 read: IOPS=61, BW=244KiB/s (250kB/s)(2488KiB/10190msec) 00:32:00.352 slat (nsec): min=5276, max=87905, avg=18633.42, stdev=20178.39 00:32:00.352 clat (msec): min=6, max=541, avg=260.35, stdev=105.13 00:32:00.352 lat (msec): min=6, max=541, avg=260.37, stdev=105.13 00:32:00.352 clat percentiles (msec): 00:32:00.352 | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 33], 20.00th=[ 220], 00:32:00.352 | 30.00th=[ 245], 40.00th=[ 271], 50.00th=[ 284], 60.00th=[ 296], 00:32:00.352 | 70.00th=[ 309], 80.00th=[ 321], 90.00th=[ 342], 95.00th=[ 393], 00:32:00.352 | 99.00th=[ 498], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], 00:32:00.352 | 99.99th=[ 542] 00:32:00.352 bw ( KiB/s): min= 128, max= 753, per=5.07%, avg=242.45, stdev=128.66, samples=20 00:32:00.352 iops : min= 32, max= 188, avg=60.60, stdev=32.11, samples=20 00:32:00.352 lat (msec) : 10=7.72%, 50=2.57%, 250=22.19%, 500=66.56%, 750=0.96% 00:32:00.352 cpu : usr=98.70%, sys=0.85%, ctx=12, majf=0, minf=86 00:32:00.352 IO depths : 1=0.8%, 2=2.9%, 4=13.3%, 8=70.9%, 16=12.1%, 32=0.0%, >=64=0.0% 00:32:00.352 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 complete : 0=0.0%, 4=91.0%, 8=3.9%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 issued rwts: total=622,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.352 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.352 filename2: (groupid=0, jobs=1): err= 0: pid=3443739: Tue Nov 26 05:28:02 2024 00:32:00.352 read: IOPS=39, BW=158KiB/s (162kB/s)(1600KiB/10143msec) 00:32:00.352 slat (usec): min=8, max=128, avg=59.44, stdev=39.76 00:32:00.352 clat (msec): min=268, max=660, avg=404.54, stdev=79.44 00:32:00.352 lat (msec): min=268, max=660, avg=404.60, stdev=79.44 00:32:00.352 clat percentiles (msec): 00:32:00.352 | 1.00th=[ 271], 5.00th=[ 279], 10.00th=[ 284], 20.00th=[ 326], 00:32:00.352 | 30.00th=[ 338], 40.00th=[ 397], 50.00th=[ 401], 60.00th=[ 418], 00:32:00.352 | 70.00th=[ 451], 80.00th=[ 481], 90.00th=[ 485], 95.00th=[ 542], 00:32:00.352 | 99.00th=[ 584], 99.50th=[ 634], 99.90th=[ 659], 99.95th=[ 659], 00:32:00.352 | 99.99th=[ 659] 00:32:00.352 bw ( KiB/s): min= 112, max= 256, per=3.20%, avg=153.60, stdev=52.79, samples=20 00:32:00.352 iops : min= 28, max= 64, avg=38.40, stdev=13.20, samples=20 00:32:00.352 lat (msec) : 500=94.00%, 750=6.00% 00:32:00.352 cpu : usr=98.36%, sys=0.99%, ctx=29, majf=0, minf=43 00:32:00.352 IO depths : 1=5.0%, 2=11.2%, 4=25.0%, 8=51.2%, 16=7.5%, 32=0.0%, >=64=0.0% 00:32:00.352 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.352 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.352 filename2: (groupid=0, jobs=1): err= 0: pid=3443740: Tue Nov 26 05:28:02 2024 00:32:00.352 read: IOPS=48, BW=195KiB/s (199kB/s)(1976KiB/10147msec) 00:32:00.352 slat (nsec): min=5617, max=92365, avg=16564.26, stdev=13529.18 00:32:00.352 clat (msec): min=185, max=624, avg=328.26, stdev=65.10 00:32:00.352 lat (msec): min=185, max=624, avg=328.28, stdev=65.10 00:32:00.352 clat percentiles (msec): 00:32:00.352 | 1.00th=[ 186], 5.00th=[ 205], 10.00th=[ 271], 20.00th=[ 284], 00:32:00.352 | 30.00th=[ 300], 40.00th=[ 313], 50.00th=[ 321], 60.00th=[ 330], 00:32:00.352 | 70.00th=[ 338], 80.00th=[ 384], 90.00th=[ 418], 95.00th=[ 422], 00:32:00.352 | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 625], 99.95th=[ 625], 00:32:00.352 | 99.99th=[ 625] 00:32:00.352 bw ( KiB/s): min= 112, max= 256, per=4.00%, avg=191.20, stdev=63.68, samples=20 00:32:00.352 iops : min= 28, max= 64, avg=47.80, stdev=15.92, samples=20 00:32:00.352 lat (msec) : 250=6.88%, 500=92.71%, 750=0.40% 00:32:00.352 cpu : usr=99.04%, sys=0.54%, ctx=15, majf=0, minf=48 00:32:00.352 IO depths : 1=2.6%, 2=8.9%, 4=25.1%, 8=53.6%, 16=9.7%, 32=0.0%, >=64=0.0% 00:32:00.352 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 issued rwts: total=494,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.352 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.352 filename2: (groupid=0, jobs=1): err= 0: pid=3443741: Tue Nov 26 05:28:02 2024 00:32:00.352 read: IOPS=50, BW=201KiB/s (206kB/s)(2040KiB/10161msec) 00:32:00.352 slat (usec): min=7, max=127, avg=43.31, stdev=41.45 00:32:00.352 clat (msec): min=141, max=578, avg=318.18, stdev=68.83 00:32:00.352 lat (msec): min=141, max=578, avg=318.22, stdev=68.85 00:32:00.352 clat percentiles (msec): 00:32:00.352 | 1.00th=[ 142], 5.00th=[ 186], 10.00th=[ 257], 20.00th=[ 284], 00:32:00.352 | 30.00th=[ 288], 40.00th=[ 300], 50.00th=[ 313], 60.00th=[ 326], 00:32:00.352 | 70.00th=[ 338], 80.00th=[ 355], 90.00th=[ 418], 95.00th=[ 439], 00:32:00.352 | 99.00th=[ 485], 99.50th=[ 514], 99.90th=[ 575], 99.95th=[ 575], 00:32:00.352 | 99.99th=[ 575] 00:32:00.352 bw ( KiB/s): min= 128, max= 256, per=4.12%, avg=197.60, stdev=56.93, samples=20 00:32:00.352 iops : min= 32, max= 64, avg=49.40, stdev=14.23, samples=20 00:32:00.352 lat (msec) : 250=9.80%, 500=89.41%, 750=0.78% 00:32:00.352 cpu : usr=98.57%, sys=0.94%, ctx=31, majf=0, minf=48 00:32:00.352 IO depths : 1=1.8%, 2=8.0%, 4=25.1%, 8=54.5%, 16=10.6%, 32=0.0%, >=64=0.0% 00:32:00.352 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 issued rwts: total=510,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.352 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.352 filename2: (groupid=0, jobs=1): err= 0: pid=3443742: Tue Nov 26 05:28:02 2024 00:32:00.352 read: IOPS=51, BW=207KiB/s (212kB/s)(2104KiB/10150msec) 00:32:00.352 slat (usec): min=5, max=111, avg=18.19, stdev=12.15 00:32:00.352 clat (msec): min=185, max=517, avg=308.26, stdev=43.78 00:32:00.352 lat (msec): min=185, max=517, avg=308.28, stdev=43.78 00:32:00.352 clat percentiles (msec): 00:32:00.352 | 1.00th=[ 186], 5.00th=[ 251], 10.00th=[ 271], 20.00th=[ 279], 00:32:00.352 | 30.00th=[ 284], 40.00th=[ 296], 50.00th=[ 309], 60.00th=[ 321], 00:32:00.352 | 70.00th=[ 330], 80.00th=[ 338], 90.00th=[ 347], 95.00th=[ 384], 00:32:00.352 | 99.00th=[ 401], 99.50th=[ 472], 99.90th=[ 518], 99.95th=[ 518], 00:32:00.352 | 99.99th=[ 518] 00:32:00.352 bw ( KiB/s): min= 128, max= 256, per=4.27%, avg=204.00, stdev=55.88, samples=20 00:32:00.352 iops : min= 32, max= 64, avg=51.00, stdev=13.97, samples=20 00:32:00.352 lat (msec) : 250=3.42%, 500=96.20%, 750=0.38% 00:32:00.352 cpu : usr=98.61%, sys=0.90%, ctx=43, majf=0, minf=49 00:32:00.352 IO depths : 1=1.3%, 2=7.6%, 4=25.1%, 8=54.9%, 16=11.0%, 32=0.0%, >=64=0.0% 00:32:00.352 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 issued rwts: total=526,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.352 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.352 filename2: (groupid=0, jobs=1): err= 0: pid=3443743: Tue Nov 26 05:28:02 2024 00:32:00.352 read: IOPS=39, BW=158KiB/s (161kB/s)(1600KiB/10151msec) 00:32:00.352 slat (nsec): min=3750, max=41329, avg=22397.70, stdev=6036.91 00:32:00.352 clat (msec): min=199, max=650, avg=405.80, stdev=81.34 00:32:00.352 lat (msec): min=199, max=650, avg=405.82, stdev=81.34 00:32:00.352 clat percentiles (msec): 00:32:00.352 | 1.00th=[ 220], 5.00th=[ 275], 10.00th=[ 288], 20.00th=[ 317], 00:32:00.352 | 30.00th=[ 359], 40.00th=[ 397], 50.00th=[ 405], 60.00th=[ 430], 00:32:00.352 | 70.00th=[ 456], 80.00th=[ 485], 90.00th=[ 498], 95.00th=[ 535], 00:32:00.352 | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 651], 99.95th=[ 651], 00:32:00.352 | 99.99th=[ 651] 00:32:00.352 bw ( KiB/s): min= 128, max= 256, per=3.20%, avg=153.60, stdev=46.83, samples=20 00:32:00.352 iops : min= 32, max= 64, avg=38.40, stdev=11.71, samples=20 00:32:00.352 lat (msec) : 250=1.00%, 500=89.50%, 750=9.50% 00:32:00.352 cpu : usr=98.40%, sys=0.98%, ctx=20, majf=0, minf=52 00:32:00.352 IO depths : 1=4.0%, 2=10.2%, 4=25.0%, 8=52.2%, 16=8.5%, 32=0.0%, >=64=0.0% 00:32:00.352 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.352 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.352 filename2: (groupid=0, jobs=1): err= 0: pid=3443744: Tue Nov 26 05:28:02 2024 00:32:00.352 read: IOPS=59, BW=238KiB/s (244kB/s)(2424KiB/10184msec) 00:32:00.352 slat (nsec): min=5491, max=61039, avg=14312.59, stdev=9158.73 00:32:00.352 clat (msec): min=17, max=449, avg=268.45, stdev=74.00 00:32:00.352 lat (msec): min=17, max=449, avg=268.47, stdev=74.00 00:32:00.352 clat percentiles (msec): 00:32:00.352 | 1.00th=[ 18], 5.00th=[ 27], 10.00th=[ 186], 20.00th=[ 241], 00:32:00.352 | 30.00th=[ 266], 40.00th=[ 275], 50.00th=[ 284], 60.00th=[ 292], 00:32:00.352 | 70.00th=[ 309], 80.00th=[ 321], 90.00th=[ 338], 95.00th=[ 338], 00:32:00.352 | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 451], 99.95th=[ 451], 00:32:00.352 | 99.99th=[ 451] 00:32:00.352 bw ( KiB/s): min= 128, max= 512, per=4.94%, avg=236.00, stdev=83.52, samples=20 00:32:00.352 iops : min= 32, max= 128, avg=59.00, stdev=20.88, samples=20 00:32:00.352 lat (msec) : 20=2.64%, 50=2.64%, 250=18.15%, 500=76.57% 00:32:00.352 cpu : usr=98.87%, sys=0.74%, ctx=15, majf=0, minf=55 00:32:00.352 IO depths : 1=4.1%, 2=10.4%, 4=25.1%, 8=52.1%, 16=8.3%, 32=0.0%, >=64=0.0% 00:32:00.352 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.352 issued rwts: total=606,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.352 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.352 filename2: (groupid=0, jobs=1): err= 0: pid=3443745: Tue Nov 26 05:28:02 2024 00:32:00.352 read: IOPS=55, BW=220KiB/s (226kB/s)(2240KiB/10161msec) 00:32:00.352 slat (nsec): min=7096, max=73267, avg=14499.26, stdev=8439.98 00:32:00.352 clat (msec): min=141, max=384, avg=289.71, stdev=44.25 00:32:00.352 lat (msec): min=141, max=384, avg=289.73, stdev=44.25 00:32:00.352 clat percentiles (msec): 00:32:00.352 | 1.00th=[ 142], 5.00th=[ 205], 10.00th=[ 241], 20.00th=[ 249], 00:32:00.352 | 30.00th=[ 279], 40.00th=[ 288], 50.00th=[ 296], 60.00th=[ 305], 00:32:00.352 | 70.00th=[ 313], 80.00th=[ 321], 90.00th=[ 338], 95.00th=[ 347], 00:32:00.352 | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], 00:32:00.352 | 99.99th=[ 384] 00:32:00.352 bw ( KiB/s): min= 128, max= 256, per=4.54%, avg=217.60, stdev=56.96, samples=20 00:32:00.352 iops : min= 32, max= 64, avg=54.40, stdev=14.24, samples=20 00:32:00.352 lat (msec) : 250=20.36%, 500=79.64% 00:32:00.352 cpu : usr=98.66%, sys=0.78%, ctx=39, majf=0, minf=35 00:32:00.353 IO depths : 1=3.0%, 2=9.3%, 4=25.0%, 8=53.2%, 16=9.5%, 32=0.0%, >=64=0.0% 00:32:00.353 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.353 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.353 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.353 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.353 00:32:00.353 Run status group 0 (all jobs): 00:32:00.353 READ: bw=4776KiB/s (4891kB/s), 158KiB/s-245KiB/s (161kB/s-251kB/s), io=47.5MiB (49.8MB), run=10124-10190msec 00:32:00.612 05:28:02 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:32:00.612 05:28:02 -- target/dif.sh@43 -- # local sub 00:32:00.613 05:28:02 -- target/dif.sh@45 -- # for sub in "$@" 00:32:00.613 05:28:02 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:00.613 05:28:02 -- target/dif.sh@36 -- # local sub_id=0 00:32:00.613 05:28:02 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:00.613 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.613 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.613 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.613 05:28:02 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:00.613 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.613 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.613 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.613 05:28:02 -- target/dif.sh@45 -- # for sub in "$@" 00:32:00.613 05:28:02 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:00.613 05:28:02 -- target/dif.sh@36 -- # local sub_id=1 00:32:00.613 05:28:02 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:00.613 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.613 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.613 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.613 05:28:02 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:00.613 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.613 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.613 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.613 05:28:02 -- target/dif.sh@45 -- # for sub in "$@" 00:32:00.613 05:28:02 -- target/dif.sh@46 -- # destroy_subsystem 2 00:32:00.613 05:28:02 -- target/dif.sh@36 -- # local sub_id=2 00:32:00.613 05:28:02 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:32:00.613 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.613 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.613 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.613 05:28:02 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:32:00.613 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.613 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.872 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.872 05:28:02 -- target/dif.sh@115 -- # NULL_DIF=1 00:32:00.872 05:28:02 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:32:00.872 05:28:02 -- target/dif.sh@115 -- # numjobs=2 00:32:00.872 05:28:02 -- target/dif.sh@115 -- # iodepth=8 00:32:00.872 05:28:02 -- target/dif.sh@115 -- # runtime=5 00:32:00.872 05:28:02 -- target/dif.sh@115 -- # files=1 00:32:00.872 05:28:02 -- target/dif.sh@117 -- # create_subsystems 0 1 00:32:00.872 05:28:02 -- target/dif.sh@28 -- # local sub 00:32:00.872 05:28:02 -- target/dif.sh@30 -- # for sub in "$@" 00:32:00.872 05:28:02 -- target/dif.sh@31 -- # create_subsystem 0 00:32:00.872 05:28:02 -- target/dif.sh@18 -- # local sub_id=0 00:32:00.872 05:28:02 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:00.872 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.872 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.872 bdev_null0 00:32:00.872 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.872 05:28:02 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:00.872 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.872 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.872 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.872 05:28:02 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:00.872 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.872 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.872 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.872 05:28:02 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:00.872 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.872 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.872 [2024-11-26 05:28:02.410245] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:00.872 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.872 05:28:02 -- target/dif.sh@30 -- # for sub in "$@" 00:32:00.872 05:28:02 -- target/dif.sh@31 -- # create_subsystem 1 00:32:00.872 05:28:02 -- target/dif.sh@18 -- # local sub_id=1 00:32:00.872 05:28:02 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:00.872 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.872 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.872 bdev_null1 00:32:00.872 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.872 05:28:02 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:00.872 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.872 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.872 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.872 05:28:02 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:00.872 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.872 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.872 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.872 05:28:02 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:00.872 05:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.872 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:32:00.872 05:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.872 05:28:02 -- target/dif.sh@118 -- # fio /dev/fd/62 00:32:00.872 05:28:02 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:32:00.872 05:28:02 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:00.872 05:28:02 -- nvmf/common.sh@520 -- # config=() 00:32:00.872 05:28:02 -- nvmf/common.sh@520 -- # local subsystem config 00:32:00.872 05:28:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:00.872 05:28:02 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:00.872 05:28:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:00.872 { 00:32:00.872 "params": { 00:32:00.872 "name": "Nvme$subsystem", 00:32:00.872 "trtype": "$TEST_TRANSPORT", 00:32:00.872 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:00.872 "adrfam": "ipv4", 00:32:00.872 "trsvcid": "$NVMF_PORT", 00:32:00.872 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:00.872 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:00.872 "hdgst": ${hdgst:-false}, 00:32:00.872 "ddgst": ${ddgst:-false} 00:32:00.872 }, 00:32:00.872 "method": "bdev_nvme_attach_controller" 00:32:00.872 } 00:32:00.872 EOF 00:32:00.872 )") 00:32:00.872 05:28:02 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:00.872 05:28:02 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:00.872 05:28:02 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:00.872 05:28:02 -- target/dif.sh@82 -- # gen_fio_conf 00:32:00.872 05:28:02 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:00.872 05:28:02 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:00.872 05:28:02 -- target/dif.sh@54 -- # local file 00:32:00.872 05:28:02 -- common/autotest_common.sh@1330 -- # shift 00:32:00.872 05:28:02 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:00.872 05:28:02 -- target/dif.sh@56 -- # cat 00:32:00.872 05:28:02 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:00.872 05:28:02 -- nvmf/common.sh@542 -- # cat 00:32:00.872 05:28:02 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:00.872 05:28:02 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:00.872 05:28:02 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:00.872 05:28:02 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:00.872 05:28:02 -- target/dif.sh@72 -- # (( file <= files )) 00:32:00.872 05:28:02 -- target/dif.sh@73 -- # cat 00:32:00.872 05:28:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:00.872 05:28:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:00.872 { 00:32:00.872 "params": { 00:32:00.872 "name": "Nvme$subsystem", 00:32:00.872 "trtype": "$TEST_TRANSPORT", 00:32:00.872 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:00.872 "adrfam": "ipv4", 00:32:00.872 "trsvcid": "$NVMF_PORT", 00:32:00.872 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:00.872 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:00.872 "hdgst": ${hdgst:-false}, 00:32:00.872 "ddgst": ${ddgst:-false} 00:32:00.873 }, 00:32:00.873 "method": "bdev_nvme_attach_controller" 00:32:00.873 } 00:32:00.873 EOF 00:32:00.873 )") 00:32:00.873 05:28:02 -- nvmf/common.sh@542 -- # cat 00:32:00.873 05:28:02 -- target/dif.sh@72 -- # (( file++ )) 00:32:00.873 05:28:02 -- target/dif.sh@72 -- # (( file <= files )) 00:32:00.873 05:28:02 -- nvmf/common.sh@544 -- # jq . 00:32:00.873 05:28:02 -- nvmf/common.sh@545 -- # IFS=, 00:32:00.873 05:28:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:00.873 "params": { 00:32:00.873 "name": "Nvme0", 00:32:00.873 "trtype": "tcp", 00:32:00.873 "traddr": "10.0.0.2", 00:32:00.873 "adrfam": "ipv4", 00:32:00.873 "trsvcid": "4420", 00:32:00.873 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:00.873 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:00.873 "hdgst": false, 00:32:00.873 "ddgst": false 00:32:00.873 }, 00:32:00.873 "method": "bdev_nvme_attach_controller" 00:32:00.873 },{ 00:32:00.873 "params": { 00:32:00.873 "name": "Nvme1", 00:32:00.873 "trtype": "tcp", 00:32:00.873 "traddr": "10.0.0.2", 00:32:00.873 "adrfam": "ipv4", 00:32:00.873 "trsvcid": "4420", 00:32:00.873 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:00.873 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:00.873 "hdgst": false, 00:32:00.873 "ddgst": false 00:32:00.873 }, 00:32:00.873 "method": "bdev_nvme_attach_controller" 00:32:00.873 }' 00:32:00.873 05:28:02 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:00.873 05:28:02 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:00.873 05:28:02 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:00.873 05:28:02 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:00.873 05:28:02 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:00.873 05:28:02 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:00.873 05:28:02 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:00.873 05:28:02 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:00.873 05:28:02 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:00.873 05:28:02 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:01.131 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:01.131 ... 00:32:01.131 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:01.131 ... 00:32:01.131 fio-3.35 00:32:01.131 Starting 4 threads 00:32:01.131 EAL: No free 2048 kB hugepages reported on node 1 00:32:01.696 [2024-11-26 05:28:03.332124] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:01.696 [2024-11-26 05:28:03.332184] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:06.959 00:32:06.959 filename0: (groupid=0, jobs=1): err= 0: pid=3445175: Tue Nov 26 05:28:08 2024 00:32:06.959 read: IOPS=1960, BW=15.3MiB/s (16.1MB/s)(76.6MiB/5001msec) 00:32:06.959 slat (usec): min=3, max=160, avg=21.56, stdev= 8.35 00:32:06.959 clat (usec): min=705, max=12870, avg=4011.96, stdev=553.22 00:32:06.959 lat (usec): min=724, max=12885, avg=4033.52, stdev=552.89 00:32:06.959 clat percentiles (usec): 00:32:06.959 | 1.00th=[ 2474], 5.00th=[ 3326], 10.00th=[ 3589], 20.00th=[ 3818], 00:32:06.959 | 30.00th=[ 3884], 40.00th=[ 3949], 50.00th=[ 4015], 60.00th=[ 4080], 00:32:06.959 | 70.00th=[ 4146], 80.00th=[ 4228], 90.00th=[ 4293], 95.00th=[ 4424], 00:32:06.959 | 99.00th=[ 6063], 99.50th=[ 6587], 99.90th=[ 7308], 99.95th=[12649], 00:32:06.959 | 99.99th=[12911] 00:32:06.959 bw ( KiB/s): min=15056, max=16640, per=25.17%, avg=15688.89, stdev=476.93, samples=9 00:32:06.959 iops : min= 1882, max= 2080, avg=1961.11, stdev=59.62, samples=9 00:32:06.959 lat (usec) : 750=0.02%, 1000=0.11% 00:32:06.959 lat (msec) : 2=0.55%, 4=46.80%, 10=52.44%, 20=0.08% 00:32:06.959 cpu : usr=93.44%, sys=4.88%, ctx=237, majf=0, minf=0 00:32:06.959 IO depths : 1=0.1%, 2=9.8%, 4=61.6%, 8=28.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:06.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.959 complete : 0=0.0%, 4=93.1%, 8=6.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.959 issued rwts: total=9802,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.959 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:06.959 filename0: (groupid=0, jobs=1): err= 0: pid=3445176: Tue Nov 26 05:28:08 2024 00:32:06.959 read: IOPS=1933, BW=15.1MiB/s (15.8MB/s)(75.6MiB/5002msec) 00:32:06.960 slat (usec): min=7, max=111, avg=17.01, stdev= 8.76 00:32:06.960 clat (usec): min=841, max=8955, avg=4079.54, stdev=451.20 00:32:06.960 lat (usec): min=857, max=8974, avg=4096.55, stdev=451.05 00:32:06.960 clat percentiles (usec): 00:32:06.960 | 1.00th=[ 3032], 5.00th=[ 3621], 10.00th=[ 3752], 20.00th=[ 3884], 00:32:06.960 | 30.00th=[ 3949], 40.00th=[ 3982], 50.00th=[ 4047], 60.00th=[ 4113], 00:32:06.960 | 70.00th=[ 4146], 80.00th=[ 4228], 90.00th=[ 4293], 95.00th=[ 4490], 00:32:06.960 | 99.00th=[ 6128], 99.50th=[ 6390], 99.90th=[ 7177], 99.95th=[ 7373], 00:32:06.960 | 99.99th=[ 8979] 00:32:06.960 bw ( KiB/s): min=15264, max=15696, per=24.81%, avg=15465.40, stdev=155.66, samples=10 00:32:06.960 iops : min= 1908, max= 1962, avg=1933.10, stdev=19.51, samples=10 00:32:06.960 lat (usec) : 1000=0.01% 00:32:06.960 lat (msec) : 2=0.13%, 4=40.75%, 10=59.11% 00:32:06.960 cpu : usr=95.04%, sys=4.38%, ctx=9, majf=0, minf=0 00:32:06.960 IO depths : 1=0.1%, 2=12.0%, 4=61.2%, 8=26.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:06.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.960 complete : 0=0.0%, 4=91.5%, 8=8.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.960 issued rwts: total=9672,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.960 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:06.960 filename1: (groupid=0, jobs=1): err= 0: pid=3445177: Tue Nov 26 05:28:08 2024 00:32:06.960 read: IOPS=1967, BW=15.4MiB/s (16.1MB/s)(76.9MiB/5003msec) 00:32:06.960 slat (nsec): min=5534, max=70827, avg=17022.80, stdev=8456.43 00:32:06.960 clat (usec): min=741, max=7261, avg=4008.71, stdev=416.67 00:32:06.960 lat (usec): min=754, max=7285, avg=4025.73, stdev=417.29 00:32:06.960 clat percentiles (usec): 00:32:06.960 | 1.00th=[ 2900], 5.00th=[ 3392], 10.00th=[ 3621], 20.00th=[ 3818], 00:32:06.960 | 30.00th=[ 3916], 40.00th=[ 3982], 50.00th=[ 4047], 60.00th=[ 4080], 00:32:06.960 | 70.00th=[ 4146], 80.00th=[ 4228], 90.00th=[ 4293], 95.00th=[ 4424], 00:32:06.960 | 99.00th=[ 5604], 99.50th=[ 5866], 99.90th=[ 6521], 99.95th=[ 6980], 00:32:06.960 | 99.99th=[ 7242] 00:32:06.960 bw ( KiB/s): min=15360, max=16512, per=25.24%, avg=15736.00, stdev=399.27, samples=10 00:32:06.960 iops : min= 1920, max= 2064, avg=1967.00, stdev=49.91, samples=10 00:32:06.960 lat (usec) : 750=0.01%, 1000=0.04% 00:32:06.960 lat (msec) : 2=0.24%, 4=44.28%, 10=55.43% 00:32:06.960 cpu : usr=95.04%, sys=4.38%, ctx=13, majf=0, minf=0 00:32:06.960 IO depths : 1=0.1%, 2=12.7%, 4=60.0%, 8=27.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:06.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.960 complete : 0=0.0%, 4=92.0%, 8=8.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.960 issued rwts: total=9843,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.960 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:06.960 filename1: (groupid=0, jobs=1): err= 0: pid=3445178: Tue Nov 26 05:28:08 2024 00:32:06.960 read: IOPS=1933, BW=15.1MiB/s (15.8MB/s)(75.5MiB/5001msec) 00:32:06.960 slat (usec): min=7, max=102, avg=17.42, stdev= 8.94 00:32:06.960 clat (usec): min=630, max=8387, avg=4076.39, stdev=517.95 00:32:06.960 lat (usec): min=651, max=8408, avg=4093.81, stdev=517.80 00:32:06.960 clat percentiles (usec): 00:32:06.960 | 1.00th=[ 2802], 5.00th=[ 3589], 10.00th=[ 3720], 20.00th=[ 3851], 00:32:06.960 | 30.00th=[ 3916], 40.00th=[ 3982], 50.00th=[ 4047], 60.00th=[ 4113], 00:32:06.960 | 70.00th=[ 4146], 80.00th=[ 4228], 90.00th=[ 4359], 95.00th=[ 4686], 00:32:06.960 | 99.00th=[ 6259], 99.50th=[ 6587], 99.90th=[ 7635], 99.95th=[ 8291], 00:32:06.960 | 99.99th=[ 8356] 00:32:06.960 bw ( KiB/s): min=15328, max=15520, per=24.80%, avg=15463.11, stdev=68.87, samples=9 00:32:06.960 iops : min= 1916, max= 1940, avg=1932.89, stdev= 8.61, samples=9 00:32:06.960 lat (usec) : 750=0.02%, 1000=0.10% 00:32:06.960 lat (msec) : 2=0.31%, 4=41.64%, 10=57.92% 00:32:06.960 cpu : usr=94.54%, sys=4.78%, ctx=10, majf=0, minf=0 00:32:06.960 IO depths : 1=0.1%, 2=14.0%, 4=59.7%, 8=26.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:06.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.960 complete : 0=0.0%, 4=91.3%, 8=8.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.960 issued rwts: total=9668,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.960 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:06.960 00:32:06.960 Run status group 0 (all jobs): 00:32:06.960 READ: bw=60.9MiB/s (63.8MB/s), 15.1MiB/s-15.4MiB/s (15.8MB/s-16.1MB/s), io=305MiB (319MB), run=5001-5003msec 00:32:06.960 05:28:08 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:32:06.960 05:28:08 -- target/dif.sh@43 -- # local sub 00:32:06.960 05:28:08 -- target/dif.sh@45 -- # for sub in "$@" 00:32:06.960 05:28:08 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:06.960 05:28:08 -- target/dif.sh@36 -- # local sub_id=0 00:32:06.960 05:28:08 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:06.960 05:28:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.960 05:28:08 -- common/autotest_common.sh@10 -- # set +x 00:32:06.960 05:28:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.960 05:28:08 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:06.960 05:28:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.960 05:28:08 -- common/autotest_common.sh@10 -- # set +x 00:32:06.960 05:28:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.960 05:28:08 -- target/dif.sh@45 -- # for sub in "$@" 00:32:06.960 05:28:08 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:06.960 05:28:08 -- target/dif.sh@36 -- # local sub_id=1 00:32:06.960 05:28:08 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:06.960 05:28:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.960 05:28:08 -- common/autotest_common.sh@10 -- # set +x 00:32:06.960 05:28:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.960 05:28:08 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:06.960 05:28:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.960 05:28:08 -- common/autotest_common.sh@10 -- # set +x 00:32:07.219 05:28:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.219 00:32:07.219 real 0m24.246s 00:32:07.219 user 4m37.744s 00:32:07.219 sys 0m4.870s 00:32:07.219 05:28:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:07.219 05:28:08 -- common/autotest_common.sh@10 -- # set +x 00:32:07.219 ************************************ 00:32:07.219 END TEST fio_dif_rand_params 00:32:07.219 ************************************ 00:32:07.219 05:28:08 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:32:07.219 05:28:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:07.219 05:28:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:07.219 05:28:08 -- common/autotest_common.sh@10 -- # set +x 00:32:07.219 ************************************ 00:32:07.219 START TEST fio_dif_digest 00:32:07.219 ************************************ 00:32:07.219 05:28:08 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:32:07.219 05:28:08 -- target/dif.sh@123 -- # local NULL_DIF 00:32:07.219 05:28:08 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:32:07.219 05:28:08 -- target/dif.sh@125 -- # local hdgst ddgst 00:32:07.219 05:28:08 -- target/dif.sh@127 -- # NULL_DIF=3 00:32:07.219 05:28:08 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:32:07.219 05:28:08 -- target/dif.sh@127 -- # numjobs=3 00:32:07.219 05:28:08 -- target/dif.sh@127 -- # iodepth=3 00:32:07.219 05:28:08 -- target/dif.sh@127 -- # runtime=10 00:32:07.219 05:28:08 -- target/dif.sh@128 -- # hdgst=true 00:32:07.219 05:28:08 -- target/dif.sh@128 -- # ddgst=true 00:32:07.219 05:28:08 -- target/dif.sh@130 -- # create_subsystems 0 00:32:07.219 05:28:08 -- target/dif.sh@28 -- # local sub 00:32:07.219 05:28:08 -- target/dif.sh@30 -- # for sub in "$@" 00:32:07.219 05:28:08 -- target/dif.sh@31 -- # create_subsystem 0 00:32:07.219 05:28:08 -- target/dif.sh@18 -- # local sub_id=0 00:32:07.219 05:28:08 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:07.219 05:28:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.219 05:28:08 -- common/autotest_common.sh@10 -- # set +x 00:32:07.219 bdev_null0 00:32:07.219 05:28:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.219 05:28:08 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:07.219 05:28:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.219 05:28:08 -- common/autotest_common.sh@10 -- # set +x 00:32:07.219 05:28:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.219 05:28:08 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:07.219 05:28:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.219 05:28:08 -- common/autotest_common.sh@10 -- # set +x 00:32:07.219 05:28:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.219 05:28:08 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:07.219 05:28:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.219 05:28:08 -- common/autotest_common.sh@10 -- # set +x 00:32:07.219 [2024-11-26 05:28:08.794453] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:07.219 05:28:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.219 05:28:08 -- target/dif.sh@131 -- # fio /dev/fd/62 00:32:07.219 05:28:08 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:07.219 05:28:08 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:32:07.219 05:28:08 -- target/dif.sh@82 -- # gen_fio_conf 00:32:07.219 05:28:08 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:07.219 05:28:08 -- target/dif.sh@54 -- # local file 00:32:07.219 05:28:08 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:07.219 05:28:08 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:07.219 05:28:08 -- target/dif.sh@56 -- # cat 00:32:07.219 05:28:08 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:07.219 05:28:08 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:07.219 05:28:08 -- nvmf/common.sh@520 -- # config=() 00:32:07.219 05:28:08 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:07.219 05:28:08 -- common/autotest_common.sh@1330 -- # shift 00:32:07.219 05:28:08 -- nvmf/common.sh@520 -- # local subsystem config 00:32:07.219 05:28:08 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:07.219 05:28:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:07.219 05:28:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:07.219 05:28:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:07.219 { 00:32:07.219 "params": { 00:32:07.219 "name": "Nvme$subsystem", 00:32:07.219 "trtype": "$TEST_TRANSPORT", 00:32:07.219 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:07.219 "adrfam": "ipv4", 00:32:07.219 "trsvcid": "$NVMF_PORT", 00:32:07.219 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:07.219 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:07.219 "hdgst": ${hdgst:-false}, 00:32:07.219 "ddgst": ${ddgst:-false} 00:32:07.219 }, 00:32:07.219 "method": "bdev_nvme_attach_controller" 00:32:07.219 } 00:32:07.219 EOF 00:32:07.219 )") 00:32:07.219 05:28:08 -- nvmf/common.sh@542 -- # cat 00:32:07.219 05:28:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:07.219 05:28:08 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:07.219 05:28:08 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:07.219 05:28:08 -- target/dif.sh@72 -- # (( file <= files )) 00:32:07.219 05:28:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:07.219 05:28:08 -- nvmf/common.sh@544 -- # jq . 00:32:07.219 05:28:08 -- nvmf/common.sh@545 -- # IFS=, 00:32:07.219 05:28:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:07.219 "params": { 00:32:07.219 "name": "Nvme0", 00:32:07.219 "trtype": "tcp", 00:32:07.219 "traddr": "10.0.0.2", 00:32:07.219 "adrfam": "ipv4", 00:32:07.219 "trsvcid": "4420", 00:32:07.219 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:07.219 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:07.219 "hdgst": true, 00:32:07.219 "ddgst": true 00:32:07.219 }, 00:32:07.219 "method": "bdev_nvme_attach_controller" 00:32:07.219 }' 00:32:07.219 05:28:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:07.219 05:28:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:07.219 05:28:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:07.219 05:28:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:07.219 05:28:08 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:07.219 05:28:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:07.219 05:28:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:07.219 05:28:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:07.219 05:28:08 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:07.219 05:28:08 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:07.481 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:07.481 ... 00:32:07.481 fio-3.35 00:32:07.481 Starting 3 threads 00:32:07.481 EAL: No free 2048 kB hugepages reported on node 1 00:32:07.752 [2024-11-26 05:28:09.376722] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:07.752 [2024-11-26 05:28:09.376801] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:19.953 00:32:19.953 filename0: (groupid=0, jobs=1): err= 0: pid=3445960: Tue Nov 26 05:28:19 2024 00:32:19.953 read: IOPS=214, BW=26.8MiB/s (28.1MB/s)(269MiB/10009msec) 00:32:19.953 slat (nsec): min=4752, max=62875, avg=20710.13, stdev=7330.22 00:32:19.953 clat (usec): min=8159, max=54597, avg=13952.55, stdev=2400.38 00:32:19.953 lat (usec): min=8182, max=54609, avg=13973.26, stdev=2399.69 00:32:19.953 clat percentiles (usec): 00:32:19.953 | 1.00th=[ 9634], 5.00th=[12125], 10.00th=[12518], 20.00th=[13042], 00:32:19.953 | 30.00th=[13304], 40.00th=[13566], 50.00th=[13829], 60.00th=[14091], 00:32:19.953 | 70.00th=[14353], 80.00th=[14746], 90.00th=[15139], 95.00th=[15533], 00:32:19.953 | 99.00th=[16581], 99.50th=[17433], 99.90th=[54264], 99.95th=[54264], 00:32:19.953 | 99.99th=[54789] 00:32:19.953 bw ( KiB/s): min=24320, max=28928, per=34.15%, avg=27453.25, stdev=1089.81, samples=20 00:32:19.953 iops : min= 190, max= 226, avg=214.45, stdev= 8.53, samples=20 00:32:19.953 lat (msec) : 10=1.07%, 20=98.51%, 50=0.14%, 100=0.28% 00:32:19.953 cpu : usr=90.60%, sys=7.07%, ctx=506, majf=0, minf=190 00:32:19.953 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:19.953 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.953 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.953 issued rwts: total=2148,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.953 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:19.953 filename0: (groupid=0, jobs=1): err= 0: pid=3445961: Tue Nov 26 05:28:19 2024 00:32:19.953 read: IOPS=204, BW=25.6MiB/s (26.8MB/s)(257MiB/10046msec) 00:32:19.953 slat (nsec): min=6322, max=42221, avg=15278.67, stdev=4312.56 00:32:19.953 clat (usec): min=9012, max=56331, avg=14611.44, stdev=2721.57 00:32:19.953 lat (usec): min=9039, max=56344, avg=14626.71, stdev=2721.65 00:32:19.953 clat percentiles (usec): 00:32:19.953 | 1.00th=[11076], 5.00th=[12780], 10.00th=[13173], 20.00th=[13566], 00:32:19.953 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:32:19.953 | 70.00th=[15008], 80.00th=[15401], 90.00th=[15926], 95.00th=[16319], 00:32:19.953 | 99.00th=[17433], 99.50th=[19530], 99.90th=[54264], 99.95th=[54789], 00:32:19.953 | 99.99th=[56361] 00:32:19.953 bw ( KiB/s): min=24576, max=27392, per=32.72%, avg=26304.00, stdev=778.59, samples=20 00:32:19.953 iops : min= 192, max= 214, avg=205.50, stdev= 6.08, samples=20 00:32:19.953 lat (msec) : 10=0.39%, 20=99.12%, 50=0.10%, 100=0.39% 00:32:19.953 cpu : usr=93.20%, sys=6.28%, ctx=31, majf=0, minf=182 00:32:19.953 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:19.953 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.953 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.953 issued rwts: total=2057,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.953 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:19.953 filename0: (groupid=0, jobs=1): err= 0: pid=3445962: Tue Nov 26 05:28:19 2024 00:32:19.953 read: IOPS=209, BW=26.2MiB/s (27.5MB/s)(263MiB/10048msec) 00:32:19.953 slat (nsec): min=5824, max=63636, avg=15424.28, stdev=4113.49 00:32:19.953 clat (usec): min=8176, max=55944, avg=14279.91, stdev=1702.98 00:32:19.953 lat (usec): min=8190, max=55957, avg=14295.33, stdev=1702.98 00:32:19.953 clat percentiles (usec): 00:32:19.953 | 1.00th=[10159], 5.00th=[12387], 10.00th=[12911], 20.00th=[13435], 00:32:19.953 | 30.00th=[13829], 40.00th=[14091], 50.00th=[14222], 60.00th=[14484], 00:32:19.953 | 70.00th=[14746], 80.00th=[15139], 90.00th=[15664], 95.00th=[16057], 00:32:19.953 | 99.00th=[16909], 99.50th=[16909], 99.90th=[24773], 99.95th=[50070], 00:32:19.953 | 99.99th=[55837] 00:32:19.953 bw ( KiB/s): min=25856, max=27904, per=33.48%, avg=26908.20, stdev=606.32, samples=20 00:32:19.953 iops : min= 202, max= 218, avg=210.20, stdev= 4.76, samples=20 00:32:19.953 lat (msec) : 10=0.95%, 20=98.81%, 50=0.19%, 100=0.05% 00:32:19.953 cpu : usr=93.18%, sys=6.31%, ctx=28, majf=0, minf=184 00:32:19.953 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:19.953 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.953 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.953 issued rwts: total=2105,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.953 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:19.953 00:32:19.953 Run status group 0 (all jobs): 00:32:19.953 READ: bw=78.5MiB/s (82.3MB/s), 25.6MiB/s-26.8MiB/s (26.8MB/s-28.1MB/s), io=789MiB (827MB), run=10009-10048msec 00:32:19.953 05:28:19 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:19.953 05:28:19 -- target/dif.sh@43 -- # local sub 00:32:19.953 05:28:19 -- target/dif.sh@45 -- # for sub in "$@" 00:32:19.953 05:28:19 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:19.953 05:28:19 -- target/dif.sh@36 -- # local sub_id=0 00:32:19.953 05:28:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:19.953 05:28:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.953 05:28:19 -- common/autotest_common.sh@10 -- # set +x 00:32:19.953 05:28:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.953 05:28:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:19.953 05:28:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.953 05:28:19 -- common/autotest_common.sh@10 -- # set +x 00:32:19.953 05:28:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.953 00:32:19.953 real 0m11.005s 00:32:19.953 user 0m28.860s 00:32:19.953 sys 0m2.235s 00:32:19.953 05:28:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:19.953 05:28:19 -- common/autotest_common.sh@10 -- # set +x 00:32:19.953 ************************************ 00:32:19.953 END TEST fio_dif_digest 00:32:19.953 ************************************ 00:32:19.953 05:28:19 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:19.953 05:28:19 -- target/dif.sh@147 -- # nvmftestfini 00:32:19.953 05:28:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:19.953 05:28:19 -- nvmf/common.sh@116 -- # sync 00:32:19.953 05:28:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:19.953 05:28:19 -- nvmf/common.sh@119 -- # set +e 00:32:19.953 05:28:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:19.953 05:28:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:19.953 rmmod nvme_tcp 00:32:19.953 rmmod nvme_fabrics 00:32:19.953 rmmod nvme_keyring 00:32:19.953 05:28:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:19.953 05:28:19 -- nvmf/common.sh@123 -- # set -e 00:32:19.953 05:28:19 -- nvmf/common.sh@124 -- # return 0 00:32:19.953 05:28:19 -- nvmf/common.sh@477 -- # '[' -n 3439709 ']' 00:32:19.953 05:28:19 -- nvmf/common.sh@478 -- # killprocess 3439709 00:32:19.953 05:28:19 -- common/autotest_common.sh@936 -- # '[' -z 3439709 ']' 00:32:19.953 05:28:19 -- common/autotest_common.sh@940 -- # kill -0 3439709 00:32:19.953 05:28:19 -- common/autotest_common.sh@941 -- # uname 00:32:19.953 05:28:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:19.953 05:28:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3439709 00:32:19.953 05:28:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:19.953 05:28:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:19.953 05:28:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3439709' 00:32:19.953 killing process with pid 3439709 00:32:19.953 05:28:19 -- common/autotest_common.sh@955 -- # kill 3439709 00:32:19.953 05:28:19 -- common/autotest_common.sh@960 -- # wait 3439709 00:32:19.953 05:28:20 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:19.953 05:28:20 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:19.953 Waiting for block devices as requested 00:32:19.953 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:19.953 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:19.953 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:19.953 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:20.214 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:20.214 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:20.214 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:20.214 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:20.214 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:20.475 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:20.475 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:20.475 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:20.733 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:20.733 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:20.733 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:20.733 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:20.992 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:20.992 05:28:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:20.992 05:28:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:20.992 05:28:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:20.992 05:28:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:20.992 05:28:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:20.992 05:28:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:20.992 05:28:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:22.900 05:28:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:22.900 00:32:22.900 real 1m7.459s 00:32:22.900 user 6m35.890s 00:32:22.900 sys 0m15.796s 00:32:22.900 05:28:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:22.900 05:28:24 -- common/autotest_common.sh@10 -- # set +x 00:32:22.900 ************************************ 00:32:22.900 END TEST nvmf_dif 00:32:22.900 ************************************ 00:32:23.158 05:28:24 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:23.158 05:28:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:23.158 05:28:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:23.158 05:28:24 -- common/autotest_common.sh@10 -- # set +x 00:32:23.158 ************************************ 00:32:23.158 START TEST nvmf_abort_qd_sizes 00:32:23.158 ************************************ 00:32:23.158 05:28:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:23.158 * Looking for test storage... 00:32:23.158 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:23.158 05:28:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:23.158 05:28:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:23.158 05:28:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:23.158 05:28:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:23.159 05:28:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:23.159 05:28:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:23.159 05:28:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:23.159 05:28:24 -- scripts/common.sh@335 -- # IFS=.-: 00:32:23.159 05:28:24 -- scripts/common.sh@335 -- # read -ra ver1 00:32:23.159 05:28:24 -- scripts/common.sh@336 -- # IFS=.-: 00:32:23.159 05:28:24 -- scripts/common.sh@336 -- # read -ra ver2 00:32:23.159 05:28:24 -- scripts/common.sh@337 -- # local 'op=<' 00:32:23.159 05:28:24 -- scripts/common.sh@339 -- # ver1_l=2 00:32:23.159 05:28:24 -- scripts/common.sh@340 -- # ver2_l=1 00:32:23.159 05:28:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:23.159 05:28:24 -- scripts/common.sh@343 -- # case "$op" in 00:32:23.159 05:28:24 -- scripts/common.sh@344 -- # : 1 00:32:23.159 05:28:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:23.159 05:28:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:23.159 05:28:24 -- scripts/common.sh@364 -- # decimal 1 00:32:23.159 05:28:24 -- scripts/common.sh@352 -- # local d=1 00:32:23.159 05:28:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:23.159 05:28:24 -- scripts/common.sh@354 -- # echo 1 00:32:23.159 05:28:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:23.159 05:28:24 -- scripts/common.sh@365 -- # decimal 2 00:32:23.159 05:28:24 -- scripts/common.sh@352 -- # local d=2 00:32:23.159 05:28:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:23.159 05:28:24 -- scripts/common.sh@354 -- # echo 2 00:32:23.159 05:28:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:23.159 05:28:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:23.159 05:28:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:23.159 05:28:24 -- scripts/common.sh@367 -- # return 0 00:32:23.159 05:28:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:23.159 05:28:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:23.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:23.159 --rc genhtml_branch_coverage=1 00:32:23.159 --rc genhtml_function_coverage=1 00:32:23.159 --rc genhtml_legend=1 00:32:23.159 --rc geninfo_all_blocks=1 00:32:23.159 --rc geninfo_unexecuted_blocks=1 00:32:23.159 00:32:23.159 ' 00:32:23.159 05:28:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:23.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:23.159 --rc genhtml_branch_coverage=1 00:32:23.159 --rc genhtml_function_coverage=1 00:32:23.159 --rc genhtml_legend=1 00:32:23.159 --rc geninfo_all_blocks=1 00:32:23.159 --rc geninfo_unexecuted_blocks=1 00:32:23.159 00:32:23.159 ' 00:32:23.159 05:28:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:23.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:23.159 --rc genhtml_branch_coverage=1 00:32:23.159 --rc genhtml_function_coverage=1 00:32:23.159 --rc genhtml_legend=1 00:32:23.159 --rc geninfo_all_blocks=1 00:32:23.159 --rc geninfo_unexecuted_blocks=1 00:32:23.159 00:32:23.159 ' 00:32:23.159 05:28:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:23.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:23.159 --rc genhtml_branch_coverage=1 00:32:23.159 --rc genhtml_function_coverage=1 00:32:23.159 --rc genhtml_legend=1 00:32:23.159 --rc geninfo_all_blocks=1 00:32:23.159 --rc geninfo_unexecuted_blocks=1 00:32:23.159 00:32:23.159 ' 00:32:23.159 05:28:24 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:23.159 05:28:24 -- nvmf/common.sh@7 -- # uname -s 00:32:23.159 05:28:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:23.159 05:28:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:23.159 05:28:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:23.159 05:28:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:23.159 05:28:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:23.159 05:28:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:23.159 05:28:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:23.159 05:28:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:23.159 05:28:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:23.159 05:28:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:23.159 05:28:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:23.159 05:28:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:23.159 05:28:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:23.159 05:28:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:23.159 05:28:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:23.159 05:28:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:23.159 05:28:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:23.159 05:28:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:23.159 05:28:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:23.159 05:28:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:23.159 05:28:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:23.159 05:28:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:23.159 05:28:24 -- paths/export.sh@5 -- # export PATH 00:32:23.159 05:28:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:23.159 05:28:24 -- nvmf/common.sh@46 -- # : 0 00:32:23.159 05:28:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:23.159 05:28:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:23.159 05:28:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:23.159 05:28:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:23.159 05:28:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:23.159 05:28:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:23.159 05:28:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:23.159 05:28:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:23.159 05:28:24 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:23.159 05:28:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:23.159 05:28:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:23.159 05:28:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:23.159 05:28:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:23.159 05:28:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:23.159 05:28:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:23.159 05:28:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:23.159 05:28:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:23.159 05:28:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:23.159 05:28:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:23.159 05:28:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:23.159 05:28:24 -- common/autotest_common.sh@10 -- # set +x 00:32:25.066 05:28:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:25.066 05:28:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:25.066 05:28:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:25.066 05:28:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:25.066 05:28:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:25.066 05:28:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:25.066 05:28:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:25.066 05:28:26 -- nvmf/common.sh@294 -- # net_devs=() 00:32:25.066 05:28:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:25.066 05:28:26 -- nvmf/common.sh@295 -- # e810=() 00:32:25.066 05:28:26 -- nvmf/common.sh@295 -- # local -ga e810 00:32:25.066 05:28:26 -- nvmf/common.sh@296 -- # x722=() 00:32:25.066 05:28:26 -- nvmf/common.sh@296 -- # local -ga x722 00:32:25.066 05:28:26 -- nvmf/common.sh@297 -- # mlx=() 00:32:25.066 05:28:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:25.066 05:28:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:25.066 05:28:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:25.066 05:28:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:25.066 05:28:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:25.066 05:28:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:25.066 05:28:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:25.066 05:28:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:25.066 05:28:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:25.066 05:28:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:25.066 05:28:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:25.066 05:28:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:25.066 05:28:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:25.066 05:28:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:25.066 05:28:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:25.066 05:28:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:25.066 05:28:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:25.066 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:25.066 05:28:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:25.066 05:28:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:25.066 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:25.066 05:28:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:25.066 05:28:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:25.066 05:28:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:25.066 05:28:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:25.066 05:28:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:25.066 05:28:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:25.066 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:25.066 05:28:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:25.066 05:28:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:25.066 05:28:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:25.066 05:28:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:25.066 05:28:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:25.066 05:28:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:25.066 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:25.066 05:28:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:25.066 05:28:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:25.066 05:28:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:25.066 05:28:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:25.066 05:28:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:25.066 05:28:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:25.066 05:28:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:25.066 05:28:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:25.066 05:28:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:25.066 05:28:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:25.066 05:28:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:25.066 05:28:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:25.066 05:28:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:25.066 05:28:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:25.066 05:28:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:25.066 05:28:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:25.066 05:28:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:25.066 05:28:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:25.326 05:28:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:25.326 05:28:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:25.326 05:28:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:25.326 05:28:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:25.326 05:28:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:25.326 05:28:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:25.326 05:28:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:25.326 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:25.326 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:32:25.326 00:32:25.326 --- 10.0.0.2 ping statistics --- 00:32:25.326 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:25.326 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:32:25.326 05:28:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:25.326 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:25.326 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:32:25.326 00:32:25.326 --- 10.0.0.1 ping statistics --- 00:32:25.326 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:25.326 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:32:25.327 05:28:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:25.327 05:28:26 -- nvmf/common.sh@410 -- # return 0 00:32:25.327 05:28:26 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:25.327 05:28:26 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:26.703 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:26.703 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:26.703 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:26.703 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:26.703 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:26.703 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:26.703 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:26.703 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:26.703 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:26.703 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:26.703 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:26.703 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:26.703 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:26.703 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:26.703 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:26.703 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:27.640 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:27.640 05:28:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:27.640 05:28:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:27.640 05:28:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:27.640 05:28:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:27.640 05:28:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:27.640 05:28:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:27.640 05:28:29 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:27.640 05:28:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:27.640 05:28:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:27.640 05:28:29 -- common/autotest_common.sh@10 -- # set +x 00:32:27.640 05:28:29 -- nvmf/common.sh@469 -- # nvmfpid=3450980 00:32:27.640 05:28:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:27.640 05:28:29 -- nvmf/common.sh@470 -- # waitforlisten 3450980 00:32:27.640 05:28:29 -- common/autotest_common.sh@829 -- # '[' -z 3450980 ']' 00:32:27.640 05:28:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:27.640 05:28:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:27.640 05:28:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:27.640 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:27.640 05:28:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:27.640 05:28:29 -- common/autotest_common.sh@10 -- # set +x 00:32:27.640 [2024-11-26 05:28:29.372213] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:32:27.640 [2024-11-26 05:28:29.372303] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:27.899 EAL: No free 2048 kB hugepages reported on node 1 00:32:27.899 [2024-11-26 05:28:29.444062] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:27.899 [2024-11-26 05:28:29.535515] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:27.899 [2024-11-26 05:28:29.535714] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:27.899 [2024-11-26 05:28:29.535738] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:27.899 [2024-11-26 05:28:29.535753] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:27.899 [2024-11-26 05:28:29.535822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:27.899 [2024-11-26 05:28:29.535913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:27.899 [2024-11-26 05:28:29.536008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:27.899 [2024-11-26 05:28:29.536011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:28.836 05:28:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:28.836 05:28:30 -- common/autotest_common.sh@862 -- # return 0 00:32:28.836 05:28:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:28.836 05:28:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:28.836 05:28:30 -- common/autotest_common.sh@10 -- # set +x 00:32:28.836 05:28:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:28.836 05:28:30 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:28.836 05:28:30 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:28.836 05:28:30 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:28.836 05:28:30 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:28.836 05:28:30 -- scripts/common.sh@312 -- # local nvmes 00:32:28.836 05:28:30 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:28.836 05:28:30 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:28.836 05:28:30 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:28.836 05:28:30 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:28.836 05:28:30 -- scripts/common.sh@322 -- # uname -s 00:32:28.836 05:28:30 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:28.836 05:28:30 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:28.836 05:28:30 -- scripts/common.sh@327 -- # (( 1 )) 00:32:28.836 05:28:30 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:28.836 05:28:30 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:28.836 05:28:30 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:28.836 05:28:30 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:28.836 05:28:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:28.836 05:28:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:28.836 05:28:30 -- common/autotest_common.sh@10 -- # set +x 00:32:28.836 ************************************ 00:32:28.836 START TEST spdk_target_abort 00:32:28.836 ************************************ 00:32:28.836 05:28:30 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:28.836 05:28:30 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:28.836 05:28:30 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:28.836 05:28:30 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:28.836 05:28:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:28.836 05:28:30 -- common/autotest_common.sh@10 -- # set +x 00:32:32.128 spdk_targetn1 00:32:32.128 05:28:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:32.128 05:28:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.128 05:28:33 -- common/autotest_common.sh@10 -- # set +x 00:32:32.128 [2024-11-26 05:28:33.215779] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:32.128 05:28:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:32.128 05:28:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.128 05:28:33 -- common/autotest_common.sh@10 -- # set +x 00:32:32.128 05:28:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:32.128 05:28:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.128 05:28:33 -- common/autotest_common.sh@10 -- # set +x 00:32:32.128 05:28:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:32.128 05:28:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.128 05:28:33 -- common/autotest_common.sh@10 -- # set +x 00:32:32.128 [2024-11-26 05:28:33.248102] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:32.128 05:28:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:32.128 05:28:33 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:32.128 EAL: No free 2048 kB hugepages reported on node 1 00:32:35.447 Initializing NVMe Controllers 00:32:35.447 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:35.447 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:35.447 Initialization complete. Launching workers. 00:32:35.447 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12607, failed: 0 00:32:35.447 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1257, failed to submit 11350 00:32:35.447 success 754, unsuccess 503, failed 0 00:32:35.447 05:28:36 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:35.447 05:28:36 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:35.447 EAL: No free 2048 kB hugepages reported on node 1 00:32:38.736 Initializing NVMe Controllers 00:32:38.736 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:38.736 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:38.736 Initialization complete. Launching workers. 00:32:38.736 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8281, failed: 0 00:32:38.736 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1230, failed to submit 7051 00:32:38.736 success 306, unsuccess 924, failed 0 00:32:38.736 05:28:39 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:38.736 05:28:39 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:38.736 EAL: No free 2048 kB hugepages reported on node 1 00:32:41.273 Initializing NVMe Controllers 00:32:41.273 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:41.273 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:41.273 Initialization complete. Launching workers. 00:32:41.273 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 30560, failed: 0 00:32:41.273 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2665, failed to submit 27895 00:32:41.273 success 529, unsuccess 2136, failed 0 00:32:41.273 05:28:42 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:41.273 05:28:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:41.273 05:28:42 -- common/autotest_common.sh@10 -- # set +x 00:32:41.273 05:28:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:41.273 05:28:42 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:41.273 05:28:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:41.273 05:28:42 -- common/autotest_common.sh@10 -- # set +x 00:32:42.651 05:28:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:42.651 05:28:44 -- target/abort_qd_sizes.sh@62 -- # killprocess 3450980 00:32:42.651 05:28:44 -- common/autotest_common.sh@936 -- # '[' -z 3450980 ']' 00:32:42.651 05:28:44 -- common/autotest_common.sh@940 -- # kill -0 3450980 00:32:42.651 05:28:44 -- common/autotest_common.sh@941 -- # uname 00:32:42.651 05:28:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:42.651 05:28:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3450980 00:32:42.651 05:28:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:42.651 05:28:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:42.651 05:28:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3450980' 00:32:42.651 killing process with pid 3450980 00:32:42.651 05:28:44 -- common/autotest_common.sh@955 -- # kill 3450980 00:32:42.651 05:28:44 -- common/autotest_common.sh@960 -- # wait 3450980 00:32:42.911 00:32:42.911 real 0m14.153s 00:32:42.911 user 0m55.518s 00:32:42.911 sys 0m2.902s 00:32:42.911 05:28:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:42.911 05:28:44 -- common/autotest_common.sh@10 -- # set +x 00:32:42.911 ************************************ 00:32:42.911 END TEST spdk_target_abort 00:32:42.911 ************************************ 00:32:42.911 05:28:44 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:42.911 05:28:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:42.911 05:28:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:42.911 05:28:44 -- common/autotest_common.sh@10 -- # set +x 00:32:42.911 ************************************ 00:32:42.911 START TEST kernel_target_abort 00:32:42.911 ************************************ 00:32:42.911 05:28:44 -- common/autotest_common.sh@1114 -- # kernel_target 00:32:42.911 05:28:44 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:42.911 05:28:44 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:42.911 05:28:44 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:42.911 05:28:44 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:42.911 05:28:44 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:42.911 05:28:44 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:42.911 05:28:44 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:42.911 05:28:44 -- nvmf/common.sh@627 -- # local block nvme 00:32:42.911 05:28:44 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:42.911 05:28:44 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:42.911 05:28:44 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:42.911 05:28:44 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:44.288 Waiting for block devices as requested 00:32:44.288 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:44.288 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:44.288 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:44.288 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:44.548 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:44.548 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:44.548 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:44.548 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:44.808 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:44.808 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:44.808 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:44.808 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:45.068 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:45.068 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:45.068 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:45.068 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:45.327 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:45.327 05:28:46 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:45.327 05:28:46 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:45.327 05:28:46 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:45.327 05:28:46 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:45.327 05:28:46 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:45.327 No valid GPT data, bailing 00:32:45.327 05:28:47 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:45.327 05:28:47 -- scripts/common.sh@393 -- # pt= 00:32:45.327 05:28:47 -- scripts/common.sh@394 -- # return 1 00:32:45.327 05:28:47 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:45.327 05:28:47 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:45.327 05:28:47 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:45.327 05:28:47 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:45.327 05:28:47 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:45.327 05:28:47 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:45.327 05:28:47 -- nvmf/common.sh@654 -- # echo 1 00:32:45.327 05:28:47 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:45.327 05:28:47 -- nvmf/common.sh@656 -- # echo 1 00:32:45.327 05:28:47 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:45.327 05:28:47 -- nvmf/common.sh@663 -- # echo tcp 00:32:45.327 05:28:47 -- nvmf/common.sh@664 -- # echo 4420 00:32:45.327 05:28:47 -- nvmf/common.sh@665 -- # echo ipv4 00:32:45.327 05:28:47 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:45.327 05:28:47 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:45.586 00:32:45.586 Discovery Log Number of Records 2, Generation counter 2 00:32:45.586 =====Discovery Log Entry 0====== 00:32:45.586 trtype: tcp 00:32:45.586 adrfam: ipv4 00:32:45.586 subtype: current discovery subsystem 00:32:45.586 treq: not specified, sq flow control disable supported 00:32:45.586 portid: 1 00:32:45.586 trsvcid: 4420 00:32:45.586 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:45.586 traddr: 10.0.0.1 00:32:45.586 eflags: none 00:32:45.586 sectype: none 00:32:45.586 =====Discovery Log Entry 1====== 00:32:45.586 trtype: tcp 00:32:45.586 adrfam: ipv4 00:32:45.586 subtype: nvme subsystem 00:32:45.586 treq: not specified, sq flow control disable supported 00:32:45.586 portid: 1 00:32:45.586 trsvcid: 4420 00:32:45.586 subnqn: kernel_target 00:32:45.586 traddr: 10.0.0.1 00:32:45.586 eflags: none 00:32:45.586 sectype: none 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:45.586 05:28:47 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:45.586 EAL: No free 2048 kB hugepages reported on node 1 00:32:48.873 Initializing NVMe Controllers 00:32:48.873 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:48.873 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:48.873 Initialization complete. Launching workers. 00:32:48.873 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 42710, failed: 0 00:32:48.873 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 42710, failed to submit 0 00:32:48.873 success 0, unsuccess 42710, failed 0 00:32:48.873 05:28:50 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:48.873 05:28:50 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:48.873 EAL: No free 2048 kB hugepages reported on node 1 00:32:52.189 Initializing NVMe Controllers 00:32:52.189 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:52.189 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:52.189 Initialization complete. Launching workers. 00:32:52.189 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 76052, failed: 0 00:32:52.189 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19154, failed to submit 56898 00:32:52.189 success 0, unsuccess 19154, failed 0 00:32:52.189 05:28:53 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:52.189 05:28:53 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:52.189 EAL: No free 2048 kB hugepages reported on node 1 00:32:54.724 Initializing NVMe Controllers 00:32:54.724 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:54.724 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:54.724 Initialization complete. Launching workers. 00:32:54.724 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 73893, failed: 0 00:32:54.724 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18454, failed to submit 55439 00:32:54.724 success 0, unsuccess 18454, failed 0 00:32:54.724 05:28:56 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:32:54.724 05:28:56 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:32:54.724 05:28:56 -- nvmf/common.sh@677 -- # echo 0 00:32:54.724 05:28:56 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:32:54.724 05:28:56 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:54.724 05:28:56 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:32:54.724 05:28:56 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:54.724 05:28:56 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:32:54.724 05:28:56 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:32:54.983 00:32:54.984 real 0m11.972s 00:32:54.984 user 0m5.401s 00:32:54.984 sys 0m2.455s 00:32:54.984 05:28:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:54.984 05:28:56 -- common/autotest_common.sh@10 -- # set +x 00:32:54.984 ************************************ 00:32:54.984 END TEST kernel_target_abort 00:32:54.984 ************************************ 00:32:54.984 05:28:56 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:32:54.984 05:28:56 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:32:54.984 05:28:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:54.984 05:28:56 -- nvmf/common.sh@116 -- # sync 00:32:54.984 05:28:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:54.984 05:28:56 -- nvmf/common.sh@119 -- # set +e 00:32:54.984 05:28:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:54.984 05:28:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:54.984 rmmod nvme_tcp 00:32:54.984 rmmod nvme_fabrics 00:32:54.984 rmmod nvme_keyring 00:32:54.984 05:28:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:54.984 05:28:56 -- nvmf/common.sh@123 -- # set -e 00:32:54.984 05:28:56 -- nvmf/common.sh@124 -- # return 0 00:32:54.984 05:28:56 -- nvmf/common.sh@477 -- # '[' -n 3450980 ']' 00:32:54.984 05:28:56 -- nvmf/common.sh@478 -- # killprocess 3450980 00:32:54.984 05:28:56 -- common/autotest_common.sh@936 -- # '[' -z 3450980 ']' 00:32:54.984 05:28:56 -- common/autotest_common.sh@940 -- # kill -0 3450980 00:32:54.984 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3450980) - No such process 00:32:54.984 05:28:56 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3450980 is not found' 00:32:54.984 Process with pid 3450980 is not found 00:32:54.984 05:28:56 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:54.984 05:28:56 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:55.920 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:55.920 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:55.920 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:56.178 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:56.178 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:56.178 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:56.178 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:56.178 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:56.178 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:56.178 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:56.178 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:56.178 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:56.178 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:56.178 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:56.178 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:56.178 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:56.178 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:56.438 05:28:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:56.438 05:28:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:56.438 05:28:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:56.438 05:28:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:56.438 05:28:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:56.438 05:28:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:56.438 05:28:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:58.342 05:28:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:58.342 00:32:58.342 real 0m35.310s 00:32:58.342 user 1m3.310s 00:32:58.342 sys 0m8.768s 00:32:58.342 05:28:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:58.342 05:28:59 -- common/autotest_common.sh@10 -- # set +x 00:32:58.342 ************************************ 00:32:58.342 END TEST nvmf_abort_qd_sizes 00:32:58.342 ************************************ 00:32:58.342 05:29:00 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:32:58.342 05:29:00 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:32:58.342 05:29:00 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:32:58.342 05:29:00 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:32:58.342 05:29:00 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:32:58.342 05:29:00 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:32:58.342 05:29:00 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:32:58.342 05:29:00 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:32:58.342 05:29:00 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:32:58.343 05:29:00 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:32:58.343 05:29:00 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:32:58.343 05:29:00 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:32:58.343 05:29:00 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:32:58.343 05:29:00 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:32:58.343 05:29:00 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:32:58.343 05:29:00 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:32:58.343 05:29:00 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:32:58.343 05:29:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:58.343 05:29:00 -- common/autotest_common.sh@10 -- # set +x 00:32:58.343 05:29:00 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:32:58.343 05:29:00 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:32:58.343 05:29:00 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:32:58.343 05:29:00 -- common/autotest_common.sh@10 -- # set +x 00:33:00.245 INFO: APP EXITING 00:33:00.245 INFO: killing all VMs 00:33:00.245 INFO: killing vhost app 00:33:00.245 INFO: EXIT DONE 00:33:01.180 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:01.180 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:01.180 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:01.180 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:01.180 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:01.180 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:01.180 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:01.180 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:01.180 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:01.180 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:01.180 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:01.439 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:01.439 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:01.439 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:01.439 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:01.439 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:01.439 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:02.817 Cleaning 00:33:02.817 Removing: /var/run/dpdk/spdk0/config 00:33:02.817 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:02.817 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:02.817 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:02.817 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:02.817 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:02.817 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:02.817 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:02.817 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:02.817 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:02.817 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:02.817 Removing: /var/run/dpdk/spdk1/config 00:33:02.817 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:02.817 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:02.817 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:02.817 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:02.817 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:02.817 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:02.817 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:02.817 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:02.817 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:02.817 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:02.817 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:02.817 Removing: /var/run/dpdk/spdk2/config 00:33:02.817 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:02.817 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:02.817 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:02.817 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:02.817 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:02.817 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:02.817 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:02.817 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:02.817 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:02.817 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:02.817 Removing: /var/run/dpdk/spdk3/config 00:33:02.817 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:02.817 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:02.817 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:02.817 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:02.817 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:02.817 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:02.817 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:02.817 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:02.817 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:02.817 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:02.817 Removing: /var/run/dpdk/spdk4/config 00:33:02.817 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:02.817 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:02.817 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:02.817 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:02.817 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:02.817 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:02.817 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:02.817 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:02.817 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:02.817 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:02.817 Removing: /dev/shm/bdev_svc_trace.1 00:33:02.817 Removing: /dev/shm/nvmf_trace.0 00:33:02.817 Removing: /dev/shm/spdk_tgt_trace.pid3171318 00:33:02.817 Removing: /var/run/dpdk/spdk0 00:33:02.817 Removing: /var/run/dpdk/spdk1 00:33:02.817 Removing: /var/run/dpdk/spdk2 00:33:02.817 Removing: /var/run/dpdk/spdk3 00:33:02.817 Removing: /var/run/dpdk/spdk4 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3169597 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3170359 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3171318 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3171814 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3173163 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3174111 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3174385 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3174649 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3174988 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3175195 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3175457 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3175633 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3175822 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3176294 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3178850 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3179147 00:33:02.817 Removing: /var/run/dpdk/spdk_pid3179316 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3179458 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3179895 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3180031 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3180353 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3180493 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3180659 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3180801 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3180973 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3181115 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3181595 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3181762 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3181978 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3182150 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3182294 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3182357 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3182503 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3182775 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3182922 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3183084 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3183224 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3183505 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3183645 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3183814 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3183954 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3184252 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3184467 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3184645 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3184788 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3185066 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3185281 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3185790 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3186028 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3186307 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3186451 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3186611 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3186755 00:33:02.818 Removing: /var/run/dpdk/spdk_pid3187035 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3187173 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3187338 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3187478 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3187762 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3187904 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3188059 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3188208 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3188484 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3188631 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3188786 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3188942 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3189215 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3189361 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3189523 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3189687 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3189946 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3190091 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3190245 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3190448 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3190659 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3192885 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3250334 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3252999 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3260250 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3263606 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3266056 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3266531 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3270422 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3270428 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3271101 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3271691 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3272336 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3272873 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3272882 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3273029 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3273161 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3273169 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3273846 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3274537 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3275186 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3276021 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3276208 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3276377 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3277435 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3278307 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3283922 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3284206 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3286892 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3290686 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3292921 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3299550 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3304970 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3306325 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3307003 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3318160 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3320377 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3323297 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3324438 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3325929 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3326079 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3326352 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3326504 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3327098 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3328464 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3329487 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3329938 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3333563 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3337081 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3340781 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3365097 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3367876 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3372383 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3373365 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3374489 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3377204 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3379731 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3384124 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3384130 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3387085 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3387292 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3387482 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3387757 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3387762 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3388867 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3390086 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3391300 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3392516 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3393752 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3394969 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3398986 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3399324 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3400729 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3401521 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3405931 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3407978 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3411597 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3415356 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3418901 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3419442 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3419857 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3420281 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3420870 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3421296 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3421846 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3422398 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3425067 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3425216 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3429073 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3429255 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3431026 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3436809 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3436818 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3439894 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3441330 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3442772 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3443554 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3444986 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3445900 00:33:03.077 Removing: /var/run/dpdk/spdk_pid3451420 00:33:03.078 Removing: /var/run/dpdk/spdk_pid3451827 00:33:03.078 Removing: /var/run/dpdk/spdk_pid3452236 00:33:03.078 Removing: /var/run/dpdk/spdk_pid3453711 00:33:03.078 Removing: /var/run/dpdk/spdk_pid3454118 00:33:03.078 Removing: /var/run/dpdk/spdk_pid3454530 00:33:03.078 Clean 00:33:03.336 killing process with pid 3141027 00:33:13.310 killing process with pid 3141024 00:33:13.310 killing process with pid 3141026 00:33:13.310 killing process with pid 3141025 00:33:13.310 05:29:13 -- common/autotest_common.sh@1446 -- # return 0 00:33:13.310 05:29:13 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:13.310 05:29:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:13.310 05:29:13 -- common/autotest_common.sh@10 -- # set +x 00:33:13.310 05:29:13 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:13.310 05:29:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:13.310 05:29:13 -- common/autotest_common.sh@10 -- # set +x 00:33:13.310 05:29:13 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:13.310 05:29:13 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:13.310 05:29:13 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:13.310 05:29:13 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:13.310 05:29:13 -- spdk/autotest.sh@383 -- # hostname 00:33:13.310 05:29:13 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:13.310 geninfo: WARNING: invalid characters removed from testname! 00:33:52.012 05:29:47 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:52.012 05:29:51 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:52.269 05:29:53 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:55.594 05:29:56 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:58.129 05:29:59 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:00.659 05:30:02 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:03.944 05:30:05 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:03.944 05:30:05 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:34:03.944 05:30:05 -- common/autotest_common.sh@1690 -- $ lcov --version 00:34:03.944 05:30:05 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:34:03.944 05:30:05 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:34:03.944 05:30:05 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:34:03.944 05:30:05 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:34:03.944 05:30:05 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:34:03.944 05:30:05 -- scripts/common.sh@335 -- $ IFS=.-: 00:34:03.944 05:30:05 -- scripts/common.sh@335 -- $ read -ra ver1 00:34:03.944 05:30:05 -- scripts/common.sh@336 -- $ IFS=.-: 00:34:03.944 05:30:05 -- scripts/common.sh@336 -- $ read -ra ver2 00:34:03.944 05:30:05 -- scripts/common.sh@337 -- $ local 'op=<' 00:34:03.944 05:30:05 -- scripts/common.sh@339 -- $ ver1_l=2 00:34:03.944 05:30:05 -- scripts/common.sh@340 -- $ ver2_l=1 00:34:03.944 05:30:05 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:34:03.944 05:30:05 -- scripts/common.sh@343 -- $ case "$op" in 00:34:03.944 05:30:05 -- scripts/common.sh@344 -- $ : 1 00:34:03.944 05:30:05 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:34:03.944 05:30:05 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:34:03.944 05:30:05 -- scripts/common.sh@364 -- $ decimal 1 00:34:03.944 05:30:05 -- scripts/common.sh@352 -- $ local d=1 00:34:03.944 05:30:05 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:34:03.944 05:30:05 -- scripts/common.sh@354 -- $ echo 1 00:34:03.944 05:30:05 -- scripts/common.sh@364 -- $ ver1[v]=1 00:34:03.945 05:30:05 -- scripts/common.sh@365 -- $ decimal 2 00:34:03.945 05:30:05 -- scripts/common.sh@352 -- $ local d=2 00:34:03.945 05:30:05 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:34:03.945 05:30:05 -- scripts/common.sh@354 -- $ echo 2 00:34:03.945 05:30:05 -- scripts/common.sh@365 -- $ ver2[v]=2 00:34:03.945 05:30:05 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:34:03.945 05:30:05 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:34:03.945 05:30:05 -- scripts/common.sh@367 -- $ return 0 00:34:03.945 05:30:05 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:34:03.945 05:30:05 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:34:03.945 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:03.945 --rc genhtml_branch_coverage=1 00:34:03.945 --rc genhtml_function_coverage=1 00:34:03.945 --rc genhtml_legend=1 00:34:03.945 --rc geninfo_all_blocks=1 00:34:03.945 --rc geninfo_unexecuted_blocks=1 00:34:03.945 00:34:03.945 ' 00:34:03.945 05:30:05 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:34:03.945 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:03.945 --rc genhtml_branch_coverage=1 00:34:03.945 --rc genhtml_function_coverage=1 00:34:03.945 --rc genhtml_legend=1 00:34:03.945 --rc geninfo_all_blocks=1 00:34:03.945 --rc geninfo_unexecuted_blocks=1 00:34:03.945 00:34:03.945 ' 00:34:03.945 05:30:05 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:34:03.945 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:03.945 --rc genhtml_branch_coverage=1 00:34:03.945 --rc genhtml_function_coverage=1 00:34:03.945 --rc genhtml_legend=1 00:34:03.945 --rc geninfo_all_blocks=1 00:34:03.945 --rc geninfo_unexecuted_blocks=1 00:34:03.945 00:34:03.945 ' 00:34:03.945 05:30:05 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:34:03.945 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:03.945 --rc genhtml_branch_coverage=1 00:34:03.945 --rc genhtml_function_coverage=1 00:34:03.945 --rc genhtml_legend=1 00:34:03.945 --rc geninfo_all_blocks=1 00:34:03.945 --rc geninfo_unexecuted_blocks=1 00:34:03.945 00:34:03.945 ' 00:34:03.945 05:30:05 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:03.945 05:30:05 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:03.945 05:30:05 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:03.945 05:30:05 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:03.945 05:30:05 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:03.945 05:30:05 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:03.945 05:30:05 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:03.945 05:30:05 -- paths/export.sh@5 -- $ export PATH 00:34:03.945 05:30:05 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:03.945 05:30:05 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:34:03.945 05:30:05 -- common/autobuild_common.sh@440 -- $ date +%s 00:34:03.945 05:30:05 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732595405.XXXXXX 00:34:03.945 05:30:05 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732595405.KlBs3f 00:34:03.945 05:30:05 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:34:03.945 05:30:05 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:34:03.945 05:30:05 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:34:03.945 05:30:05 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:34:03.945 05:30:05 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:03.945 05:30:05 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:03.945 05:30:05 -- common/autobuild_common.sh@456 -- $ get_config_params 00:34:03.945 05:30:05 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:34:03.945 05:30:05 -- common/autotest_common.sh@10 -- $ set +x 00:34:03.945 05:30:05 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:34:03.945 05:30:05 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:34:03.945 05:30:05 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:03.945 05:30:05 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:03.945 05:30:05 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:03.945 05:30:05 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:03.945 05:30:05 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:03.945 05:30:05 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:03.945 05:30:05 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:03.945 05:30:05 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:03.945 05:30:05 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:03.945 + [[ -n 3086540 ]] 00:34:03.945 + sudo kill 3086540 00:34:03.957 [Pipeline] } 00:34:03.973 [Pipeline] // stage 00:34:03.978 [Pipeline] } 00:34:03.992 [Pipeline] // timeout 00:34:03.998 [Pipeline] } 00:34:04.011 [Pipeline] // catchError 00:34:04.016 [Pipeline] } 00:34:04.031 [Pipeline] // wrap 00:34:04.037 [Pipeline] } 00:34:04.050 [Pipeline] // catchError 00:34:04.059 [Pipeline] stage 00:34:04.062 [Pipeline] { (Epilogue) 00:34:04.075 [Pipeline] catchError 00:34:04.076 [Pipeline] { 00:34:04.090 [Pipeline] echo 00:34:04.092 Cleanup processes 00:34:04.098 [Pipeline] sh 00:34:04.386 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:04.386 3466944 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:04.402 [Pipeline] sh 00:34:04.689 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:04.689 ++ grep -v 'sudo pgrep' 00:34:04.689 ++ awk '{print $1}' 00:34:04.689 + sudo kill -9 00:34:04.689 + true 00:34:04.702 [Pipeline] sh 00:34:04.987 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:14.974 [Pipeline] sh 00:34:15.264 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:15.264 Artifacts sizes are good 00:34:15.281 [Pipeline] archiveArtifacts 00:34:15.288 Archiving artifacts 00:34:15.457 [Pipeline] sh 00:34:15.742 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:15.758 [Pipeline] cleanWs 00:34:15.780 [WS-CLEANUP] Deleting project workspace... 00:34:15.780 [WS-CLEANUP] Deferred wipeout is used... 00:34:15.820 [WS-CLEANUP] done 00:34:15.821 [Pipeline] } 00:34:15.837 [Pipeline] // catchError 00:34:15.849 [Pipeline] sh 00:34:16.129 + logger -p user.info -t JENKINS-CI 00:34:16.137 [Pipeline] } 00:34:16.150 [Pipeline] // stage 00:34:16.156 [Pipeline] } 00:34:16.171 [Pipeline] // node 00:34:16.176 [Pipeline] End of Pipeline 00:34:16.217 Finished: SUCCESS